-- Logs begin at Wed 2022-08-24 09:53:56 UTC, end at Wed 2022-08-24 11:02:13 UTC. -- Aug 24 10:23:51.139197 dv-cinder-854274-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 10:23:51.146771 dv-cinder-854274-2-smb devstack@keystone.service[81619]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 10:23:51 2022] *** Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: nodename: dv-cinder-854274-2-smb Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: machine: x86_64 Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: clock source: unix Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: pcre jit disabled Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: detected number of CPU cores: 4 Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: current working directory: / Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: detected binary path: /usr/bin/uwsgi-core Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: your processes number limit is 47680 Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: your memory page size is 4096 bytes Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: detected max file descriptor number: 2048 Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: lock engine: pthread robust mutexes Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: thunder lock: enabled Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 10:23:51.150816 dv-cinder-854274-2-smb devstack@keystone.service[81619]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 10:23:51.190098 dv-cinder-854274-2-smb devstack@keystone.service[81619]: Python main interpreter initialized at 0x561ca5c9e9c0 Aug 24 10:23:51.190098 dv-cinder-854274-2-smb devstack@keystone.service[81619]: python threads support enabled Aug 24 10:23:51.190098 dv-cinder-854274-2-smb devstack@keystone.service[81619]: your server socket listen backlog is limited to 100 connections Aug 24 10:23:51.190098 dv-cinder-854274-2-smb devstack@keystone.service[81619]: your mercy for graceful operations on workers is 90 seconds Aug 24 10:23:51.190487 dv-cinder-854274-2-smb devstack@keystone.service[81619]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 10:23:51.190565 dv-cinder-854274-2-smb devstack@keystone.service[81619]: *** Operational MODE: preforking *** Aug 24 10:23:51.190817 dv-cinder-854274-2-smb devstack@keystone.service[81619]: *** uWSGI is running in multiple interpreter mode *** Aug 24 10:23:51.190817 dv-cinder-854274-2-smb devstack@keystone.service[81619]: spawned uWSGI master process (pid: 81619) Aug 24 10:23:51.191031 dv-cinder-854274-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 10:23:51.192856 dv-cinder-854274-2-smb devstack@keystone.service[81619]: spawned uWSGI worker 1 (pid: 81632, cores: 1) Aug 24 10:23:51.192856 dv-cinder-854274-2-smb devstack@keystone.service[81619]: spawned uWSGI worker 2 (pid: 81633, cores: 1) Aug 24 10:23:51.192856 dv-cinder-854274-2-smb devstack@keystone.service[81619]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 10:23:55.555771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:23:55.555771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: from cryptography.utils import int_from_bytes Aug 24 10:23:55.556556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:23:55.556556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: from cryptography.utils import int_from_bytes Aug 24 10:23:55.560862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:23:55.560862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: from cryptography.utils import int_from_bytes Aug 24 10:23:55.561333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:23:55.561333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: from cryptography.utils import int_from_bytes Aug 24 10:23:55.616997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:23:55.616997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:23:55.616997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] command line args: [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:23:55.616997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:23:55.616997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ================================================================================ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:23:55.617376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:23:55.617447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] admin_token = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.617513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:23:55.617578 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] config_dir = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.617641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] command line args: [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:23:55.617704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.617762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:23:55.617830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] config_source = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.617895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ================================================================================ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:23:55.617958 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] debug = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.618023 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] admin_token = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.618085 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.618437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config_dir = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.618503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.618567 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.618631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.618695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config_source = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.618695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] debug = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.618816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.618878 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.618960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_config_append = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_dir = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_file = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619646 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_config_append = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_dir = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.619982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620242 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620314 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620374 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620701 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620884 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.620942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621129 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621547 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621714 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.91/identity {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621714 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] publish_errors = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621856 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.621940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.91/identity {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622109 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] publish_errors = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622459 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] standard_threads = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622826 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622949 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.622949 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623129 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_journal = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] standard_threads = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_json = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_stderr = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_syslog = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_journal = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623740 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.623818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_json = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.623910 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.624045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_stderr = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.624122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_syslog = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.624184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.624301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:23:55.624458 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.624560 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.624643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.624800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.624880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.625063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.625165 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.625298 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.625380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.625548 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.625634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.625786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.625866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.626037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.626130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.626308 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.626399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.626560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.626640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.626801 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.626894 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.627054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.627135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.627307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.627387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.627549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.627630 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.627806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.627898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.628057 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.628137 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.628306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.628385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.628544 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.628634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.628801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.628881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.629054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.629132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.629300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.629379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.629537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.629623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.629775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.629853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.630013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.630130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.630335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.630453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.630571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.630684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.630801 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.630913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.631033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.631144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.631254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.631370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.631492 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.631599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.631702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.631844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.631940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.632135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.632332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.632462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.632462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.632685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.632685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.632901 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.633012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.633115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.633226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.633336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.633453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.633567 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.633684 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.633803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.633916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.634026 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.634136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.634246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.634386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.634511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.634511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.634717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.634812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.634905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.634999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.635103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.635205 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.635301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.635444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.635551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.635655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.635794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.635906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.636023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.636138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.636250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.636385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.636566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.636693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.636809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.636921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.637032 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.637150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.637263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.637383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.638094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.638238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.638396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.638512 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.638646 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.638889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.639009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.639124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.639245 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.639380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.639496 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.639615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.639773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.639904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.640019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.640132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.640239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.640358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.640471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.640573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.640684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.640803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.640915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.641058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.641176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.641290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.641391 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.641501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.641613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.641725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.641845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.642036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.642154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.642272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.642392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.642505 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.642694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.642810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.642922 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.643035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.643147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.643265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.643387 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.643500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.643612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.643749 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.643866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.643990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.644114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.644240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.644354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.644472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.644585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.644698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.644810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.644931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.645050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.645171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.645285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.645398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.645545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.645670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.645784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.645897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.646010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.646124 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.646243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.646365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.646479 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.646597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.646711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.646824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.646936 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.647056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.647171 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.647284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.647641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.647778 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.647894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.648003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.648121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.648242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.648355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.648468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.648579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.648702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.648821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.648933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.649049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.649161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.649274 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.649397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.649511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.649631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.external = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.649744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.649856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.649968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.650088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.650204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.650318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.650430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.650552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.password = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.650696 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.external = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.650819 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.token = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.650933 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.651057 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.651171 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.651283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.651397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.651516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.651637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.651815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.password = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.651931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.652045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.token = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.652157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.652270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.652395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.652511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.652625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.652738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.652850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.652963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.653091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.653284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.653966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.654140 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.654338 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.654508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.654636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.654752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.654885 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.655015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.655128 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.655242 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.655364 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.655480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.655635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.655777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.655892 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.656005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.656132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.656255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.656369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.656483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.656597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.656710 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.656831 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.657027 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.657134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.657229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.657324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.657442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.657624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.657726 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.657822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.657929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.658026 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.658160 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.658273 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.658415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.658519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.658646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.658749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.658883 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.658995 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.659131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.659235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.659378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.659481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.659609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.659779 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.659885 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.659982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.660106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.660209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.660358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.662806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.662806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.663985 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664058 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664209 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664797 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.664939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665713 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.665934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666158 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666888 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.666962 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.667032 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.667133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.667253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.667374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.667460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.667613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.667692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.667890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.667970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.668125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.668220 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.668370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.668453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.668616 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.668694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.668984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.669118 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.669364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.669659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.669995 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.670113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.670228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.670351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.670466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.670675 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.670793 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.670907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.671020 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.671141 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.671257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.671371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.671484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.671597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.671710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.671885 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.672001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.672115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.672228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.672392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.672509 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.672631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.672746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.672859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.672971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.673084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.673197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.673353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.673472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.673607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.673725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.673858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.673982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.674106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.674220 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.674333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.674447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.674561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.674674 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.674795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.674908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.675021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.675134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.675246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.675367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.675482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.675595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.675751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.675871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.675984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.676110 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.676226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.676340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.676452 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.676567 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.676680 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.676800 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.676915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.677028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.677142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.677254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.677366 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.677487 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.677603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.677715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.677828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.677941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.678054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.678175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.678289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.678402 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.678515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.678629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.678742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.678862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.678977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.679090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.679202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.679353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.679471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.679592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.679708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.679846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.679971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.680086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.680199 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.680325 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.680440 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.680553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.680666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.680780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.680894 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.681083 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.681199 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.681313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.681426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.681546 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.681660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.681783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.681898 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.681898 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.682112 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.682225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.682341 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.682463 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.682577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.682691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.682803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.682917 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.683030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.683151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.683265 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.683378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.683481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.683577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.683670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.683825 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.683945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.684058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] role.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.684171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.684284 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] role.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.684397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.684568 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.684779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.684970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.685151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.685273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.685388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.685510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.685625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.685739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.685892 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.686009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.686009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.686232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.686347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.686459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.686572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.686684 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.686796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.686918 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.687034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.687132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.687228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.687322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.687438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.687552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.687686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.691505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.691624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.691624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.691840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.691919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.691992 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692284 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692721 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692721 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.692994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693071 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693298 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693598 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693884 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.693955 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694112 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694185 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.694927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.695002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.695074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.695144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.695214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.695292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.695413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.695489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.695561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.695632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.695703 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.695825 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.695940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696435 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.696944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697086 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697086 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697224 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697452 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697532 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.697939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.698017 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.698178 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.698257 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.698468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.698547 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.698716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.698794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.698957 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.699044 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.699203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.699288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.699440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.699517 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.699679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.699784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.699938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.700577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.700721 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.700908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.700989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.701262 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.701340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.701593 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.701672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.701844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.701922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.702080 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.702163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.702245 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:23:55.702318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.702553 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.702804 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.703040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.703285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.703515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.703820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.704029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:23:55.704180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:23:55.732599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.732817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.733042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.734312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.734540 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.734765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.741731 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.743590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.770624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.770859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.773305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.773535 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.830779 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.831297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.881484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.881914 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.882897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:55.883131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.054615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.054838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.055061 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.055292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.055508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.055739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.056267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.056497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.056718 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.056935 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.057150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.057363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.086150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.086407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.086511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.086615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.086697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.086817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.086904 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.087036 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.087136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.087255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.087444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.087523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.087587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.087788 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.103660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.103865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.117072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.117313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.117508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.117618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.117733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.117818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.117948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.118031 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.118205 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.118284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.118348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.118410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.118626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.118834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:23:56.139876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.140033 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 10:23:56.140145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.140354 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 10:23:56.140437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.140561 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 10:23:56.140697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.140836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.140918 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 10:23:56.141107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.141188 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.141411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.141622 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.141887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.141965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.142172 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.151657 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.151837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.151958 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.152115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.152230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.152387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.152514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.152672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.160022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.160513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.162926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.164728 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.164811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.164883 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.164956 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165482 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.165966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.166037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.166104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.166176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.166176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.190027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.190336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.191514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.191824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.191909 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.193408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.196534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.196772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.196854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.197054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.197134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.197345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.204314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.204602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.204684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.204892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.208730 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.208998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.209082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.209388 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.209511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.209613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.209703 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.209832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.209917 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.210104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.210185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.210375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.210480 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.210644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.210740 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.210913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.228332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.228449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.228613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.228699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.232900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.233043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.236173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.236273 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.236473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.236558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.240695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.240866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.243846 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.243946 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.247640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.250856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.250856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.251028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.251110 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.251186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.251261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.251343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.251418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.251492 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.251566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.251639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.265766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.265957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.266058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.266256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.266352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.266524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.266607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.266795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.273767 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.273951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.275311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.275482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.275592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.275784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.278310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.278592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.278902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.279002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.279154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.279290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.279459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.279582 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.279766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.279889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.291143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.291291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.291426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.291573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.291729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.291874 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.292016 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.292151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.292294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.292427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.292587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.292700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.292862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.292972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.308316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.308798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.312261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.312721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.315160 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.315573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.316635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.317030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.318118 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.318400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.318484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.318681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.318765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.319042 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.325906 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.326356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.327383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.327856 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.330277 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.330570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.330800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.330887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.331096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.331181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.331378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.331661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.339115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.339404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.339632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.341571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.341703 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.341703 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.347738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.347961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:23:56.348068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.348249 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.348334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.348531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.348615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.348810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.348896 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.349092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.349175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.349366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.349456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.349632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.349715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.349896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.349979 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.350169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.350260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.350446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.350530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.350716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.350799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.350982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.351065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.351242 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.351323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.351497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:23:56.386331 dv-cinder-854274-2-smb devstack@keystone.service[81633]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561ca5c9e9c0 pid: 81633 (default app) Aug 24 10:23:56.386686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561ca5c9e9c0 pid: 81632 (default app) Aug 24 10:23:56.390829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529c4b-8828-4d16-8355-5df617c57e10 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:56.391063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529c4b-8828-4d16-8355-5df617c57e10 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:56.391336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529c4b-8828-4d16-8355-5df617c57e10 None None] PATH_INFO: `/v3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:56.395503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1/1] 10.222.0.91 () {50 vars in 791 bytes} [Wed Aug 24 10:23:56 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:03.922632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588d52-12f5-4b1a-ac7d-ce947584dde0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:03.923162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588d52-12f5-4b1a-ac7d-ce947584dde0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:03.923244 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588d52-12f5-4b1a-ac7d-ce947584dde0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:03.927486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1/2] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:03.934969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39500c46-61c4-40a2-9257-2a98d05b71f3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:03.935609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39500c46-61c4-40a2-9257-2a98d05b71f3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:03.935609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39500c46-61c4-40a2-9257-2a98d05b71f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:04.006360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: INFO dbcounter [None req-39500c46-61c4-40a2-9257-2a98d05b71f3 None None] Registered counter for database keystone Aug 24 10:24:04.026695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG oslo_db.sqlalchemy.engines [None req-39500c46-61c4-40a2-9257-2a98d05b71f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:24:04.034785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writer thread running {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:24:04.241778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG passlib.handlers.bcrypt [None req-39500c46-61c4-40a2-9257-2a98d05b71f3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81633) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 10:24:04.242206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG passlib.handlers.bcrypt [None req-39500c46-61c4-40a2-9257-2a98d05b71f3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81633) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 10:24:04.299252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-39500c46-61c4-40a2-9257-2a98d05b71f3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:04.301032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-39500c46-61c4-40a2-9257-2a98d05b71f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:04.438437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 2/3] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 10:24:04.941982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588d52-12f5-4b1a-ac7d-ce947584dde0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:05.011867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: INFO dbcounter [None req-8c588d52-12f5-4b1a-ac7d-ce947584dde0 None None] Registered counter for database keystone Aug 24 10:24:05.034921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG oslo_db.sqlalchemy.engines [None req-8c588d52-12f5-4b1a-ac7d-ce947584dde0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:24:05.041321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writer thread running {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:24:05.162999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588d52-12f5-4b1a-ac7d-ce947584dde0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:05.167281 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18f973-6420-41fd-af1d-656d0095e300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:05.167957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18f973-6420-41fd-af1d-656d0095e300 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:05.168236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18f973-6420-41fd-af1d-656d0095e300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:05.169276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18f973-6420-41fd-af1d-656d0095e300 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:05.177961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18f973-6420-41fd-af1d-656d0095e300 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:05.229967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ac18f973-6420-41fd-af1d-656d0095e300 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 10:24:05.230238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18f973-6420-41fd-af1d-656d0095e300 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:05.241307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 2/4] 10.222.0.91 () {58 vars in 1324 bytes} [Wed Aug 24 10:24:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:05.247306 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39500c46-61c4-40a2-9257-2a98d05b71f3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:05.261913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39500c46-61c4-40a2-9257-2a98d05b71f3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:05.266463 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc28343-8281-4eea-a59d-2688626cc092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:05.267572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc28343-8281-4eea-a59d-2688626cc092 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:05.267890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc28343-8281-4eea-a59d-2688626cc092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:05.268168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc28343-8281-4eea-a59d-2688626cc092 admin admin] PATH_INFO: `/v3/projects/8164e47598a34978921b5d7bbf1d90ac` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:05.269754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc28343-8281-4eea-a59d-2688626cc092 admin admin] RBAC: Authorizing `identity:get_project(project_id=8164e47598a34978921b5d7bbf1d90ac)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:05.323095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: WARNING keystone.common.rbac_enforcer.enforcer [None req-acc28343-8281-4eea-a59d-2688626cc092 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 10:24:05.323439 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc28343-8281-4eea-a59d-2688626cc092 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:05.328119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 3/5] 10.222.0.91 () {56 vars in 1207 bytes} [Wed Aug 24 10:24:05 2022] GET /identity/v3/projects/8164e47598a34978921b5d7bbf1d90ac => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:07.252541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb63e87-5d19-4245-a994-f20d44b52e06 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:07.253127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb63e87-5d19-4245-a994-f20d44b52e06 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:07.253127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb63e87-5d19-4245-a994-f20d44b52e06 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:07.257285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 3/6] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:24:07.263360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82216373-6545-4700-b17e-44e7c0b924b1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:07.263820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82216373-6545-4700-b17e-44e7c0b924b1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:07.263948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82216373-6545-4700-b17e-44e7c0b924b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:07.285252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-82216373-6545-4700-b17e-44e7c0b924b1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:07.286769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-82216373-6545-4700-b17e-44e7c0b924b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:07.295632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 4/7] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 10:24:07.570180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb63e87-5d19-4245-a994-f20d44b52e06 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:07.582742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb63e87-5d19-4245-a994-f20d44b52e06 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:07.586919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380216d9-e6f6-4981-b71d-b162bc1b5159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:07.587508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380216d9-e6f6-4981-b71d-b162bc1b5159 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:07.587814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380216d9-e6f6-4981-b71d-b162bc1b5159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:07.588084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380216d9-e6f6-4981-b71d-b162bc1b5159 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:07.596666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380216d9-e6f6-4981-b71d-b162bc1b5159 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:07.598436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380216d9-e6f6-4981-b71d-b162bc1b5159 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:07.608352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 4/8] 10.222.0.91 () {58 vars in 1324 bytes} [Wed Aug 24 10:24:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:24:07.614161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82216373-6545-4700-b17e-44e7c0b924b1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:07.623441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82216373-6545-4700-b17e-44e7c0b924b1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:07.627822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdf754-35ae-4fb2-86f4-4428575bceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:07.628455 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdf754-35ae-4fb2-86f4-4428575bceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:07.628736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdf754-35ae-4fb2-86f4-4428575bceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:07.629011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdf754-35ae-4fb2-86f4-4428575bceb4 admin admin] PATH_INFO: `/v3/users/9c9fa0b484ce4f7bb377c75f947c0872` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:07.630322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdf754-35ae-4fb2-86f4-4428575bceb4 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c9fa0b484ce4f7bb377c75f947c0872)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:07.632193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdf754-35ae-4fb2-86f4-4428575bceb4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:07.633732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 5/9] 10.222.0.91 () {56 vars in 1198 bytes} [Wed Aug 24 10:24:07 2022] GET /identity/v3/users/9c9fa0b484ce4f7bb377c75f947c0872 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:09.657179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88835-ee73-4017-9647-29ade29be982 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:09.657698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88835-ee73-4017-9647-29ade29be982 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:09.657698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88835-ee73-4017-9647-29ade29be982 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:09.658971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 5/10] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:09.664940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dfec7-cb31-45dd-9432-e93dfa4bb139 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:09.665446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dfec7-cb31-45dd-9432-e93dfa4bb139 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:09.665446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dfec7-cb31-45dd-9432-e93dfa4bb139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:09.684201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6a8dfec7-cb31-45dd-9432-e93dfa4bb139 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:09.685399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6a8dfec7-cb31-45dd-9432-e93dfa4bb139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:09.697155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689d0c-5248-4375-9fbf-8df986cf31d7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:09.697438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689d0c-5248-4375-9fbf-8df986cf31d7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:09.697714 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689d0c-5248-4375-9fbf-8df986cf31d7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:09.699011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 6/11] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:24:09.704519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93712e-0880-4451-90b9-ee9d2d3d2639 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:09.704799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93712e-0880-4451-90b9-ee9d2d3d2639 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:09.705072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93712e-0880-4451-90b9-ee9d2d3d2639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:09.748246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG passlib.handlers.bcrypt [None req-4e93712e-0880-4451-90b9-ee9d2d3d2639 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81632) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 10:24:09.748666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG passlib.handlers.bcrypt [None req-4e93712e-0880-4451-90b9-ee9d2d3d2639 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81632) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 10:24:09.771329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 6/12] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:09.795130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4e93712e-0880-4451-90b9-ee9d2d3d2639 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:09.796764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4e93712e-0880-4451-90b9-ee9d2d3d2639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:09.902281 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 7/13] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:10.040021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dfec7-cb31-45dd-9432-e93dfa4bb139 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:10.064914 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:10.148562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dfec7-cb31-45dd-9432-e93dfa4bb139 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:10.174945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93712e-0880-4451-90b9-ee9d2d3d2639 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:10.185862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c09190-45a4-46d5-9454-5d529d8b2d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:10.186447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c09190-45a4-46d5-9454-5d529d8b2d38 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:10.186723 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c09190-45a4-46d5-9454-5d529d8b2d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:10.186993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c09190-45a4-46d5-9454-5d529d8b2d38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:10.198661 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c09190-45a4-46d5-9454-5d529d8b2d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b9c09190-45a4-46d5-9454-5d529d8b2d38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:10.207620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:10.208660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:10.209485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 7/14] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:24:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:10.214656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c09190-45a4-46d5-9454-5d529d8b2d38 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:10.282279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93712e-0880-4451-90b9-ee9d2d3d2639 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:10.284590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:10.298960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:10.316758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c09190-45a4-46d5-9454-5d529d8b2d38 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:10.319540 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f342059-a18e-41b8-aa65-2cfc96336b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:10.320428 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f342059-a18e-41b8-aa65-2cfc96336b64 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:10.320709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f342059-a18e-41b8-aa65-2cfc96336b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:10.320981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f342059-a18e-41b8-aa65-2cfc96336b64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:10.355267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2e54e-3bee-4bb2-9859-92d51779624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:10.356464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2e54e-3bee-4bb2-9859-92d51779624c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:10.356747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2e54e-3bee-4bb2-9859-92d51779624c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:10.357162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2e54e-3bee-4bb2-9859-92d51779624c None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:10.357988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2e54e-3bee-4bb2-9859-92d51779624c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:10.358303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2e54e-3bee-4bb2-9859-92d51779624c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:10.359727 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2e54e-3bee-4bb2-9859-92d51779624c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:10.373710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 8/15] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:10.378958 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2e54e-3bee-4bb2-9859-92d51779624c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:10.396705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f342059-a18e-41b8-aa65-2cfc96336b64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:10.398495 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f342059-a18e-41b8-aa65-2cfc96336b64 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:10.494159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2e54e-3bee-4bb2-9859-92d51779624c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:10.506899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 8/16] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:10.512501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f342059-a18e-41b8-aa65-2cfc96336b64 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:10.515935 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:10.531288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb110e9-b55f-4f69-8b87-49ae8d756d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:10.531956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb110e9-b55f-4f69-8b87-49ae8d756d4a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:10.532234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb110e9-b55f-4f69-8b87-49ae8d756d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:10.532504 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb110e9-b55f-4f69-8b87-49ae8d756d4a None admin] PATH_INFO: `/v3/users/9c9fa0b484ce4f7bb377c75f947c0872` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:10.533707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb110e9-b55f-4f69-8b87-49ae8d756d4a None admin] RBAC: Authorizing `identity:get_user(user_id=9c9fa0b484ce4f7bb377c75f947c0872)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:10.535168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb110e9-b55f-4f69-8b87-49ae8d756d4a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:10.536780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 9/17] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:10 2022] GET /identity/v3/users/9c9fa0b484ce4f7bb377c75f947c0872 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:10.542376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb110e9-b55f-4f69-8b87-49ae8d756d4a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:10.557557 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:10.621035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f342059-a18e-41b8-aa65-2cfc96336b64 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:10.648539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb110e9-b55f-4f69-8b87-49ae8d756d4a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:10.658242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe48f4-ea95-4fd9-8fda-0f234011ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:10.659103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe48f4-ea95-4fd9-8fda-0f234011ae3a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:10.659383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe48f4-ea95-4fd9-8fda-0f234011ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:10.659653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe48f4-ea95-4fd9-8fda-0f234011ae3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:10.679016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe48f4-ea95-4fd9-8fda-0f234011ae3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:10.680573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe48f4-ea95-4fd9-8fda-0f234011ae3a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:10.685700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745be8-cc3c-4c2d-bd07-89682cff1a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:10.686329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745be8-cc3c-4c2d-bd07-89682cff1a88 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:10.686604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745be8-cc3c-4c2d-bd07-89682cff1a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:10.686872 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745be8-cc3c-4c2d-bd07-89682cff1a88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:10.688022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae745be8-cc3c-4c2d-bd07-89682cff1a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:10.689470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae745be8-cc3c-4c2d-bd07-89682cff1a88 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:10.691004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 10/18] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:10.696817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745be8-cc3c-4c2d-bd07-89682cff1a88 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-50fe48f4-ea95-4fd9-8fda-0f234011ae3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:10.701152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:10.702351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:10.703355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:10.703355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:10.703355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:10.703355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 9/19] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:24:10.709729 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe48f4-ea95-4fd9-8fda-0f234011ae3a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:10.768296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:10.785525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:10.805199 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745be8-cc3c-4c2d-bd07-89682cff1a88 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:10.816397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe48f4-ea95-4fd9-8fda-0f234011ae3a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:10.843419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592dc65-7b40-44f3-bde5-a170fe1459fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:10.844061 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592dc65-7b40-44f3-bde5-a170fe1459fa None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:10.844334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592dc65-7b40-44f3-bde5-a170fe1459fa None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:10.844603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592dc65-7b40-44f3-bde5-a170fe1459fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:10.845323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592dc65-7b40-44f3-bde5-a170fe1459fa None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.domain.id=default, user.id=9c9fa0b484ce4f7bb377c75f947c0872) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:10.845625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592dc65-7b40-44f3-bde5-a170fe1459fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:10.847192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592dc65-7b40-44f3-bde5-a170fe1459fa None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:10.851756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b090d5e-b9b2-4ca8-b045-68e68e224e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:10.852366 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b090d5e-b9b2-4ca8-b045-68e68e224e86 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:10.852647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b090d5e-b9b2-4ca8-b045-68e68e224e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:10.852918 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b090d5e-b9b2-4ca8-b045-68e68e224e86 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:10.853564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b090d5e-b9b2-4ca8-b045-68e68e224e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:10.853866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b090d5e-b9b2-4ca8-b045-68e68e224e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:10.854311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 11/20] 10.222.0.91 () {56 vars in 1322 bytes} [Wed Aug 24 10:24:10 2022] GET /identity/v3/role_assignments?user.id=9c9fa0b484ce4f7bb377c75f947c0872&scope.domain.id=default&role.id=60abeefc9ac84e31a0162ac559220669 => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:10.855248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b090d5e-b9b2-4ca8-b045-68e68e224e86 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:10.878306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 10/21] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:12.899603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d601a8-7d2c-4ed8-9801-d29875200c5c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:12.900149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d601a8-7d2c-4ed8-9801-d29875200c5c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:12.900411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d601a8-7d2c-4ed8-9801-d29875200c5c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:12.901997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 12/22] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:12.912327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866cbb8-3bca-433c-b824-701760c9398e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:12.913231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866cbb8-3bca-433c-b824-701760c9398e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:12.913729 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866cbb8-3bca-433c-b824-701760c9398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:12.936631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d866cbb8-3bca-433c-b824-701760c9398e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:12.938177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d866cbb8-3bca-433c-b824-701760c9398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:13.024997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 11/23] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:13.226651 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683762c3-491c-4223-b9ce-a7033c119a06 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:13.227348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683762c3-491c-4223-b9ce-a7033c119a06 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:13.227848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683762c3-491c-4223-b9ce-a7033c119a06 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:13.229724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 13/24] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:13.236477 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dda396-29c9-42cc-9d47-ef4aacd0e27c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:13.237334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dda396-29c9-42cc-9d47-ef4aacd0e27c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:13.238047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dda396-29c9-42cc-9d47-ef4aacd0e27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:13.265067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b4dda396-29c9-42cc-9d47-ef4aacd0e27c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:13.266614 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b4dda396-29c9-42cc-9d47-ef4aacd0e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:13.311093 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf95af-840f-432b-b443-5673abceb730 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:13.311704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf95af-840f-432b-b443-5673abceb730 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:13.312235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf95af-840f-432b-b443-5673abceb730 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:13.313795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 14/25] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:24:13.325611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a9936-e6dc-4993-825c-8d4403076c1b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:13.326326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a9936-e6dc-4993-825c-8d4403076c1b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:13.326814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a9936-e6dc-4993-825c-8d4403076c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:13.329579 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:13.359733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9a4a9936-e6dc-4993-825c-8d4403076c1b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:13.360923 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9a4a9936-e6dc-4993-825c-8d4403076c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:13.381611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 12/26] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:13.461054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 15/27] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:13.530105 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dda396-29c9-42cc-9d47-ef4aacd0e27c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:13.672066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dda396-29c9-42cc-9d47-ef4aacd0e27c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:13.716673 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0c7b-09e2-45aa-92cb-3adc842d305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:13.717319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0c7b-09e2-45aa-92cb-3adc842d305c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:13.717597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0c7b-09e2-45aa-92cb-3adc842d305c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:13.717867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0c7b-09e2-45aa-92cb-3adc842d305c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:13.735566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e0c7b-09e2-45aa-92cb-3adc842d305c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-891e0c7b-09e2-45aa-92cb-3adc842d305c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:13.742034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:13.742893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:13.744152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 13/28] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:24:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:13.750957 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a9936-e6dc-4993-825c-8d4403076c1b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:13.804399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0c7b-09e2-45aa-92cb-3adc842d305c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:13.848089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:13.870607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a9936-e6dc-4993-825c-8d4403076c1b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:13.887788 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:13.917566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c916c7d-f64f-4d61-883e-0d3fdf6ff8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:13.919310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c916c7d-f64f-4d61-883e-0d3fdf6ff8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:13.919916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c916c7d-f64f-4d61-883e-0d3fdf6ff8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:13.920670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c916c7d-f64f-4d61-883e-0d3fdf6ff8f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:13.921481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c916c7d-f64f-4d61-883e-0d3fdf6ff8f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:13.921923 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c916c7d-f64f-4d61-883e-0d3fdf6ff8f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:13.923442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c916c7d-f64f-4d61-883e-0d3fdf6ff8f2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:13.935159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 16/29] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:13.936457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c916c7d-f64f-4d61-883e-0d3fdf6ff8f2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:14.006616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0c7b-09e2-45aa-92cb-3adc842d305c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:14.077229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923a9eb-6fe4-413e-a4be-03d81b0fe20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:14.077997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923a9eb-6fe4-413e-a4be-03d81b0fe20b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:14.078313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923a9eb-6fe4-413e-a4be-03d81b0fe20b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:14.078592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923a9eb-6fe4-413e-a4be-03d81b0fe20b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:14.087120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c916c7d-f64f-4d61-883e-0d3fdf6ff8f2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:14.091666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923a9eb-6fe4-413e-a4be-03d81b0fe20b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:14.093277 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923a9eb-6fe4-413e-a4be-03d81b0fe20b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f923a9eb-6fe4-413e-a4be-03d81b0fe20b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:14.110488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:14.111430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:14.112266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:14.112266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:14.112266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:14.112266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 14/30] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:24:14.112925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923a9eb-6fe4-413e-a4be-03d81b0fe20b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:14.159571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933d92d-12c7-4d57-9349-5ff21517c156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:14.160332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933d92d-12c7-4d57-9349-5ff21517c156 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:14.160615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933d92d-12c7-4d57-9349-5ff21517c156 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:14.160887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933d92d-12c7-4d57-9349-5ff21517c156 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:14.161586 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933d92d-12c7-4d57-9349-5ff21517c156 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:14.163039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933d92d-12c7-4d57-9349-5ff21517c156 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:14.170869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:14.234881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:14.250846 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923a9eb-6fe4-413e-a4be-03d81b0fe20b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:14.298696 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509ce1a-f9c4-4733-9ed0-d15b23a3a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:14.299396 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509ce1a-f9c4-4733-9ed0-d15b23a3a617 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:14.299891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509ce1a-f9c4-4733-9ed0-d15b23a3a617 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:14.300209 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509ce1a-f9c4-4733-9ed0-d15b23a3a617 None admin] PATH_INFO: `/v3/users/9c9fa0b484ce4f7bb377c75f947c0872` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:14.301823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509ce1a-f9c4-4733-9ed0-d15b23a3a617 None admin] RBAC: Authorizing `identity:get_user(user_id=9c9fa0b484ce4f7bb377c75f947c0872)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:14.303289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509ce1a-f9c4-4733-9ed0-d15b23a3a617 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:14.305021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 15/31] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:14 2022] GET /identity/v3/users/9c9fa0b484ce4f7bb377c75f947c0872 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:14.305800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509ce1a-f9c4-4733-9ed0-d15b23a3a617 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:14.413237 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 17/32] 10.222.0.91 () {60 vars in 1131 bytes} [Wed Aug 24 10:24:13 2022] POST /identity/v3/roles => generated 219 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:14.415319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67171c00-899e-45a1-92c3-7d3a8dc25311 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:14.415842 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67171c00-899e-45a1-92c3-7d3a8dc25311 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:14.416361 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67171c00-899e-45a1-92c3-7d3a8dc25311 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:14.417939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 18/33] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:14.423217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509ce1a-f9c4-4733-9ed0-d15b23a3a617 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:14.424725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67171c00-899e-45a1-92c3-7d3a8dc25311 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:14.459987 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c2fc0-43d3-44a3-a1d2-ab6c4babccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:14.460638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c2fc0-43d3-44a3-a1d2-ab6c4babccfa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:14.460924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c2fc0-43d3-44a3-a1d2-ab6c4babccfa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:14.461202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c2fc0-43d3-44a3-a1d2-ab6c4babccfa None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:14.461914 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c2fc0-43d3-44a3-a1d2-ab6c4babccfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:14.462157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c2fc0-43d3-44a3-a1d2-ab6c4babccfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:14.463558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c2fc0-43d3-44a3-a1d2-ab6c4babccfa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:14.477662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 16/34] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:14.478862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad24c3e-17f2-47a3-8e29-55b2ac7318e3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:14.479055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad24c3e-17f2-47a3-8e29-55b2ac7318e3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:14.483915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad24c3e-17f2-47a3-8e29-55b2ac7318e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:14.517879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4ad24c3e-17f2-47a3-8e29-55b2ac7318e3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:14.519112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4ad24c3e-17f2-47a3-8e29-55b2ac7318e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:14.534967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:14.622322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67171c00-899e-45a1-92c3-7d3a8dc25311 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:14.644929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 17/35] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:14.646626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad24c3e-17f2-47a3-8e29-55b2ac7318e3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:14.679310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b160300-538f-49e8-8493-f6df9f666091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:14.679310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160300-538f-49e8-8493-f6df9f666091 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:14.679310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160300-538f-49e8-8493-f6df9f666091 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:14.679310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160300-538f-49e8-8493-f6df9f666091 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:14.680680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b160300-538f-49e8-8493-f6df9f666091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:14.684552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b160300-538f-49e8-8493-f6df9f666091 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:14.688168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 19/36] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:14.697471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b160300-538f-49e8-8493-f6df9f666091 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:14.780545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:14.830925 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b160300-538f-49e8-8493-f6df9f666091 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:14.874593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52ffa3-7f03-4dcd-b3eb-9d910f9f3c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:14.875370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52ffa3-7f03-4dcd-b3eb-9d910f9f3c9e None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:14.875846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52ffa3-7f03-4dcd-b3eb-9d910f9f3c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:14.879748 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52ffa3-7f03-4dcd-b3eb-9d910f9f3c9e None admin] PATH_INFO: `/v3/domains/default/users/9c9fa0b484ce4f7bb377c75f947c0872/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:14.883332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52ffa3-7f03-4dcd-b3eb-9d910f9f3c9e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9c9fa0b484ce4f7bb377c75f947c0872, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:14.885299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52ffa3-7f03-4dcd-b3eb-9d910f9f3c9e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:14.896587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad24c3e-17f2-47a3-8e29-55b2ac7318e3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:14.940376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d4059-1747-4229-904a-7bb6620baa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:14.941095 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d4059-1747-4229-904a-7bb6620baa3e None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:14.941333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d4059-1747-4229-904a-7bb6620baa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:14.941661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d4059-1747-4229-904a-7bb6620baa3e None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:14.942371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d4059-1747-4229-904a-7bb6620baa3e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:14.943936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d4059-1747-4229-904a-7bb6620baa3e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:14.993024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 20/37] 10.222.0.91 () {58 vars in 1361 bytes} [Wed Aug 24 10:24:14 2022] PUT /identity/v3/domains/default/users/9c9fa0b484ce4f7bb377c75f947c0872/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:24:14.994511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12a6cd-977c-4c5f-989f-06f0df17e5fd None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:14.994804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12a6cd-977c-4c5f-989f-06f0df17e5fd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:14.995087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12a6cd-977c-4c5f-989f-06f0df17e5fd None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:15.002095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 21/38] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:15.002095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12a6cd-977c-4c5f-989f-06f0df17e5fd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:15.051667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:15.135994 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12a6cd-977c-4c5f-989f-06f0df17e5fd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:15.173786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:15.184603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bed9e-3b2d-4ac7-a016-1e5c74d32e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:15.185765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bed9e-3b2d-4ac7-a016-1e5c74d32e5b None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:15.186208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bed9e-3b2d-4ac7-a016-1e5c74d32e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:15.187274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bed9e-3b2d-4ac7-a016-1e5c74d32e5b None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:15.187630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bed9e-3b2d-4ac7-a016-1e5c74d32e5b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:15.189256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bed9e-3b2d-4ac7-a016-1e5c74d32e5b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:15.199702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 18/39] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:24:14 2022] POST /identity/v3/projects => generated 301 bytes in 554 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:15.203812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a58812-c9ba-400f-960d-c245eace4ae0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:15.203812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a58812-c9ba-400f-960d-c245eace4ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:15.203812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a58812-c9ba-400f-960d-c245eace4ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:15.224597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-31a58812-c9ba-400f-960d-c245eace4ae0 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:15.226230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-31a58812-c9ba-400f-960d-c245eace4ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:15.267819 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 22/40] 10.222.0.91 () {60 vars in 1131 bytes} [Wed Aug 24 10:24:14 2022] POST /identity/v3/roles => generated 225 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:15.320154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 19/41] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:15.353342 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e10b0-e545-44ba-a463-a0912d3a8dad None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:15.354005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e10b0-e545-44ba-a463-a0912d3a8dad None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:15.354489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e10b0-e545-44ba-a463-a0912d3a8dad None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:15.357003 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 23/42] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:15.363877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c7c9-b004-4141-8b05-16c61ef849cc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:15.364493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c7c9-b004-4141-8b05-16c61ef849cc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:15.364971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c7c9-b004-4141-8b05-16c61ef849cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:15.386286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-38a3c7c9-b004-4141-8b05-16c61ef849cc None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:15.387931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-38a3c7c9-b004-4141-8b05-16c61ef849cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:15.475843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 20/43] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:15.658047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e10b0-e545-44ba-a463-a0912d3a8dad None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:15.765444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e10b0-e545-44ba-a463-a0912d3a8dad None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:15.776719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c7c9-b004-4141-8b05-16c61ef849cc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:15.809887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f18930-96c6-48e4-924a-f467fb0be326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:15.810506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f18930-96c6-48e4-924a-f467fb0be326 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:15.810882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f18930-96c6-48e4-924a-f467fb0be326 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:15.811193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f18930-96c6-48e4-924a-f467fb0be326 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:15.812410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f18930-96c6-48e4-924a-f467fb0be326 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:15.823090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f18930-96c6-48e4-924a-f467fb0be326 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:15.839261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:15.882631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c7c9-b004-4141-8b05-16c61ef849cc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:15.923416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9242cd-9dcf-4c79-8cda-dd0cecf89cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:15.924315 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9242cd-9dcf-4c79-8cda-dd0cecf89cef None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:15.924603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9242cd-9dcf-4c79-8cda-dd0cecf89cef None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:15.924910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9242cd-9dcf-4c79-8cda-dd0cecf89cef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:15.925992 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9242cd-9dcf-4c79-8cda-dd0cecf89cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:15.926483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 24/44] 10.222.0.91 () {60 vars in 1131 bytes} [Wed Aug 24 10:24:15 2022] POST /identity/v3/roles => generated 223 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:15.927741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9242cd-9dcf-4c79-8cda-dd0cecf89cef None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:15.931461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 21/45] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:15.938049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f18930-96c6-48e4-924a-f467fb0be326 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:16.004652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:16.073105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f18930-96c6-48e4-924a-f467fb0be326 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:16.118428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac081ef-ece1-4e09-89f1-8986df55e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:16.119049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac081ef-ece1-4e09-89f1-8986df55e70e None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:16.119336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac081ef-ece1-4e09-89f1-8986df55e70e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:16.119609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac081ef-ece1-4e09-89f1-8986df55e70e None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:16.120434 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac081ef-ece1-4e09-89f1-8986df55e70e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:16.122708 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac081ef-ece1-4e09-89f1-8986df55e70e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:16.218411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 25/46] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:24:15 2022] POST /identity/v3/projects => generated 312 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:16.972592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a027d5-189f-4b87-ae84-96136ce77314 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:16.973139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a027d5-189f-4b87-ae84-96136ce77314 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:16.973139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a027d5-189f-4b87-ae84-96136ce77314 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:16.974482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 22/47] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:16.980092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a09054-8913-4c36-aa11-93d897725104 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:16.980405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a09054-8913-4c36-aa11-93d897725104 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:16.980665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a09054-8913-4c36-aa11-93d897725104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:16.999244 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-02a09054-8913-4c36-aa11-93d897725104 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:17.000783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-02a09054-8913-4c36-aa11-93d897725104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:17.069991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 26/48] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:17.344945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a027d5-189f-4b87-ae84-96136ce77314 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:17.458193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a027d5-189f-4b87-ae84-96136ce77314 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:17.486617 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:17.495422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f522b4-aa24-4930-b4e4-5d459337f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:17.496189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f522b4-aa24-4930-b4e4-5d459337f781 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:17.501479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f522b4-aa24-4930-b4e4-5d459337f781 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:17.501479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f522b4-aa24-4930-b4e4-5d459337f781 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:17.510320 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f522b4-aa24-4930-b4e4-5d459337f781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-64f522b4-aa24-4930-b4e4-5d459337f781 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:17.515285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:17.516193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:17.516957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 23/49] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:17.522570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a09054-8913-4c36-aa11-93d897725104 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:17.550437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:17.736529 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a09054-8913-4c36-aa11-93d897725104 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:17.772894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006fac9-4320-4610-a819-b685c5a11584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:17.773516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006fac9-4320-4610-a819-b685c5a11584 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:17.773794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006fac9-4320-4610-a819-b685c5a11584 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:17.774067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006fac9-4320-4610-a819-b685c5a11584 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:17.774741 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006fac9-4320-4610-a819-b685c5a11584 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:17.775044 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006fac9-4320-4610-a819-b685c5a11584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:17.776478 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006fac9-4320-4610-a819-b685c5a11584 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:17.787693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 27/50] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:17.793646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f522b4-aa24-4930-b4e4-5d459337f781 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:18.006635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f522b4-aa24-4930-b4e4-5d459337f781 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:18.042841 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564ec79-8155-4583-9005-a0cbd5fad50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:18.044142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564ec79-8155-4583-9005-a0cbd5fad50f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:18.044419 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564ec79-8155-4583-9005-a0cbd5fad50f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:18.044697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564ec79-8155-4583-9005-a0cbd5fad50f None admin] PATH_INFO: `/v3/users/9c9fa0b484ce4f7bb377c75f947c0872` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:18.045872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564ec79-8155-4583-9005-a0cbd5fad50f None admin] RBAC: Authorizing `identity:get_user(user_id=9c9fa0b484ce4f7bb377c75f947c0872)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:18.047339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564ec79-8155-4583-9005-a0cbd5fad50f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:18.048967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 24/51] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:17 2022] GET /identity/v3/users/9c9fa0b484ce4f7bb377c75f947c0872 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:18.054557 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006fac9-4320-4610-a819-b685c5a11584 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:18.145838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:18.158512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006fac9-4320-4610-a819-b685c5a11584 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:18.179093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71022462-0100-42fc-95b9-bb6de2d8ff6d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:18.179381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71022462-0100-42fc-95b9-bb6de2d8ff6d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:18.179663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71022462-0100-42fc-95b9-bb6de2d8ff6d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:18.181203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 25/52] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:24:18.187159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542c44d-6713-4831-afdc-d3fe8ddb5e57 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:18.187454 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542c44d-6713-4831-afdc-d3fe8ddb5e57 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:18.187748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542c44d-6713-4831-afdc-d3fe8ddb5e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:18.195999 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc8f81-7987-41c0-8a0d-300d8dfa42a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:18.196631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc8f81-7987-41c0-8a0d-300d8dfa42a9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:18.196912 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc8f81-7987-41c0-8a0d-300d8dfa42a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:18.197180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc8f81-7987-41c0-8a0d-300d8dfa42a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:18.198287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc8f81-7987-41c0-8a0d-300d8dfa42a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:18.200077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc8f81-7987-41c0-8a0d-300d8dfa42a9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:18.201834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 28/53] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:18.205981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3542c44d-6713-4831-afdc-d3fe8ddb5e57 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:18.207293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3542c44d-6713-4831-afdc-d3fe8ddb5e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:18.207393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc8f81-7987-41c0-8a0d-300d8dfa42a9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:18.267124 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:18.285952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 26/54] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:18.320397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc8f81-7987-41c0-8a0d-300d8dfa42a9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:18.355114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c0c1e-f03b-4899-9d01-335174f696a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:18.357036 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c0c1e-f03b-4899-9d01-335174f696a0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:18.357312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c0c1e-f03b-4899-9d01-335174f696a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:18.357580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c0c1e-f03b-4899-9d01-335174f696a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:18.358299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c0c1e-f03b-4899-9d01-335174f696a0 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.domain.id=default, user.id=9c9fa0b484ce4f7bb377c75f947c0872) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:18.358601 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c0c1e-f03b-4899-9d01-335174f696a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:18.360137 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c0c1e-f03b-4899-9d01-335174f696a0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:18.366105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 29/55] 10.222.0.91 () {56 vars in 1322 bytes} [Wed Aug 24 10:24:18 2022] GET /identity/v3/role_assignments?user.id=9c9fa0b484ce4f7bb377c75f947c0872&scope.domain.id=default&role.id=60abeefc9ac84e31a0162ac559220669 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:18.562296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542c44d-6713-4831-afdc-d3fe8ddb5e57 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:18.664371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542c44d-6713-4831-afdc-d3fe8ddb5e57 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:18.698736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e726d5b-5612-4210-b06c-78102b6da191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:18.699400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e726d5b-5612-4210-b06c-78102b6da191 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:18.699795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e726d5b-5612-4210-b06c-78102b6da191 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:18.700074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e726d5b-5612-4210-b06c-78102b6da191 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:18.701215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e726d5b-5612-4210-b06c-78102b6da191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:18.702668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e726d5b-5612-4210-b06c-78102b6da191 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:18.704287 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 27/56] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:18.709908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c0c1e-f03b-4899-9d01-335174f696a0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:18.733304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:18.811094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c0c1e-f03b-4899-9d01-335174f696a0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:18.846887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3e8c7-e795-48d3-a75d-509fea74c885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:18.847421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3e8c7-e795-48d3-a75d-509fea74c885 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:18.847708 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3e8c7-e795-48d3-a75d-509fea74c885 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:18.848008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3e8c7-e795-48d3-a75d-509fea74c885 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:18.848666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3e8c7-e795-48d3-a75d-509fea74c885 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:18.850115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3e8c7-e795-48d3-a75d-509fea74c885 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:18.935517 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 30/57] 10.222.0.91 () {60 vars in 1140 bytes} [Wed Aug 24 10:24:18 2022] POST /identity/v3/projects => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:24:20.851546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0779-1fe4-4e3d-b115-800f4ff07d2f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:20.852123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0779-1fe4-4e3d-b115-800f4ff07d2f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:20.852123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0779-1fe4-4e3d-b115-800f4ff07d2f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:20.853456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 28/58] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:20.859454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd25f3-9229-46d6-8f09-041723409887 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:20.859899 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd25f3-9229-46d6-8f09-041723409887 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:20.860044 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd25f3-9229-46d6-8f09-041723409887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:20.877836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-accd25f3-9229-46d6-8f09-041723409887 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:20.879049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-accd25f3-9229-46d6-8f09-041723409887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:20.946449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 31/59] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:21.216124 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c0779-1fe4-4e3d-b115-800f4ff07d2f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:21.273737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:21.321104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c0779-1fe4-4e3d-b115-800f4ff07d2f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:21.356025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41566fd8-ff67-4ee6-9695-336ae87cd1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:21.356732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41566fd8-ff67-4ee6-9695-336ae87cd1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:21.357174 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41566fd8-ff67-4ee6-9695-336ae87cd1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:21.357531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41566fd8-ff67-4ee6-9695-336ae87cd1e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:21.358736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41566fd8-ff67-4ee6-9695-336ae87cd1e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:21.360221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41566fd8-ff67-4ee6-9695-336ae87cd1e2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:21.361794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 29/60] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:21.367489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd25f3-9229-46d6-8f09-041723409887 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:21.369739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:21.469335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd25f3-9229-46d6-8f09-041723409887 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:21.502657 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e71074-8a8a-4b82-9d32-7fa73be130a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:21.503261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e71074-8a8a-4b82-9d32-7fa73be130a3 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:21.503542 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e71074-8a8a-4b82-9d32-7fa73be130a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:21.503846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e71074-8a8a-4b82-9d32-7fa73be130a3 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:21.504497 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e71074-8a8a-4b82-9d32-7fa73be130a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:21.505948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e71074-8a8a-4b82-9d32-7fa73be130a3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:21.593598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 32/61] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:24:21 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:24.763991 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf55cc-069e-4465-9e13-af962518719c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:24.764536 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf55cc-069e-4465-9e13-af962518719c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:24.764536 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf55cc-069e-4465-9e13-af962518719c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:24.766165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 30/62] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:24.771336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f2f12-f007-4adc-b7b0-ef67ab92c3ae None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:24.771778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f2f12-f007-4adc-b7b0-ef67ab92c3ae None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:24.772210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f2f12-f007-4adc-b7b0-ef67ab92c3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:24.794078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0f0f2f12-f007-4adc-b7b0-ef67ab92c3ae None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:24.795288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0f0f2f12-f007-4adc-b7b0-ef67ab92c3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:24.871107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:24.885368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 33/63] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:25.126148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ee491-c6fa-4556-b3bc-50c0a3f6f671 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.126401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ee491-c6fa-4556-b3bc-50c0a3f6f671 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.126668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ee491-c6fa-4556-b3bc-50c0a3f6f671 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.128313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 31/64] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:25.138345 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ead57c-85d6-4a79-825b-ba0ba1475fc4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.138631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ead57c-85d6-4a79-825b-ba0ba1475fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.139098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ead57c-85d6-4a79-825b-ba0ba1475fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.168913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-56ead57c-85d6-4a79-825b-ba0ba1475fc4 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:25.170370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-56ead57c-85d6-4a79-825b-ba0ba1475fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:25.216814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6fd16-a332-4883-8634-bce58f714dc4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.217431 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6fd16-a332-4883-8634-bce58f714dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.217936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6fd16-a332-4883-8634-bce58f714dc4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.219809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 32/65] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:25.224745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6fd16-a332-4883-8634-bce58f714dc4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:25.245334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 34/66] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:25.251751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957e7b4-37d2-497f-94c5-123c352887c5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.251751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957e7b4-37d2-497f-94c5-123c352887c5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.251751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957e7b4-37d2-497f-94c5-123c352887c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.266945 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b957e7b4-37d2-497f-94c5-123c352887c5 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:25.268165 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b957e7b4-37d2-497f-94c5-123c352887c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:25.344809 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 35/67] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:25.348871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b6379-d94e-4bcf-97f4-b77eb4ae0d7a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.349163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b6379-d94e-4bcf-97f4-b77eb4ae0d7a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.349446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b6379-d94e-4bcf-97f4-b77eb4ae0d7a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.350789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 36/68] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:25.356510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d8c12-ae45-4c7b-8cb2-3787bf418c53 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.357019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d8c12-ae45-4c7b-8cb2-3787bf418c53 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.357436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d8c12-ae45-4c7b-8cb2-3787bf418c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.383215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9d1d8c12-ae45-4c7b-8cb2-3787bf418c53 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:25.392873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9d1d8c12-ae45-4c7b-8cb2-3787bf418c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:25.404815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6fd16-a332-4883-8634-bce58f714dc4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:25.426525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:25.442579 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a9484-9924-4720-acc0-87daa8c094c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:25.443576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a9484-9924-4720-acc0-87daa8c094c0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.444029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a9484-9924-4720-acc0-87daa8c094c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.444448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a9484-9924-4720-acc0-87daa8c094c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.473502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a9484-9924-4720-acc0-87daa8c094c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:25.477706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a66a9484-9924-4720-acc0-87daa8c094c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:25.480472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:25.482082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:25.482849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:25.482849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:25.482849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:25.482849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:25.482849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:25.482849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:25.482849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:25.482849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:25.482849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:25.482849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:25.482849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:25.482849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:25.485184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 33/69] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:24:25.491410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a9484-9924-4720-acc0-87daa8c094c0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:25.531238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 37/70] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:25.603019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a9484-9924-4720-acc0-87daa8c094c0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:25.613690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d8c12-ae45-4c7b-8cb2-3787bf418c53 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:25.648980 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f0cc-8721-4b44-95da-8ee2a09a410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:25.649942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f0cc-8721-4b44-95da-8ee2a09a410e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.650410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f0cc-8721-4b44-95da-8ee2a09a410e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.650933 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f0cc-8721-4b44-95da-8ee2a09a410e None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.651929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f0cc-8721-4b44-95da-8ee2a09a410e None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:25.652452 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f0cc-8721-4b44-95da-8ee2a09a410e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:25.654022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f0cc-8721-4b44-95da-8ee2a09a410e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:25.667327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 34/71] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:25.676084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f0cc-8721-4b44-95da-8ee2a09a410e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:25.728862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:25.769129 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d8c12-ae45-4c7b-8cb2-3787bf418c53 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:25.791415 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f0cc-8721-4b44-95da-8ee2a09a410e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:25.812442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86770da7-531b-42eb-8d98-1adf69777e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:25.813724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86770da7-531b-42eb-8d98-1adf69777e90 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.814254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86770da7-531b-42eb-8d98-1adf69777e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.814697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86770da7-531b-42eb-8d98-1adf69777e90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.826022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86770da7-531b-42eb-8d98-1adf69777e90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-86770da7-531b-42eb-8d98-1adf69777e90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:25.830788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:25.831668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 38/72] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:24:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:24:25.833139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86770da7-531b-42eb-8d98-1adf69777e90 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:25.833887 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53c99b-f218-4737-9461-0d39df41abdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:25.834566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53c99b-f218-4737-9461-0d39df41abdb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.835072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53c99b-f218-4737-9461-0d39df41abdb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.835552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53c99b-f218-4737-9461-0d39df41abdb None admin] PATH_INFO: `/v3/users/1c055d472f134e8781758d53d4d6ec52` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.856134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53c99b-f218-4737-9461-0d39df41abdb None admin] RBAC: Authorizing `identity:get_user(user_id=1c055d472f134e8781758d53d4d6ec52)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:25.865879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53c99b-f218-4737-9461-0d39df41abdb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:25.865879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 35/73] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:25 2022] GET /identity/v3/users/1c055d472f134e8781758d53d4d6ec52 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:25.865879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac7146-728f-4a08-b349-4f3a5e0e3824 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.865879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac7146-728f-4a08-b349-4f3a5e0e3824 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.865879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac7146-728f-4a08-b349-4f3a5e0e3824 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.865879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 36/74] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:25.866920 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac7146-728f-4a08-b349-4f3a5e0e3824 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:25.900649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:25.961997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86770da7-531b-42eb-8d98-1adf69777e90 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:25.974951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:25.979172 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac7146-728f-4a08-b349-4f3a5e0e3824 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:25.997841 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fa06b-7206-49a6-ac14-ea7aeb799e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:25.998468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fa06b-7206-49a6-ac14-ea7aeb799e87 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.998749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fa06b-7206-49a6-ac14-ea7aeb799e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.999023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fa06b-7206-49a6-ac14-ea7aeb799e87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.009266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fa06b-7206-49a6-ac14-ea7aeb799e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a66fa06b-7206-49a6-ac14-ea7aeb799e87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:26.014215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:26.015081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:26.015930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:26.015930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:26.015930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:26.015930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:26.015930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:26.015930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:26.015930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:26.015930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:26.015930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:26.015930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:26.015930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:26.015930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:26.016507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8e21-1169-4131-9a0e-8608c4e46eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:26.016592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 39/75] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:24:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:26.016592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b5571-c6ed-4ffe-a5d3-6bcb9cac36fd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:26.016888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b5571-c6ed-4ffe-a5d3-6bcb9cac36fd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:26.017109 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b5571-c6ed-4ffe-a5d3-6bcb9cac36fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.019979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8e21-1169-4131-9a0e-8608c4e46eda None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:26.020360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8e21-1169-4131-9a0e-8608c4e46eda None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:26.020641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8e21-1169-4131-9a0e-8608c4e46eda None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.021332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f8e21-1169-4131-9a0e-8608c4e46eda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:26.021638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f8e21-1169-4131-9a0e-8608c4e46eda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:26.023288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f8e21-1169-4131-9a0e-8608c4e46eda None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:26.032475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 37/76] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:24:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:26.033298 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8e21-1169-4131-9a0e-8608c4e46eda None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:26.035788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d11b5571-c6ed-4ffe-a5d3-6bcb9cac36fd None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:26.037464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d11b5571-c6ed-4ffe-a5d3-6bcb9cac36fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:26.111274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 40/77] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:26.112356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b5571-c6ed-4ffe-a5d3-6bcb9cac36fd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:26.141438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:26.146265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8e21-1169-4131-9a0e-8608c4e46eda None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:26.185482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b6950-86a8-4a6a-8262-3e934561ea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:26.186017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b6950-86a8-4a6a-8262-3e934561ea42 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:26.186294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b6950-86a8-4a6a-8262-3e934561ea42 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:26.186563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b6950-86a8-4a6a-8262-3e934561ea42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.220166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:26.225303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b5571-c6ed-4ffe-a5d3-6bcb9cac36fd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:26.263059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b6950-86a8-4a6a-8262-3e934561ea42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:26.263381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acda858-8c28-42da-be30-cafb0f7fde73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:26.263993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acda858-8c28-42da-be30-cafb0f7fde73 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:26.264312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acda858-8c28-42da-be30-cafb0f7fde73 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:26.264605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b6950-86a8-4a6a-8262-3e934561ea42 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:26.264738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acda858-8c28-42da-be30-cafb0f7fde73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.276750 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acda858-8c28-42da-be30-cafb0f7fde73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7acda858-8c28-42da-be30-cafb0f7fde73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:26.282858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:26.283764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:26.284520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 41/78] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:26.285145 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acda858-8c28-42da-be30-cafb0f7fde73 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:26.389353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 38/79] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:26.390294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b6950-86a8-4a6a-8262-3e934561ea42 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:26.401660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:26.414359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acda858-8c28-42da-be30-cafb0f7fde73 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:26.448577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3b87f-e478-474f-b642-6c0ea1fbcd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:26.449878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3b87f-e478-474f-b642-6c0ea1fbcd3d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:26.450167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3b87f-e478-474f-b642-6c0ea1fbcd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:26.450445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3b87f-e478-474f-b642-6c0ea1fbcd3d None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.451102 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3b87f-e478-474f-b642-6c0ea1fbcd3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:26.451405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3b87f-e478-474f-b642-6c0ea1fbcd3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:26.452843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3b87f-e478-474f-b642-6c0ea1fbcd3d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:26.453052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:26.461968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 42/80] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:26.462751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3b87f-e478-474f-b642-6c0ea1fbcd3d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:26.494786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b6950-86a8-4a6a-8262-3e934561ea42 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:26.530644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e514c7f-da4c-4e62-9830-cbef78361597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:26.531282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e514c7f-da4c-4e62-9830-cbef78361597 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:26.531564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e514c7f-da4c-4e62-9830-cbef78361597 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:26.531899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e514c7f-da4c-4e62-9830-cbef78361597 None admin] PATH_INFO: `/v3/users/1c055d472f134e8781758d53d4d6ec52` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.533078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e514c7f-da4c-4e62-9830-cbef78361597 None admin] RBAC: Authorizing `identity:get_user(user_id=1c055d472f134e8781758d53d4d6ec52)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:26.534568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e514c7f-da4c-4e62-9830-cbef78361597 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:26.536195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 39/81] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:26 2022] GET /identity/v3/users/1c055d472f134e8781758d53d4d6ec52 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:26.540922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e514c7f-da4c-4e62-9830-cbef78361597 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:26.574463 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3b87f-e478-474f-b642-6c0ea1fbcd3d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:26.610159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724480-39c3-4e3f-ad4b-324d762e77bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:26.610869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724480-39c3-4e3f-ad4b-324d762e77bd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:26.611146 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724480-39c3-4e3f-ad4b-324d762e77bd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:26.611416 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724480-39c3-4e3f-ad4b-324d762e77bd None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.612108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724480-39c3-4e3f-ad4b-324d762e77bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:26.612408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724480-39c3-4e3f-ad4b-324d762e77bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:26.616279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724480-39c3-4e3f-ad4b-324d762e77bd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:26.624105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 43/82] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:26.624807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724480-39c3-4e3f-ad4b-324d762e77bd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:26.640288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:26.645339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e514c7f-da4c-4e62-9830-cbef78361597 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:26.675152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:26.688081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ba380-371e-4218-8ba3-f4e21079b993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:26.688735 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ba380-371e-4218-8ba3-f4e21079b993 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:26.689022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ba380-371e-4218-8ba3-f4e21079b993 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:26.689306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ba380-371e-4218-8ba3-f4e21079b993 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.690452 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ba380-371e-4218-8ba3-f4e21079b993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:26.691936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ba380-371e-4218-8ba3-f4e21079b993 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:26.693714 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 40/83] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:26.694305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ba380-371e-4218-8ba3-f4e21079b993 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:26.729218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724480-39c3-4e3f-ad4b-324d762e77bd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:26.764401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26287f36-78d4-4a90-ab36-a63192b71939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:26.765024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287f36-78d4-4a90-ab36-a63192b71939 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:26.765306 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287f36-78d4-4a90-ab36-a63192b71939 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:26.765581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287f36-78d4-4a90-ab36-a63192b71939 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.766735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26287f36-78d4-4a90-ab36-a63192b71939 None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:26.768202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26287f36-78d4-4a90-ab36-a63192b71939 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:26.769837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 44/84] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:26 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:26.769837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26287f36-78d4-4a90-ab36-a63192b71939 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:26.813565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ba380-371e-4218-8ba3-f4e21079b993 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:26.850357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e95bd-fcb4-4fc4-9901-a27a63635e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:26.850998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e95bd-fcb4-4fc4-9901-a27a63635e72 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:26.851282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e95bd-fcb4-4fc4-9901-a27a63635e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:26.851563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e95bd-fcb4-4fc4-9901-a27a63635e72 None admin] PATH_INFO: `/v3/users/9c9fa0b484ce4f7bb377c75f947c0872` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.852765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e95bd-fcb4-4fc4-9901-a27a63635e72 None admin] RBAC: Authorizing `identity:get_user(user_id=9c9fa0b484ce4f7bb377c75f947c0872)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:26.854216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e95bd-fcb4-4fc4-9901-a27a63635e72 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:26.856600 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 41/85] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:26 2022] GET /identity/v3/users/9c9fa0b484ce4f7bb377c75f947c0872 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:26.857398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e95bd-fcb4-4fc4-9901-a27a63635e72 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:26.864634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:26.884091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26287f36-78d4-4a90-ab36-a63192b71939 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:26.921575 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc1426-a805-4b99-a261-13869712fbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:26.922180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc1426-a805-4b99-a261-13869712fbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:26.922459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc1426-a805-4b99-a261-13869712fbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:26.922735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc1426-a805-4b99-a261-13869712fbd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.923481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:26.961146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e95bd-fcb4-4fc4-9901-a27a63635e72 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:26.990331 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc1426-a805-4b99-a261-13869712fbd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:26.991742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc1426-a805-4b99-a261-13869712fbd7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:26.999387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd4bd-1e75-47a8-86ff-a22fdcb25754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:27.000056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd4bd-1e75-47a8-86ff-a22fdcb25754 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:27.000334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd4bd-1e75-47a8-86ff-a22fdcb25754 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:27.000604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd4bd-1e75-47a8-86ff-a22fdcb25754 None admin] PATH_INFO: `/v3/users/1c055d472f134e8781758d53d4d6ec52` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:27.001803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cd4bd-1e75-47a8-86ff-a22fdcb25754 None admin] RBAC: Authorizing `identity:get_user(user_id=1c055d472f134e8781758d53d4d6ec52)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:27.003263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cd4bd-1e75-47a8-86ff-a22fdcb25754 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:27.004880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 42/86] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:26 2022] GET /identity/v3/users/1c055d472f134e8781758d53d4d6ec52 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:27.005620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd4bd-1e75-47a8-86ff-a22fdcb25754 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:27.079602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:27.099634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 45/87] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:27.100290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc1426-a805-4b99-a261-13869712fbd7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:27.120182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd4bd-1e75-47a8-86ff-a22fdcb25754 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:27.160757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6658a-c4e4-428c-9281-a4798cb34d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:27.161371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6658a-c4e4-428c-9281-a4798cb34d65 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:27.161650 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6658a-c4e4-428c-9281-a4798cb34d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:27.161926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6658a-c4e4-428c-9281-a4798cb34d65 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:27.162575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6658a-c4e4-428c-9281-a4798cb34d65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:27.164082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6658a-c4e4-428c-9281-a4798cb34d65 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:27.175385 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:27.205006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc1426-a805-4b99-a261-13869712fbd7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:27.238313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04085a50-d965-4bef-8b44-335b3bf0603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:27.238912 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04085a50-d965-4bef-8b44-335b3bf0603e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:27.239192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04085a50-d965-4bef-8b44-335b3bf0603e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:27.239465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04085a50-d965-4bef-8b44-335b3bf0603e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:27.240215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04085a50-d965-4bef-8b44-335b3bf0603e None admin] RBAC: Adding query filter params (role.id=aa830dbb276f42eebec54786852e6f47, scope.project.id=640e6f0276c34a73896d6d942799e2d5, user.id=1c055d472f134e8781758d53d4d6ec52) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:27.240569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04085a50-d965-4bef-8b44-335b3bf0603e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:27.241977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04085a50-d965-4bef-8b44-335b3bf0603e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:27.248027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 46/88] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:27 2022] GET /identity/v3/role_assignments?user.id=1c055d472f134e8781758d53d4d6ec52&scope.project.id=640e6f0276c34a73896d6d942799e2d5&role.id=aa830dbb276f42eebec54786852e6f47 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:27.248827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04085a50-d965-4bef-8b44-335b3bf0603e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:27.265670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 43/89] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:24:27 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:27.265670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6658a-c4e4-428c-9281-a4798cb34d65 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:27.325838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:27.415806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04085a50-d965-4bef-8b44-335b3bf0603e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:27.425768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6658a-c4e4-428c-9281-a4798cb34d65 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:27.462017 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2c64f-6ef3-4bb0-a5c4-f32a31a828ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:27.462703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2c64f-6ef3-4bb0-a5c4-f32a31a828ff None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:27.462987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2c64f-6ef3-4bb0-a5c4-f32a31a828ff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:27.463264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2c64f-6ef3-4bb0-a5c4-f32a31a828ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:27.477015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c58d1-1ce5-4949-911c-d146972b0836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:27.477652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c58d1-1ce5-4949-911c-d146972b0836 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:27.477933 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c58d1-1ce5-4949-911c-d146972b0836 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:27.478211 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c58d1-1ce5-4949-911c-d146972b0836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:27.567072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2c64f-6ef3-4bb0-a5c4-f32a31a828ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:27.567966 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:27.570603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2c64f-6ef3-4bb0-a5c4-f32a31a828ff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:27.581446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c58d1-1ce5-4949-911c-d146972b0836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:27.582990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c58d1-1ce5-4949-911c-d146972b0836 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:27.643319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:27.716400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 44/90] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:27.717622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c58d1-1ce5-4949-911c-d146972b0836 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:27.719741 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 47/91] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:27.725243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2c64f-6ef3-4bb0-a5c4-f32a31a828ff None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:27.843542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:27.854483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2c64f-6ef3-4bb0-a5c4-f32a31a828ff None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:27.855196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c58d1-1ce5-4949-911c-d146972b0836 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:27.897627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce802971-e53d-4039-8033-ae0bb11b110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:27.898540 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce802971-e53d-4039-8033-ae0bb11b110d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:27.898969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce802971-e53d-4039-8033-ae0bb11b110d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:27.899384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce802971-e53d-4039-8033-ae0bb11b110d None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:27.900743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce802971-e53d-4039-8033-ae0bb11b110d None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:27.903066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce802971-e53d-4039-8033-ae0bb11b110d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:27.904989 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 45/92] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:27 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:27.905925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce802971-e53d-4039-8033-ae0bb11b110d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:27.970381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0aade-ec8c-4ad8-92cb-a9952d7f1e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:27.971142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0aade-ec8c-4ad8-92cb-a9952d7f1e2d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:27.971495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0aade-ec8c-4ad8-92cb-a9952d7f1e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:27.971863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0aade-ec8c-4ad8-92cb-a9952d7f1e2d None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:27.973187 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0aade-ec8c-4ad8-92cb-a9952d7f1e2d None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:27.975189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0aade-ec8c-4ad8-92cb-a9952d7f1e2d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:27.977311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 48/93] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:27 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:27.978161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0aade-ec8c-4ad8-92cb-a9952d7f1e2d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:28.015290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce802971-e53d-4039-8033-ae0bb11b110d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:28.019015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:28.052751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36dc2-b074-4849-af23-bf99cc32fc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:28.053690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36dc2-b074-4849-af23-bf99cc32fc31 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:28.054153 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36dc2-b074-4849-af23-bf99cc32fc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:28.054701 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36dc2-b074-4849-af23-bf99cc32fc31 None admin] PATH_INFO: `/v3/projects/fa71fd1594124b72b19b1d03a7dedd13` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:28.056100 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df36dc2-b074-4849-af23-bf99cc32fc31 None admin] RBAC: Authorizing `identity:get_project(project_id=fa71fd1594124b72b19b1d03a7dedd13)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:28.057751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df36dc2-b074-4849-af23-bf99cc32fc31 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:28.059693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 46/94] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:27 2022] GET /identity/v3/projects/fa71fd1594124b72b19b1d03a7dedd13 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:28.060757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36dc2-b074-4849-af23-bf99cc32fc31 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:28.099820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:28.124808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0aade-ec8c-4ad8-92cb-a9952d7f1e2d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:28.176414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287f16c-6783-47a6-a598-9134cb402f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:28.177044 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287f16c-6783-47a6-a598-9134cb402f1b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:28.177326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287f16c-6783-47a6-a598-9134cb402f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:28.177629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287f16c-6783-47a6-a598-9134cb402f1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:28.178491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287f16c-6783-47a6-a598-9134cb402f1b None admin] RBAC: Adding query filter params (role.id=2d3147d5707740a9995645aee5e671b3, scope.project.id=640e6f0276c34a73896d6d942799e2d5, user.id=1c055d472f134e8781758d53d4d6ec52) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:28.178854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287f16c-6783-47a6-a598-9134cb402f1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:28.180367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287f16c-6783-47a6-a598-9134cb402f1b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:28.192176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 49/95] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:27 2022] GET /identity/v3/role_assignments?user.id=1c055d472f134e8781758d53d4d6ec52&scope.project.id=640e6f0276c34a73896d6d942799e2d5&role.id=2d3147d5707740a9995645aee5e671b3 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:28.193042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287f16c-6783-47a6-a598-9134cb402f1b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:28.200676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36dc2-b074-4849-af23-bf99cc32fc31 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:28.268854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c6362-edf6-4f15-b29a-180886004309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:28.270087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c6362-edf6-4f15-b29a-180886004309 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:28.270572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c6362-edf6-4f15-b29a-180886004309 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:28.271068 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c6362-edf6-4f15-b29a-180886004309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:28.272357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c6362-edf6-4f15-b29a-180886004309 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=640e6f0276c34a73896d6d942799e2d5, user.id=9c9fa0b484ce4f7bb377c75f947c0872) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:28.272872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c6362-edf6-4f15-b29a-180886004309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:28.274553 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c6362-edf6-4f15-b29a-180886004309 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:28.288798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 47/96] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:28 2022] GET /identity/v3/role_assignments?user.id=9c9fa0b484ce4f7bb377c75f947c0872&scope.project.id=640e6f0276c34a73896d6d942799e2d5&role.id=60abeefc9ac84e31a0162ac559220669 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:28.401038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:28.447856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287f16c-6783-47a6-a598-9134cb402f1b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:28.487658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3102a8b-d62f-42c4-b868-c10662ecfcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:28.488314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102a8b-d62f-42c4-b868-c10662ecfcbf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:28.488599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102a8b-d62f-42c4-b868-c10662ecfcbf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:28.488874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102a8b-d62f-42c4-b868-c10662ecfcbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:28.489613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3102a8b-d62f-42c4-b868-c10662ecfcbf None admin] RBAC: Adding query filter params (role.id=aa830dbb276f42eebec54786852e6f47, scope.project.id=fa71fd1594124b72b19b1d03a7dedd13, user.id=1c055d472f134e8781758d53d4d6ec52) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:28.489926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3102a8b-d62f-42c4-b868-c10662ecfcbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:28.491412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3102a8b-d62f-42c4-b868-c10662ecfcbf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:28.497998 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 50/97] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:28 2022] GET /identity/v3/role_assignments?user.id=1c055d472f134e8781758d53d4d6ec52&scope.project.id=fa71fd1594124b72b19b1d03a7dedd13&role.id=aa830dbb276f42eebec54786852e6f47 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:29.816100 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f03d0-1fbf-4d5d-ad53-8e73ba72490b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:29.816610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f03d0-1fbf-4d5d-ad53-8e73ba72490b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:29.816684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f03d0-1fbf-4d5d-ad53-8e73ba72490b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:29.818239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 48/98] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:29.824888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f870ce4-b896-4381-815a-13d3f89f67a1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:29.824888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f870ce4-b896-4381-815a-13d3f89f67a1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:29.824888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f870ce4-b896-4381-815a-13d3f89f67a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:29.849689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0f870ce4-b896-4381-815a-13d3f89f67a1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:29.850930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0f870ce4-b896-4381-815a-13d3f89f67a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:29.891116 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7e433-a048-4591-932f-bf78295d1757 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:29.891421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7e433-a048-4591-932f-bf78295d1757 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:29.891680 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7e433-a048-4591-932f-bf78295d1757 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:29.893141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 49/99] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:24:29.899481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987e89a-c64b-4c74-956b-4c0a1e95661a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:29.899810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987e89a-c64b-4c74-956b-4c0a1e95661a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:29.900081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987e89a-c64b-4c74-956b-4c0a1e95661a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:29.932721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6987e89a-c64b-4c74-956b-4c0a1e95661a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:29.934074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6987e89a-c64b-4c74-956b-4c0a1e95661a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:29.976302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 51/100] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:30.064376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 50/101] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:30.396399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f870ce4-b896-4381-815a-13d3f89f67a1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:30.499274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:30.531857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f870ce4-b896-4381-815a-13d3f89f67a1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:30.568487 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82640158-b676-4f97-afac-5e4d27c5fa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:30.569131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82640158-b676-4f97-afac-5e4d27c5fa4d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:30.569417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82640158-b676-4f97-afac-5e4d27c5fa4d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:30.569694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82640158-b676-4f97-afac-5e4d27c5fa4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:30.582276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82640158-b676-4f97-afac-5e4d27c5fa4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-82640158-b676-4f97-afac-5e4d27c5fa4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:30.587798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:30.588643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:30.589464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:30.589464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:30.589464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:30.589464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:30.589464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:30.589464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:30.589464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:30.589464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:30.589464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:30.589464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:30.589464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:30.589464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:30.590120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 52/102] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:30.595362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987e89a-c64b-4c74-956b-4c0a1e95661a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:30.609698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82640158-b676-4f97-afac-5e4d27c5fa4d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:30.629765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:30.729621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987e89a-c64b-4c74-956b-4c0a1e95661a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:30.773394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82640158-b676-4f97-afac-5e4d27c5fa4d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:30.776646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb767c43-d4ed-46b0-b39d-a32304bcf1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:30.777588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767c43-d4ed-46b0-b39d-a32304bcf1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:30.778261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767c43-d4ed-46b0-b39d-a32304bcf1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:30.778771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767c43-d4ed-46b0-b39d-a32304bcf1e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:30.779654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb767c43-d4ed-46b0-b39d-a32304bcf1e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:30.780186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb767c43-d4ed-46b0-b39d-a32304bcf1e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:30.782093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb767c43-d4ed-46b0-b39d-a32304bcf1e8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:30.798471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 51/103] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:30.811009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:30.813341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb767c43-d4ed-46b0-b39d-a32304bcf1e8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:30.823071 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30098234-3221-494d-aa32-a5cffd9c7d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:30.823507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098234-3221-494d-aa32-a5cffd9c7d6c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:30.824353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098234-3221-494d-aa32-a5cffd9c7d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:30.827869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098234-3221-494d-aa32-a5cffd9c7d6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:30.847767 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30098234-3221-494d-aa32-a5cffd9c7d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-30098234-3221-494d-aa32-a5cffd9c7d6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:30.857754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:30.858690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:30.859457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:30.859457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:30.859457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:30.859457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:30.859457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:30.859457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:30.859457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:30.859457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:30.859457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:30.859457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:30.859457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:30.859457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:30.863307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 53/104] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:30.868908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30098234-3221-494d-aa32-a5cffd9c7d6c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:30.972120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:30.993832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb767c43-d4ed-46b0-b39d-a32304bcf1e8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:31.038187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc9482-511f-4045-9a81-bc261e50594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:31.039232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9482-511f-4045-9a81-bc261e50594a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.040595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9482-511f-4045-9a81-bc261e50594a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.046552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9482-511f-4045-9a81-bc261e50594a None admin] PATH_INFO: `/v3/users/1c055d472f134e8781758d53d4d6ec52` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.048301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc9482-511f-4045-9a81-bc261e50594a None admin] RBAC: Authorizing `identity:get_user(user_id=1c055d472f134e8781758d53d4d6ec52)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:31.050129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc9482-511f-4045-9a81-bc261e50594a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:31.052089 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 52/105] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:30 2022] GET /identity/v3/users/1c055d472f134e8781758d53d4d6ec52 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:31.057083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10359-a831-4ccd-bb47-0006f8f5b1eb None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.057682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10359-a831-4ccd-bb47-0006f8f5b1eb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.058212 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10359-a831-4ccd-bb47-0006f8f5b1eb None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.059903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 53/106] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:31.060882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c10359-a831-4ccd-bb47-0006f8f5b1eb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:31.109963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30098234-3221-494d-aa32-a5cffd9c7d6c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:31.148239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1f541-b21b-4a32-ac73-cb0b589a842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:31.148902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1f541-b21b-4a32-ac73-cb0b589a842a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.149193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1f541-b21b-4a32-ac73-cb0b589a842a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.149474 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1f541-b21b-4a32-ac73-cb0b589a842a None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.150263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1f541-b21b-4a32-ac73-cb0b589a842a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:31.150580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1f541-b21b-4a32-ac73-cb0b589a842a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:31.152898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1f541-b21b-4a32-ac73-cb0b589a842a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:31.162738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 54/107] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:31.164057 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5adad5-567e-4b52-ae7e-896c57c659cc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.164400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5adad5-567e-4b52-ae7e-896c57c659cc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.164687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5adad5-567e-4b52-ae7e-896c57c659cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.185118 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1c5adad5-567e-4b52-ae7e-896c57c659cc None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:31.186344 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1c5adad5-567e-4b52-ae7e-896c57c659cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:31.234395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c10359-a831-4ccd-bb47-0006f8f5b1eb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:31.262790 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 55/108] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:31.263769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5adad5-567e-4b52-ae7e-896c57c659cc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:31.268179 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:31.293342 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2987d-9c20-4cf5-9d27-56a1493b5916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:31.294126 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2987d-9c20-4cf5-9d27-56a1493b5916 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.294407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2987d-9c20-4cf5-9d27-56a1493b5916 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.294681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2987d-9c20-4cf5-9d27-56a1493b5916 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.296023 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2987d-9c20-4cf5-9d27-56a1493b5916 None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:31.297473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2987d-9c20-4cf5-9d27-56a1493b5916 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:31.299276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 54/109] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:31 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:31.300267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813d790-7099-46ea-b8c7-73e8147324c1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.300546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813d790-7099-46ea-b8c7-73e8147324c1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.308964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813d790-7099-46ea-b8c7-73e8147324c1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.308964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 55/110] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:31.312826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637ff0-94c3-4e4d-9278-dde915730be3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.313120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637ff0-94c3-4e4d-9278-dde915730be3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.313396 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637ff0-94c3-4e4d-9278-dde915730be3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.314752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 56/111] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:31 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:31.316622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5976c-fa2d-498f-bef5-e89934a995e9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.316902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5976c-fa2d-498f-bef5-e89934a995e9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.317175 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5976c-fa2d-498f-bef5-e89934a995e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.336711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-caf5976c-fa2d-498f-bef5-e89934a995e9 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:31.337912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-caf5976c-fa2d-498f-bef5-e89934a995e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:31.352535 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:31.377848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5adad5-567e-4b52-ae7e-896c57c659cc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:31.411309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 57/112] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:31.416551 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5976c-fa2d-498f-bef5-e89934a995e9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:31.437317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb174278-b0b5-45a3-9c09-1b0718772569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:31.438371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174278-b0b5-45a3-9c09-1b0718772569 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.438807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174278-b0b5-45a3-9c09-1b0718772569 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.439281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174278-b0b5-45a3-9c09-1b0718772569 None admin] PATH_INFO: `/v3/users/c198ef5340e0496485b77d0e1d891035` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.469214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb174278-b0b5-45a3-9c09-1b0718772569 None admin] RBAC: Authorizing `identity:get_user(user_id=c198ef5340e0496485b77d0e1d891035)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:31.472230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb174278-b0b5-45a3-9c09-1b0718772569 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:31.474302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 56/113] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:31 2022] GET /identity/v3/users/c198ef5340e0496485b77d0e1d891035 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:31.477911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2324d1-315e-495f-9b3d-156d6a0e4298 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.479063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2324d1-315e-495f-9b3d-156d6a0e4298 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.479639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2324d1-315e-495f-9b3d-156d6a0e4298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.517548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9b2324d1-315e-495f-9b3d-156d6a0e4298 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:31.519839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9b2324d1-315e-495f-9b3d-156d6a0e4298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:31.578559 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:31.605840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5976c-fa2d-498f-bef5-e89934a995e9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:31.620200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 57/114] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:31.622542 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2324d1-315e-495f-9b3d-156d6a0e4298 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:31.664807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a706e4-f958-48d6-9328-78b151d150e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:31.665526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a706e4-f958-48d6-9328-78b151d150e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.665872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a706e4-f958-48d6-9328-78b151d150e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.666217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a706e4-f958-48d6-9328-78b151d150e9 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5/users/1c055d472f134e8781758d53d4d6ec52/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.669065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a706e4-f958-48d6-9328-78b151d150e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=640e6f0276c34a73896d6d942799e2d5, user_id=1c055d472f134e8781758d53d4d6ec52, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:31.670627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a706e4-f958-48d6-9328-78b151d150e9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:31.745845 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 58/115] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:24:31 2022] PUT /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5/users/1c055d472f134e8781758d53d4d6ec52/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:24:31.748789 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a706e4-f958-48d6-9328-78b151d150e9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:31.761021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2324d1-315e-495f-9b3d-156d6a0e4298 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:31.767575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:31.813659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d62f3-2315-4492-b9ef-315ce115e685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:31.814715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d62f3-2315-4492-b9ef-315ce115e685 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.815260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d62f3-2315-4492-b9ef-315ce115e685 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.815822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d62f3-2315-4492-b9ef-315ce115e685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.882196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:31.916142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a706e4-f958-48d6-9328-78b151d150e9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:31.922744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d62f3-2315-4492-b9ef-315ce115e685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:31.924726 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d62f3-2315-4492-b9ef-315ce115e685 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:31.956253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1eced-4585-45ab-9c2b-385d98d5e6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:31.956992 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1eced-4585-45ab-9c2b-385d98d5e6db None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.957305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1eced-4585-45ab-9c2b-385d98d5e6db None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.957544 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1eced-4585-45ab-9c2b-385d98d5e6db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.959204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1eced-4585-45ab-9c2b-385d98d5e6db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:31.961147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1eced-4585-45ab-9c2b-385d98d5e6db None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:31.963780 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 59/116] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:31.968441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f25833-ccf7-4c37-8024-3e60b206fb7b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:31.968822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f25833-ccf7-4c37-8024-3e60b206fb7b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:31.968971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f25833-ccf7-4c37-8024-3e60b206fb7b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:31.971159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 60/117] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:31.975059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f25833-ccf7-4c37-8024-3e60b206fb7b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:32.059891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 58/118] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:32.061073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d62f3-2315-4492-b9ef-315ce115e685 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:32.066720 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:32.093363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f25833-ccf7-4c37-8024-3e60b206fb7b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:32.128249 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7bd8-bc21-44be-aefc-75943940f1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:32.128885 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7bd8-bc21-44be-aefc-75943940f1cb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:32.129163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7bd8-bc21-44be-aefc-75943940f1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:32.129434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7bd8-bc21-44be-aefc-75943940f1cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:32.140379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc7bd8-bc21-44be-aefc-75943940f1cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e9fc7bd8-bc21-44be-aefc-75943940f1cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:32.145599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:32.146534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 61/119] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:24:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:32.148458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7bd8-bc21-44be-aefc-75943940f1cb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:32.153196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:32.188232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d62f3-2315-4492-b9ef-315ce115e685 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:32.229381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadd71e-d229-4e34-b9dd-098926f90ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:32.229381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd71e-d229-4e34-b9dd-098926f90ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:32.229381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd71e-d229-4e34-b9dd-098926f90ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:32.229381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd71e-d229-4e34-b9dd-098926f90ea1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:32.241126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadd71e-d229-4e34-b9dd-098926f90ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-acadd71e-d229-4e34-b9dd-098926f90ea1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:32.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:32.247970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:32.249091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 59/120] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:32.249735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92087d18-a2a3-400c-a79a-45263aa9d9ac None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:32.250343 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92087d18-a2a3-400c-a79a-45263aa9d9ac None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:32.250686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92087d18-a2a3-400c-a79a-45263aa9d9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:32.270312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-92087d18-a2a3-400c-a79a-45263aa9d9ac None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:32.271569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-92087d18-a2a3-400c-a79a-45263aa9d9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:32.276630 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7bd8-bc21-44be-aefc-75943940f1cb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:32.319939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01da694-f77b-40ae-b29b-d9290341ca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:32.320625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01da694-f77b-40ae-b29b-d9290341ca7d None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:32.320918 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01da694-f77b-40ae-b29b-d9290341ca7d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:32.321197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01da694-f77b-40ae-b29b-d9290341ca7d None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:32.321851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01da694-f77b-40ae-b29b-d9290341ca7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:32.323291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01da694-f77b-40ae-b29b-d9290341ca7d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:32.329871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:32.356010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 60/121] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:32.357091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92087d18-a2a3-400c-a79a-45263aa9d9ac None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:32.434482 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:32.444802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 62/122] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:24:32 2022] POST /identity/v3/projects => generated 302 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:32.445672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01da694-f77b-40ae-b29b-d9290341ca7d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:32.491010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92087d18-a2a3-400c-a79a-45263aa9d9ac None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:32.533273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df00e57-00b8-43d9-af2f-3b2e91c6c805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:32.534403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df00e57-00b8-43d9-af2f-3b2e91c6c805 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:32.534890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df00e57-00b8-43d9-af2f-3b2e91c6c805 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:32.535537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df00e57-00b8-43d9-af2f-3b2e91c6c805 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:32.537099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df00e57-00b8-43d9-af2f-3b2e91c6c805 None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:32.538924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df00e57-00b8-43d9-af2f-3b2e91c6c805 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:32.541065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 61/123] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:32 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:32.542086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df00e57-00b8-43d9-af2f-3b2e91c6c805 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:32.567293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01da694-f77b-40ae-b29b-d9290341ca7d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:32.607056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa9c12-5710-4ddf-9372-eebdcd285a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:32.607467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa9c12-5710-4ddf-9372-eebdcd285a0d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:32.607772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa9c12-5710-4ddf-9372-eebdcd285a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:32.608048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa9c12-5710-4ddf-9372-eebdcd285a0d None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:32.608732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa9c12-5710-4ddf-9372-eebdcd285a0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:32.609029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa9c12-5710-4ddf-9372-eebdcd285a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:32.610627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa9c12-5710-4ddf-9372-eebdcd285a0d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:32.620267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 63/124] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:24:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:32.625057 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa9c12-5710-4ddf-9372-eebdcd285a0d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:32.666627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df00e57-00b8-43d9-af2f-3b2e91c6c805 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:32.684969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:32.700698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:32.716492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af9cf5-5120-4832-b261-15c1450a60ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:32.717126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9cf5-5120-4832-b261-15c1450a60ed None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:32.717400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9cf5-5120-4832-b261-15c1450a60ed None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:32.717668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9cf5-5120-4832-b261-15c1450a60ed None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:32.718344 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af9cf5-5120-4832-b261-15c1450a60ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:32.718640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af9cf5-5120-4832-b261-15c1450a60ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:32.720788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af9cf5-5120-4832-b261-15c1450a60ed None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:32.730903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 62/125] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:32.731906 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af9cf5-5120-4832-b261-15c1450a60ed None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:32.757521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa9c12-5710-4ddf-9372-eebdcd285a0d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:32.806600 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cbcf3-39be-4ec2-ad2e-4f4425649fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:32.807209 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cbcf3-39be-4ec2-ad2e-4f4425649fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:32.807485 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cbcf3-39be-4ec2-ad2e-4f4425649fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:32.807888 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cbcf3-39be-4ec2-ad2e-4f4425649fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:32.809214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cbcf3-39be-4ec2-ad2e-4f4425649fb9 None admin] RBAC: Adding query filter params (role.id=d9779f8bf7d746acbd4f8eb816c8e589, scope.project.id=640e6f0276c34a73896d6d942799e2d5, user.id=c198ef5340e0496485b77d0e1d891035) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:32.809533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cbcf3-39be-4ec2-ad2e-4f4425649fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:32.811215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cbcf3-39be-4ec2-ad2e-4f4425649fb9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:32.817906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 64/126] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:32 2022] GET /identity/v3/role_assignments?user.id=c198ef5340e0496485b77d0e1d891035&scope.project.id=640e6f0276c34a73896d6d942799e2d5&role.id=d9779f8bf7d746acbd4f8eb816c8e589 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:32.819012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cbcf3-39be-4ec2-ad2e-4f4425649fb9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:32.887397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af9cf5-5120-4832-b261-15c1450a60ed None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:32.980718 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c583d-f618-41ae-94ef-e713ad3494a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:32.981865 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c583d-f618-41ae-94ef-e713ad3494a0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:32.983904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c583d-f618-41ae-94ef-e713ad3494a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:32.986179 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c583d-f618-41ae-94ef-e713ad3494a0 None admin] PATH_INFO: `/v3/users/1c055d472f134e8781758d53d4d6ec52` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:32.987879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c583d-f618-41ae-94ef-e713ad3494a0 None admin] RBAC: Authorizing `identity:get_user(user_id=1c055d472f134e8781758d53d4d6ec52)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:32.990757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c583d-f618-41ae-94ef-e713ad3494a0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:32.994317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 63/127] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:32 2022] GET /identity/v3/users/1c055d472f134e8781758d53d4d6ec52 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:32.995943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c583d-f618-41ae-94ef-e713ad3494a0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.019630 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cbcf3-39be-4ec2-ad2e-4f4425649fb9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.038917 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:33.062985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bafc5c-8e9c-4ba8-afe6-965f487ea180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.063624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bafc5c-8e9c-4ba8-afe6-965f487ea180 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.064055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bafc5c-8e9c-4ba8-afe6-965f487ea180 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.064330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bafc5c-8e9c-4ba8-afe6-965f487ea180 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.076282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bafc5c-8e9c-4ba8-afe6-965f487ea180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:33.080557 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f2bafc5c-8e9c-4ba8-afe6-965f487ea180 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:33.083681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:33.085407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:33.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:33.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:33.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:33.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:33.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:33.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:33.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:33.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:33.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:33.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:33.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:33.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:33.093399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 65/128] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:24:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:33.094327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bafc5c-8e9c-4ba8-afe6-965f487ea180 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.154086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c583d-f618-41ae-94ef-e713ad3494a0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.241154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bafc5c-8e9c-4ba8-afe6-965f487ea180 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.253082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edc77a-7553-428c-b275-64d14511861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.253854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edc77a-7553-428c-b275-64d14511861b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.254137 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edc77a-7553-428c-b275-64d14511861b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.254617 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edc77a-7553-428c-b275-64d14511861b None admin] PATH_INFO: `/v3/users/1c055d472f134e8781758d53d4d6ec52` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.260414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edc77a-7553-428c-b275-64d14511861b None admin] RBAC: Authorizing `identity:get_user(user_id=1c055d472f134e8781758d53d4d6ec52)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:33.262909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edc77a-7553-428c-b275-64d14511861b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:33.265507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 64/129] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:32 2022] GET /identity/v3/users/1c055d472f134e8781758d53d4d6ec52 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:33.266977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edc77a-7553-428c-b275-64d14511861b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.283479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec962f-71aa-42c9-8d09-3ca55d71b1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.284526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec962f-71aa-42c9-8d09-3ca55d71b1ce None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.285057 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec962f-71aa-42c9-8d09-3ca55d71b1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.285589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec962f-71aa-42c9-8d09-3ca55d71b1ce None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.287182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec962f-71aa-42c9-8d09-3ca55d71b1ce None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:33.288880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec962f-71aa-42c9-8d09-3ca55d71b1ce None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:33.290944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 66/130] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:33 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:33.291981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec962f-71aa-42c9-8d09-3ca55d71b1ce None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.343376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:33.428739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec962f-71aa-42c9-8d09-3ca55d71b1ce None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.443837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edc77a-7553-428c-b275-64d14511861b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.473927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:33.488780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c51f1a-b9fd-444a-89a4-6874a6a6ebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.489417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c51f1a-b9fd-444a-89a4-6874a6a6ebb1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.489706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c51f1a-b9fd-444a-89a4-6874a6a6ebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.489989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c51f1a-b9fd-444a-89a4-6874a6a6ebb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.490701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c51f1a-b9fd-444a-89a4-6874a6a6ebb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:33.491209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c51f1a-b9fd-444a-89a4-6874a6a6ebb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:33.498175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c51f1a-b9fd-444a-89a4-6874a6a6ebb1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:33.512350 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 65/131] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:33.512947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c51f1a-b9fd-444a-89a4-6874a6a6ebb1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.519465 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ecd5a-ac2f-4426-a6d5-bb3bc6a650ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.520182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ecd5a-ac2f-4426-a6d5-bb3bc6a650ed None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.520468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ecd5a-ac2f-4426-a6d5-bb3bc6a650ed None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.520745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ecd5a-ac2f-4426-a6d5-bb3bc6a650ed None admin] PATH_INFO: `/v3/projects/fa71fd1594124b72b19b1d03a7dedd13` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.522810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ecd5a-ac2f-4426-a6d5-bb3bc6a650ed None admin] RBAC: Authorizing `identity:get_project(project_id=fa71fd1594124b72b19b1d03a7dedd13)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:33.524332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ecd5a-ac2f-4426-a6d5-bb3bc6a650ed None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:33.526341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 67/132] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:33 2022] GET /identity/v3/projects/fa71fd1594124b72b19b1d03a7dedd13 => generated 312 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:33.527266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ecd5a-ac2f-4426-a6d5-bb3bc6a650ed None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.669782 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c51f1a-b9fd-444a-89a4-6874a6a6ebb1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.739196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ecd5a-ac2f-4426-a6d5-bb3bc6a650ed None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.740774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788d962-a92c-4f2b-b12e-3e01ed3b27b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.741720 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788d962-a92c-4f2b-b12e-3e01ed3b27b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.742194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788d962-a92c-4f2b-b12e-3e01ed3b27b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.742655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788d962-a92c-4f2b-b12e-3e01ed3b27b4 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5/users/1c055d472f134e8781758d53d4d6ec52/roles/2d3147d5707740a9995645aee5e671b3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.748433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788d962-a92c-4f2b-b12e-3e01ed3b27b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=640e6f0276c34a73896d6d942799e2d5, user_id=1c055d472f134e8781758d53d4d6ec52, role_id=2d3147d5707740a9995645aee5e671b3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:33.750202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788d962-a92c-4f2b-b12e-3e01ed3b27b4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:33.766325 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:33.795561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff6af9-60eb-472b-9a76-30a80baccac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.796309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6af9-60eb-472b-9a76-30a80baccac6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.796655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6af9-60eb-472b-9a76-30a80baccac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.796992 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6af9-60eb-472b-9a76-30a80baccac6 None admin] PATH_INFO: `/v3/users/9c9fa0b484ce4f7bb377c75f947c0872` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.798214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff6af9-60eb-472b-9a76-30a80baccac6 None admin] RBAC: Authorizing `identity:get_user(user_id=9c9fa0b484ce4f7bb377c75f947c0872)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:33.799757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff6af9-60eb-472b-9a76-30a80baccac6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:33.801834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 68/133] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:33 2022] GET /identity/v3/users/9c9fa0b484ce4f7bb377c75f947c0872 => generated 247 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:33.802675 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff6af9-60eb-472b-9a76-30a80baccac6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.864527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 66/134] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:24:33 2022] PUT /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5/users/1c055d472f134e8781758d53d4d6ec52/roles/2d3147d5707740a9995645aee5e671b3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:24:33.865596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788d962-a92c-4f2b-b12e-3e01ed3b27b4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.966669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff6af9-60eb-472b-9a76-30a80baccac6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.988305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:34.050036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ac713-02b7-4c69-bca1-b095124694c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:34.051171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ac713-02b7-4c69-bca1-b095124694c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:34.051640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ac713-02b7-4c69-bca1-b095124694c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:34.052024 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ac713-02b7-4c69-bca1-b095124694c1 None admin] PATH_INFO: `/v3/projects/fa71fd1594124b72b19b1d03a7dedd13/users/1c055d472f134e8781758d53d4d6ec52/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:34.054162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ac713-02b7-4c69-bca1-b095124694c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa71fd1594124b72b19b1d03a7dedd13, user_id=1c055d472f134e8781758d53d4d6ec52, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:34.059952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ac713-02b7-4c69-bca1-b095124694c1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:34.088705 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788d962-a92c-4f2b-b12e-3e01ed3b27b4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:34.135112 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d9769-27b8-4d19-9e48-b53715a260e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:34.135815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d9769-27b8-4d19-9e48-b53715a260e9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:34.136597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d9769-27b8-4d19-9e48-b53715a260e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:34.136942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d9769-27b8-4d19-9e48-b53715a260e9 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:34.138114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d9769-27b8-4d19-9e48-b53715a260e9 None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:34.139630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d9769-27b8-4d19-9e48-b53715a260e9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:34.141352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 67/135] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:33 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:34.142560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a2ab4-6d0c-4fe4-8424-4d67f8a7b1c6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:34.142846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a2ab4-6d0c-4fe4-8424-4d67f8a7b1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:34.149388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a2ab4-6d0c-4fe4-8424-4d67f8a7b1c6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:34.149388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 68/136] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:34.149388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a2ab4-6d0c-4fe4-8424-4d67f8a7b1c6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:34.149738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 69/137] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:24:33 2022] PUT /identity/v3/projects/fa71fd1594124b72b19b1d03a7dedd13/users/1c055d472f134e8781758d53d4d6ec52/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:24:34.156398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12039e0-17ec-48b5-b33a-af6ab49cc0d0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:34.156921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12039e0-17ec-48b5-b33a-af6ab49cc0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:34.157407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12039e0-17ec-48b5-b33a-af6ab49cc0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:34.200965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d12039e0-17ec-48b5-b33a-af6ab49cc0d0 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:34.202201 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d12039e0-17ec-48b5-b33a-af6ab49cc0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:34.267967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:34.367445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 70/138] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:34.380705 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a2ab4-6d0c-4fe4-8424-4d67f8a7b1c6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:34.408500 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:34.433492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230fbf9-d950-4ebd-8031-b803f0337d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:34.434238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230fbf9-d950-4ebd-8031-b803f0337d47 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:34.434526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230fbf9-d950-4ebd-8031-b803f0337d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:34.434803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230fbf9-d950-4ebd-8031-b803f0337d47 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5/users/9c9fa0b484ce4f7bb377c75f947c0872/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:34.436904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230fbf9-d950-4ebd-8031-b803f0337d47 None admin] RBAC: Authorizing `identity:create_grant(project_id=640e6f0276c34a73896d6d942799e2d5, user_id=9c9fa0b484ce4f7bb377c75f947c0872, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:34.438392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230fbf9-d950-4ebd-8031-b803f0337d47 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:34.513596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 69/139] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:24:34 2022] PUT /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5/users/9c9fa0b484ce4f7bb377c75f947c0872/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:24:34.891791 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12039e0-17ec-48b5-b33a-af6ab49cc0d0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:35.080376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12039e0-17ec-48b5-b33a-af6ab49cc0d0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:35.139592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc6a94-17ef-4552-82e8-56ffcb3afe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:35.141250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc6a94-17ef-4552-82e8-56ffcb3afe83 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:35.142058 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc6a94-17ef-4552-82e8-56ffcb3afe83 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:35.142792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc6a94-17ef-4552-82e8-56ffcb3afe83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:35.162487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc6a94-17ef-4552-82e8-56ffcb3afe83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d9cc6a94-17ef-4552-82e8-56ffcb3afe83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:35.173053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:35.174693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:35.176184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:35.176184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:35.176184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:35.176184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:35.176184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:35.176184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:35.176184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:35.176184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:35.176184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:35.176184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:35.176184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:35.176184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:35.180265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 71/140] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:35.189160 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230fbf9-d950-4ebd-8031-b803f0337d47 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:35.352474 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230fbf9-d950-4ebd-8031-b803f0337d47 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:35.421692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e81122-a47b-4790-b0d6-f350b1db3f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:35.422238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e81122-a47b-4790-b0d6-f350b1db3f21 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:35.422523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e81122-a47b-4790-b0d6-f350b1db3f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:35.422798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e81122-a47b-4790-b0d6-f350b1db3f21 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:35.423482 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e81122-a47b-4790-b0d6-f350b1db3f21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:35.423807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e81122-a47b-4790-b0d6-f350b1db3f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:35.425204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e81122-a47b-4790-b0d6-f350b1db3f21 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:35.438645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 70/141] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:35.444414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc6a94-17ef-4552-82e8-56ffcb3afe83 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:35.466250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0657d3e-75d9-45f1-8dbe-8d7932a29588 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:35.466549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0657d3e-75d9-45f1-8dbe-8d7932a29588 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:35.466802 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0657d3e-75d9-45f1-8dbe-8d7932a29588 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:35.468332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 71/142] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:24:35.473617 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8ae8f-5c19-4140-bb91-8ed9904ba943 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:35.473904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8ae8f-5c19-4140-bb91-8ed9904ba943 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:35.474182 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8ae8f-5c19-4140-bb91-8ed9904ba943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:35.489941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:35.504212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-03c8ae8f-5c19-4140-bb91-8ed9904ba943 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:35.506309 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-03c8ae8f-5c19-4140-bb91-8ed9904ba943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:35.587069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:35.598698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc6a94-17ef-4552-82e8-56ffcb3afe83 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:35.645582 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76061374-1680-4630-84d1-aaaa3475ab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:35.646998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76061374-1680-4630-84d1-aaaa3475ab76 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:35.647299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76061374-1680-4630-84d1-aaaa3475ab76 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:35.647576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76061374-1680-4630-84d1-aaaa3475ab76 None admin] PATH_INFO: `/v3/users/1c055d472f134e8781758d53d4d6ec52` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:35.650199 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76061374-1680-4630-84d1-aaaa3475ab76 None admin] RBAC: Authorizing `identity:get_user(user_id=1c055d472f134e8781758d53d4d6ec52)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:35.651778 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76061374-1680-4630-84d1-aaaa3475ab76 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:35.653671 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 72/143] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:35 2022] GET /identity/v3/users/1c055d472f134e8781758d53d4d6ec52 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:35.660745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab0431-d07e-433f-8b32-ae48f7a674df None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:35.661048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab0431-d07e-433f-8b32-ae48f7a674df None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:35.661307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab0431-d07e-433f-8b32-ae48f7a674df None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:35.662690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 73/144] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:35.671974 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab0431-d07e-433f-8b32-ae48f7a674df None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:35.681386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 72/145] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:35.682889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dd288-f543-432f-a018-9b08791163ad None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:35.683064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dd288-f543-432f-a018-9b08791163ad None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:35.684053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dd288-f543-432f-a018-9b08791163ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:35.717467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ef1dd288-f543-432f-a018-9b08791163ad None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:35.718664 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ef1dd288-f543-432f-a018-9b08791163ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:35.849104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 73/146] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:35.857297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:35.864573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab0431-d07e-433f-8b32-ae48f7a674df None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:35.910930 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b993-6eb8-4fc4-87c5-af730af29ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:35.911789 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b993-6eb8-4fc4-87c5-af730af29ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:35.912117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b993-6eb8-4fc4-87c5-af730af29ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:35.912416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b993-6eb8-4fc4-87c5-af730af29ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:35.999646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b993-6eb8-4fc4-87c5-af730af29ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:36.001144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b993-6eb8-4fc4-87c5-af730af29ae0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:36.118803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:36.128006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 74/147] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:36.130796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dd288-f543-432f-a018-9b08791163ad None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:36.250397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:36.256282 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dd288-f543-432f-a018-9b08791163ad None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:36.264760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b993-6eb8-4fc4-87c5-af730af29ae0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:36.300841 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d48aa1-2172-45b5-99e8-714235ad5b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:36.301477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d48aa1-2172-45b5-99e8-714235ad5b89 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:36.301753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d48aa1-2172-45b5-99e8-714235ad5b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:36.302020 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d48aa1-2172-45b5-99e8-714235ad5b89 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:36.303127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d48aa1-2172-45b5-99e8-714235ad5b89 None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:36.304614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d48aa1-2172-45b5-99e8-714235ad5b89 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:36.306762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 74/148] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:36 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:36.316571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d48aa1-2172-45b5-99e8-714235ad5b89 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:36.470436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d48aa1-2172-45b5-99e8-714235ad5b89 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:36.474924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b993-6eb8-4fc4-87c5-af730af29ae0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:36.517311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df9f6c-15a5-46c5-8ef4-7906508f214a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:36.517850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df9f6c-15a5-46c5-8ef4-7906508f214a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:36.518128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df9f6c-15a5-46c5-8ef4-7906508f214a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:36.518400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df9f6c-15a5-46c5-8ef4-7906508f214a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:36.519139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df9f6c-15a5-46c5-8ef4-7906508f214a None admin] RBAC: Adding query filter params (role.id=aa830dbb276f42eebec54786852e6f47, scope.project.id=640e6f0276c34a73896d6d942799e2d5, user.id=1c055d472f134e8781758d53d4d6ec52) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:36.519445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df9f6c-15a5-46c5-8ef4-7906508f214a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:36.520942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df9f6c-15a5-46c5-8ef4-7906508f214a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:36.534755 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 75/149] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:36 2022] GET /identity/v3/role_assignments?user.id=1c055d472f134e8781758d53d4d6ec52&scope.project.id=640e6f0276c34a73896d6d942799e2d5&role.id=aa830dbb276f42eebec54786852e6f47 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:36.536551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df9f6c-15a5-46c5-8ef4-7906508f214a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:36.557976 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985e40a-1a48-40ec-a842-e3dde9c1d239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:36.558627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985e40a-1a48-40ec-a842-e3dde9c1d239 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:36.558903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985e40a-1a48-40ec-a842-e3dde9c1d239 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:36.559170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985e40a-1a48-40ec-a842-e3dde9c1d239 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:36.584052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985e40a-1a48-40ec-a842-e3dde9c1d239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:36.592086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2985e40a-1a48-40ec-a842-e3dde9c1d239 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:36.593210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:36.594065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:36.594823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:36.594823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:36.594823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:36.594823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:36.594823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:36.594823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:36.594823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:36.594823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:36.594823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:36.594823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:36.594823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:36.594823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:36.595807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 75/150] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:24:36.602334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985e40a-1a48-40ec-a842-e3dde9c1d239 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:36.710075 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df9f6c-15a5-46c5-8ef4-7906508f214a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:36.738862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:36.788811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48454b7a-8f0e-4622-bbe8-63af8f57ff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:36.789368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48454b7a-8f0e-4622-bbe8-63af8f57ff98 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:36.789654 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48454b7a-8f0e-4622-bbe8-63af8f57ff98 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:36.789937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48454b7a-8f0e-4622-bbe8-63af8f57ff98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:36.791362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48454b7a-8f0e-4622-bbe8-63af8f57ff98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:36.793003 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48454b7a-8f0e-4622-bbe8-63af8f57ff98 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:36.799474 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 76/151] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:36.800807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48454b7a-8f0e-4622-bbe8-63af8f57ff98 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:36.811449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985e40a-1a48-40ec-a842-e3dde9c1d239 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:36.853981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a7f6d-ad3a-4676-9914-675b8beb95ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:36.854616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7f6d-ad3a-4676-9914-675b8beb95ce None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:36.855639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7f6d-ad3a-4676-9914-675b8beb95ce None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:36.857260 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7f6d-ad3a-4676-9914-675b8beb95ce None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:36.857730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a7f6d-ad3a-4676-9914-675b8beb95ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:36.858282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a7f6d-ad3a-4676-9914-675b8beb95ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:36.860030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a7f6d-ad3a-4676-9914-675b8beb95ce None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:36.880702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 76/152] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:36.887360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a7f6d-ad3a-4676-9914-675b8beb95ce None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:36.999935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:37.007752 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48454b7a-8f0e-4622-bbe8-63af8f57ff98 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:37.049159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a7f6d-ad3a-4676-9914-675b8beb95ce None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:37.066783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9b69e-9d8b-48ac-87a2-10fd5f9c829a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:37.067473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9b69e-9d8b-48ac-87a2-10fd5f9c829a None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.067784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9b69e-9d8b-48ac-87a2-10fd5f9c829a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.068074 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9b69e-9d8b-48ac-87a2-10fd5f9c829a None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.068739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9b69e-9d8b-48ac-87a2-10fd5f9c829a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:37.070193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9b69e-9d8b-48ac-87a2-10fd5f9c829a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:37.094874 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:37.097943 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c347c-b292-4b84-9448-cf18491c5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:37.098757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c347c-b292-4b84-9448-cf18491c5d89 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.101337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c347c-b292-4b84-9448-cf18491c5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.101337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c347c-b292-4b84-9448-cf18491c5d89 None admin] PATH_INFO: `/v3/users/c198ef5340e0496485b77d0e1d891035` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.101337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c347c-b292-4b84-9448-cf18491c5d89 None admin] RBAC: Authorizing `identity:get_user(user_id=c198ef5340e0496485b77d0e1d891035)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:37.102606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c347c-b292-4b84-9448-cf18491c5d89 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:37.104634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 77/153] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:36 2022] GET /identity/v3/users/c198ef5340e0496485b77d0e1d891035 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:37.110880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c347c-b292-4b84-9448-cf18491c5d89 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:37.192569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 77/154] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:24:36 2022] POST /identity/v3/users => generated 283 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:24:37.194961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300d57c-5df5-4dfd-a79b-b2b57ba89c01 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.195189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300d57c-5df5-4dfd-a79b-b2b57ba89c01 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.195478 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300d57c-5df5-4dfd-a79b-b2b57ba89c01 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.202337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 78/155] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:37.204041 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e201a-8ea5-4fad-8eda-eddc1665371b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.204332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e201a-8ea5-4fad-8eda-eddc1665371b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.204610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e201a-8ea5-4fad-8eda-eddc1665371b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.242284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c347c-b292-4b84-9448-cf18491c5d89 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:37.248953 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-397e201a-8ea5-4fad-8eda-eddc1665371b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:37.250167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-397e201a-8ea5-4fad-8eda-eddc1665371b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:37.290792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faeb246-671b-4c1d-9294-75634867e19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:37.291507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb246-671b-4c1d-9294-75634867e19c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.291836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb246-671b-4c1d-9294-75634867e19c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.292186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb246-671b-4c1d-9294-75634867e19c None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.294683 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faeb246-671b-4c1d-9294-75634867e19c None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:37.296580 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faeb246-671b-4c1d-9294-75634867e19c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:37.298300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 78/156] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:37 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:37.299594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f97cf2-1800-49f9-98da-f0f4fb9a2946 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.303934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f97cf2-1800-49f9-98da-f0f4fb9a2946 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.305114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f97cf2-1800-49f9-98da-f0f4fb9a2946 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.306715 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 79/157] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:37.307340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f97cf2-1800-49f9-98da-f0f4fb9a2946 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:37.357373 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 79/158] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:37.359488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f7d36-ed8a-4d80-a111-5e7b55514228 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.360035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f7d36-ed8a-4d80-a111-5e7b55514228 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.360715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f7d36-ed8a-4d80-a111-5e7b55514228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.383465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a80f7d36-ed8a-4d80-a111-5e7b55514228 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:37.388210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a80f7d36-ed8a-4d80-a111-5e7b55514228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:37.405597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:37.468654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f97cf2-1800-49f9-98da-f0f4fb9a2946 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:37.493422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 80/159] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:37.494670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef79e7-e365-4be6-97ee-39d73a6a9d05 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.494959 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef79e7-e365-4be6-97ee-39d73a6a9d05 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.495780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef79e7-e365-4be6-97ee-39d73a6a9d05 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.496661 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 81/160] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:37.504947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c8503-035e-4d0f-bf84-62e5f34b1257 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.505232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c8503-035e-4d0f-bf84-62e5f34b1257 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.505510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c8503-035e-4d0f-bf84-62e5f34b1257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.519563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc4aff-dd2a-4399-94e3-3961fce5e51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:37.521415 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc4aff-dd2a-4399-94e3-3961fce5e51b None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.521415 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc4aff-dd2a-4399-94e3-3961fce5e51b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.521849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc4aff-dd2a-4399-94e3-3961fce5e51b None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5/users/c198ef5340e0496485b77d0e1d891035/roles/d9779f8bf7d746acbd4f8eb816c8e589` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.524311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc4aff-dd2a-4399-94e3-3961fce5e51b None admin] RBAC: Authorizing `identity:create_grant(project_id=640e6f0276c34a73896d6d942799e2d5, user_id=c198ef5340e0496485b77d0e1d891035, role_id=d9779f8bf7d746acbd4f8eb816c8e589)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:37.525772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc4aff-dd2a-4399-94e3-3961fce5e51b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:37.536467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-695c8503-035e-4d0f-bf84-62e5f34b1257 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:37.537731 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-695c8503-035e-4d0f-bf84-62e5f34b1257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:37.550395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:37.614671 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 80/161] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:24:37 2022] PUT /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5/users/c198ef5340e0496485b77d0e1d891035/roles/d9779f8bf7d746acbd4f8eb816c8e589 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:24:37.643838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 82/162] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:37.674047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc4aff-dd2a-4399-94e3-3961fce5e51b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:37.796679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc4aff-dd2a-4399-94e3-3961fce5e51b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:37.813096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:37.834098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c8503-035e-4d0f-bf84-62e5f34b1257 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:37.834991 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a31cf-8ff9-49b6-9c9b-e444bf7a652b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:37.835644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a31cf-8ff9-49b6-9c9b-e444bf7a652b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.835951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a31cf-8ff9-49b6-9c9b-e444bf7a652b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.836226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a31cf-8ff9-49b6-9c9b-e444bf7a652b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.851473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a31cf-8ff9-49b6-9c9b-e444bf7a652b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-aa9a31cf-8ff9-49b6-9c9b-e444bf7a652b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:37.860047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:37.861077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:37.862043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 81/163] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:24:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:37.868817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a31cf-8ff9-49b6-9c9b-e444bf7a652b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:37.966049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c8503-035e-4d0f-bf84-62e5f34b1257 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.001361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a31cf-8ff9-49b6-9c9b-e444bf7a652b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.017781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32e5f1-ace2-4ce4-abb2-f9f8143f48ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.018738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32e5f1-ace2-4ce4-abb2-f9f8143f48ef None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.019213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32e5f1-ace2-4ce4-abb2-f9f8143f48ef None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.019702 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32e5f1-ace2-4ce4-abb2-f9f8143f48ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.039734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32e5f1-ace2-4ce4-abb2-f9f8143f48ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:38.046210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da715a-8ceb-4dd0-bf6f-a44aa88de2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.046819 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da715a-8ceb-4dd0-bf6f-a44aa88de2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-2f32e5f1-ace2-4ce4-abb2-f9f8143f48ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:38.046997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:38.047886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:38.049080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:38.049080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:38.049080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:38.049080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:38.049080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:38.049080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:38.049080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:38.049080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:38.049080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:38.049080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:38.049080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:38.049080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:38.049686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da715a-8ceb-4dd0-bf6f-a44aa88de2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.049686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da715a-8ceb-4dd0-bf6f-a44aa88de2a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.049686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da715a-8ceb-4dd0-bf6f-a44aa88de2a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:38.049857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 83/164] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:38.049921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da715a-8ceb-4dd0-bf6f-a44aa88de2a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:38.049986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32e5f1-ace2-4ce4-abb2-f9f8143f48ef None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.050138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da715a-8ceb-4dd0-bf6f-a44aa88de2a6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:38.055170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:38.073241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 82/165] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:24:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:38.073241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da715a-8ceb-4dd0-bf6f-a44aa88de2a6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.127279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:38.196378 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32e5f1-ace2-4ce4-abb2-f9f8143f48ef None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.225327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da715a-8ceb-4dd0-bf6f-a44aa88de2a6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.270983 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb2f4d-2495-405f-b771-c6a79a38890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.271982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb2f4d-2495-405f-b771-c6a79a38890a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.272374 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb2f4d-2495-405f-b771-c6a79a38890a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.272484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba5f53-cf42-476f-a882-aae8da7d9bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.272897 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb2f4d-2495-405f-b771-c6a79a38890a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.273083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba5f53-cf42-476f-a882-aae8da7d9bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.273390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba5f53-cf42-476f-a882-aae8da7d9bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.273673 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba5f53-cf42-476f-a882-aae8da7d9bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.274645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba5f53-cf42-476f-a882-aae8da7d9bb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:38.274957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba5f53-cf42-476f-a882-aae8da7d9bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:38.276908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba5f53-cf42-476f-a882-aae8da7d9bb1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:38.289653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 83/166] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:38.290018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb2f4d-2495-405f-b771-c6a79a38890a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:38.290508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba5f53-cf42-476f-a882-aae8da7d9bb1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-65eb2f4d-2495-405f-b771-c6a79a38890a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:38.296679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:38.297859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 84/167] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:38.298950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb2f4d-2495-405f-b771-c6a79a38890a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.408254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:38.438631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:38.443363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba5f53-cf42-476f-a882-aae8da7d9bb1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.451471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb2f4d-2495-405f-b771-c6a79a38890a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.482301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac175e3-4fc3-48f8-ac23-0ce49163f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.483308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac175e3-4fc3-48f8-ac23-0ce49163f772 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.483854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac175e3-4fc3-48f8-ac23-0ce49163f772 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.484324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac175e3-4fc3-48f8-ac23-0ce49163f772 None admin] PATH_INFO: `/v3/users/1c055d472f134e8781758d53d4d6ec52` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.485755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac175e3-4fc3-48f8-ac23-0ce49163f772 None admin] RBAC: Authorizing `identity:get_user(user_id=1c055d472f134e8781758d53d4d6ec52)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:38.487476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac175e3-4fc3-48f8-ac23-0ce49163f772 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:38.489358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 84/168] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:38 2022] GET /identity/v3/users/1c055d472f134e8781758d53d4d6ec52 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:38.490540 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac175e3-4fc3-48f8-ac23-0ce49163f772 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.492282 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc06c8b-4522-45ce-8a71-32c3c68bbfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.492933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06c8b-4522-45ce-8a71-32c3c68bbfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.493215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06c8b-4522-45ce-8a71-32c3c68bbfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.493488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06c8b-4522-45ce-8a71-32c3c68bbfc0 None admin] PATH_INFO: `/v3/users/1c055d472f134e8781758d53d4d6ec52` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.494864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc06c8b-4522-45ce-8a71-32c3c68bbfc0 None admin] RBAC: Authorizing `identity:get_user(user_id=1c055d472f134e8781758d53d4d6ec52)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:38.497893 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc06c8b-4522-45ce-8a71-32c3c68bbfc0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:38.498841 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 85/169] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:38 2022] GET /identity/v3/users/1c055d472f134e8781758d53d4d6ec52 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:38.499751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc06c8b-4522-45ce-8a71-32c3c68bbfc0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.707602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc06c8b-4522-45ce-8a71-32c3c68bbfc0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.726006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac175e3-4fc3-48f8-ac23-0ce49163f772 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.781445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:38.793970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27e080-72bf-401d-ad64-cbdbca38cb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.797631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27e080-72bf-401d-ad64-cbdbca38cb25 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.797631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27e080-72bf-401d-ad64-cbdbca38cb25 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.797631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27e080-72bf-401d-ad64-cbdbca38cb25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.825931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd370c-2510-48c9-871a-7e60ca93a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.826566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd370c-2510-48c9-871a-7e60ca93a061 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.826847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd370c-2510-48c9-871a-7e60ca93a061 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.827124 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd370c-2510-48c9-871a-7e60ca93a061 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.827837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd370c-2510-48c9-871a-7e60ca93a061 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:38.828145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd370c-2510-48c9-871a-7e60ca93a061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:38.829590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd370c-2510-48c9-871a-7e60ca93a061 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:38.847171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 85/170] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:38.848166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd370c-2510-48c9-871a-7e60ca93a061 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.916892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:38.977747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27e080-72bf-401d-ad64-cbdbca38cb25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:38.979310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27e080-72bf-401d-ad64-cbdbca38cb25 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:39.115504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd370c-2510-48c9-871a-7e60ca93a061 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:39.205092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fc069-7284-418c-b5c3-d94ce96b3612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:39.205722 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fc069-7284-418c-b5c3-d94ce96b3612 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:39.206000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fc069-7284-418c-b5c3-d94ce96b3612 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:39.206267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fc069-7284-418c-b5c3-d94ce96b3612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:39.220662 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 86/171] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:39.221437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27e080-72bf-401d-ad64-cbdbca38cb25 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:39.302204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:39.335080 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fc069-7284-418c-b5c3-d94ce96b3612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:39.336815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fc069-7284-418c-b5c3-d94ce96b3612 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:39.392123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:39.439485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27e080-72bf-401d-ad64-cbdbca38cb25 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:39.484640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a85b7b-6f5a-4aaa-b671-8395366b20d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:39.485647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a85b7b-6f5a-4aaa-b671-8395366b20d4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:39.486147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a85b7b-6f5a-4aaa-b671-8395366b20d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:39.486769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a85b7b-6f5a-4aaa-b671-8395366b20d4 None admin] PATH_INFO: `/v3/users/9c9fa0b484ce4f7bb377c75f947c0872` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:39.488366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a85b7b-6f5a-4aaa-b671-8395366b20d4 None admin] RBAC: Authorizing `identity:get_user(user_id=9c9fa0b484ce4f7bb377c75f947c0872)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:39.490043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a85b7b-6f5a-4aaa-b671-8395366b20d4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:39.492127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 87/172] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:39 2022] GET /identity/v3/users/9c9fa0b484ce4f7bb377c75f947c0872 => generated 247 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:39.493275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a85b7b-6f5a-4aaa-b671-8395366b20d4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:39.524725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 86/173] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:39.525538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fc069-7284-418c-b5c3-d94ce96b3612 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:39.604028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a85b7b-6f5a-4aaa-b671-8395366b20d4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:39.608388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:39.644781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79ab3b-47f7-4c2d-a1e2-4998239cae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:39.652331 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79ab3b-47f7-4c2d-a1e2-4998239cae3b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:39.653085 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79ab3b-47f7-4c2d-a1e2-4998239cae3b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:39.653577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79ab3b-47f7-4c2d-a1e2-4998239cae3b None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:39.655069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79ab3b-47f7-4c2d-a1e2-4998239cae3b None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:39.656784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79ab3b-47f7-4c2d-a1e2-4998239cae3b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:39.658811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 88/174] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:39 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:39.660021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79ab3b-47f7-4c2d-a1e2-4998239cae3b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:39.767813 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fc069-7284-418c-b5c3-d94ce96b3612 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:39.769575 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79ab3b-47f7-4c2d-a1e2-4998239cae3b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:39.809941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f918d-2845-4f4a-8957-e660f0377703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:39.811012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f918d-2845-4f4a-8957-e660f0377703 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:39.811511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f918d-2845-4f4a-8957-e660f0377703 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:39.812020 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f918d-2845-4f4a-8957-e660f0377703 None admin] PATH_INFO: `/v3/projects/fa71fd1594124b72b19b1d03a7dedd13` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:39.813709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f918d-2845-4f4a-8957-e660f0377703 None admin] RBAC: Authorizing `identity:get_project(project_id=fa71fd1594124b72b19b1d03a7dedd13)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:39.814822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:39.816982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f918d-2845-4f4a-8957-e660f0377703 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:39.821749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 89/175] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:39 2022] GET /identity/v3/projects/fa71fd1594124b72b19b1d03a7dedd13 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:39.821749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f918d-2845-4f4a-8957-e660f0377703 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:39.833270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80974567-d725-40aa-b890-c985ca0a0b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:39.833891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80974567-d725-40aa-b890-c985ca0a0b15 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:39.834171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80974567-d725-40aa-b890-c985ca0a0b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:39.834443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80974567-d725-40aa-b890-c985ca0a0b15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:39.860299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:39.935203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f918d-2845-4f4a-8957-e660f0377703 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:39.956994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80974567-d725-40aa-b890-c985ca0a0b15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:39.958459 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80974567-d725-40aa-b890-c985ca0a0b15 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:39.976865 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fd85d-ad11-40e0-aef7-74f35fff76b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:39.977840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fd85d-ad11-40e0-aef7-74f35fff76b9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:39.978318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fd85d-ad11-40e0-aef7-74f35fff76b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:39.978841 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fd85d-ad11-40e0-aef7-74f35fff76b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:39.979871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fd85d-ad11-40e0-aef7-74f35fff76b9 None admin] RBAC: Adding query filter params (role.id=2d3147d5707740a9995645aee5e671b3, scope.project.id=640e6f0276c34a73896d6d942799e2d5, user.id=1c055d472f134e8781758d53d4d6ec52) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:39.980385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fd85d-ad11-40e0-aef7-74f35fff76b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:39.982116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fd85d-ad11-40e0-aef7-74f35fff76b9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:39.989198 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 90/176] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:39 2022] GET /identity/v3/role_assignments?user.id=1c055d472f134e8781758d53d4d6ec52&scope.project.id=640e6f0276c34a73896d6d942799e2d5&role.id=2d3147d5707740a9995645aee5e671b3 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:39.990349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fd85d-ad11-40e0-aef7-74f35fff76b9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:40.121875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fd85d-ad11-40e0-aef7-74f35fff76b9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:40.136869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:40.140092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 87/177] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:40.142595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80974567-d725-40aa-b890-c985ca0a0b15 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:40.173639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea7455-d5fa-4bd9-a4f8-002d2507f5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:40.174831 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea7455-d5fa-4bd9-a4f8-002d2507f5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:40.175315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea7455-d5fa-4bd9-a4f8-002d2507f5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:40.175828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea7455-d5fa-4bd9-a4f8-002d2507f5b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:40.176874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea7455-d5fa-4bd9-a4f8-002d2507f5b7 None admin] RBAC: Adding query filter params (role.id=aa830dbb276f42eebec54786852e6f47, scope.project.id=fa71fd1594124b72b19b1d03a7dedd13, user.id=1c055d472f134e8781758d53d4d6ec52) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:40.177435 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea7455-d5fa-4bd9-a4f8-002d2507f5b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:40.179264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea7455-d5fa-4bd9-a4f8-002d2507f5b7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:40.187125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 91/178] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:39 2022] GET /identity/v3/role_assignments?user.id=1c055d472f134e8781758d53d4d6ec52&scope.project.id=fa71fd1594124b72b19b1d03a7dedd13&role.id=aa830dbb276f42eebec54786852e6f47 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:40.233694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:40.357227 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80974567-d725-40aa-b890-c985ca0a0b15 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:40.409877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfc4bf-8f4b-4d99-a295-bc7ffa360fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:40.410442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfc4bf-8f4b-4d99-a295-bc7ffa360fac None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:40.410723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfc4bf-8f4b-4d99-a295-bc7ffa360fac None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:40.410996 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfc4bf-8f4b-4d99-a295-bc7ffa360fac None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:40.416656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfc4bf-8f4b-4d99-a295-bc7ffa360fac None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:40.418523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfc4bf-8f4b-4d99-a295-bc7ffa360fac None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:40.420719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 88/179] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:40 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:40.427233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea7455-d5fa-4bd9-a4f8-002d2507f5b7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:40.487560 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19d81b-f0c2-4a4a-9ed0-6badf4db6bfc None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:40.487974 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19d81b-f0c2-4a4a-9ed0-6badf4db6bfc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:40.488208 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19d81b-f0c2-4a4a-9ed0-6badf4db6bfc None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:40.489860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 89/180] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:40.499245 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b55cf-afb2-445b-b93a-c88878894db1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:40.500075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b55cf-afb2-445b-b93a-c88878894db1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:40.500556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b55cf-afb2-445b-b93a-c88878894db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:40.528191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-023b55cf-afb2-445b-b93a-c88878894db1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:40.529788 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-023b55cf-afb2-445b-b93a-c88878894db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:40.626572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea7455-d5fa-4bd9-a4f8-002d2507f5b7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:40.675080 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 90/181] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:40.695877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff987b2-a344-43f4-b836-ab545bf98ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:40.696941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff987b2-a344-43f4-b836-ab545bf98ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:40.697414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff987b2-a344-43f4-b836-ab545bf98ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:40.697895 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff987b2-a344-43f4-b836-ab545bf98ec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:40.699060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff987b2-a344-43f4-b836-ab545bf98ec6 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=640e6f0276c34a73896d6d942799e2d5, user.id=9c9fa0b484ce4f7bb377c75f947c0872) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:40.699663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff987b2-a344-43f4-b836-ab545bf98ec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:40.701419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff987b2-a344-43f4-b836-ab545bf98ec6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:40.708269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 92/182] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:40 2022] GET /identity/v3/role_assignments?user.id=9c9fa0b484ce4f7bb377c75f947c0872&scope.project.id=640e6f0276c34a73896d6d942799e2d5&role.id=60abeefc9ac84e31a0162ac559220669 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:40.850117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13902e3a-5920-4f05-bfb2-38c71099a2d0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:40.850461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13902e3a-5920-4f05-bfb2-38c71099a2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:40.850793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13902e3a-5920-4f05-bfb2-38c71099a2d0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:40.852531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 91/183] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:40.859250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b318b-2bf0-4b35-a82b-c47602bd3cd6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:40.859893 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b318b-2bf0-4b35-a82b-c47602bd3cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:40.860384 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b318b-2bf0-4b35-a82b-c47602bd3cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:40.886553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-342b318b-2bf0-4b35-a82b-c47602bd3cd6 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:40.888813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-342b318b-2bf0-4b35-a82b-c47602bd3cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:40.922444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:40.986044 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 93/184] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:41.031854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13902e3a-5920-4f05-bfb2-38c71099a2d0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:41.062493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:41.100197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec42bd-8bd8-417b-b13e-02783b0abd37 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.100702 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec42bd-8bd8-417b-b13e-02783b0abd37 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.101091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec42bd-8bd8-417b-b13e-02783b0abd37 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.102780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 94/185] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:41.115320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58f73-6ad3-4372-899d-b184acdeb8e1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.115686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58f73-6ad3-4372-899d-b184acdeb8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.115957 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58f73-6ad3-4372-899d-b184acdeb8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.138385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9bd58f73-6ad3-4372-899d-b184acdeb8e1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:41.139587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9bd58f73-6ad3-4372-899d-b184acdeb8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:41.161773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13902e3a-5920-4f05-bfb2-38c71099a2d0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:41.221239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b02fb-f9db-4024-ba32-574a59a29437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:41.221897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b02fb-f9db-4024-ba32-574a59a29437 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.222171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b02fb-f9db-4024-ba32-574a59a29437 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.222822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b02fb-f9db-4024-ba32-574a59a29437 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.227669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 95/186] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:41.242510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b02fb-f9db-4024-ba32-574a59a29437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-561b02fb-f9db-4024-ba32-574a59a29437 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:41.254570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:41.255527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:41.256381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 92/187] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:24:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:41.261988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd58f73-6ad3-4372-899d-b184acdeb8e1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:41.301079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b02fb-f9db-4024-ba32-574a59a29437 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:41.369524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:41.385011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd58f73-6ad3-4372-899d-b184acdeb8e1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:41.412038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:41.427504 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feceec7-0ceb-48b0-8559-e80ab4a2e154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:41.428153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feceec7-0ceb-48b0-8559-e80ab4a2e154 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.428436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feceec7-0ceb-48b0-8559-e80ab4a2e154 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.428634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b02fb-f9db-4024-ba32-574a59a29437 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:41.428742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feceec7-0ceb-48b0-8559-e80ab4a2e154 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.429365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feceec7-0ceb-48b0-8559-e80ab4a2e154 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:41.429665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feceec7-0ceb-48b0-8559-e80ab4a2e154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:41.432080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feceec7-0ceb-48b0-8559-e80ab4a2e154 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:41.441730 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 96/188] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:41.443023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb693a-c6df-41c6-bcd3-d8adcfd280fb None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.443304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb693a-c6df-41c6-bcd3-d8adcfd280fb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.443574 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb693a-c6df-41c6-bcd3-d8adcfd280fb None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.445135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 97/189] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:41.450767 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb64bc-6e1a-4fcd-89b6-0ab277fd2b0a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.451057 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb64bc-6e1a-4fcd-89b6-0ab277fd2b0a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.451336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb64bc-6e1a-4fcd-89b6-0ab277fd2b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.470728 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f6cb64bc-6e1a-4fcd-89b6-0ab277fd2b0a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:41.471972 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f6cb64bc-6e1a-4fcd-89b6-0ab277fd2b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:41.478046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b0616-2968-4d46-87c7-75bad9b4b21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:41.478906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b0616-2968-4d46-87c7-75bad9b4b21e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.479386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b0616-2968-4d46-87c7-75bad9b4b21e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.479952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b0616-2968-4d46-87c7-75bad9b4b21e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.491429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b0616-2968-4d46-87c7-75bad9b4b21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-383b0616-2968-4d46-87c7-75bad9b4b21e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:41.496908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:41.497807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:41.498596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 93/190] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:24:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:24:41.503563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b0616-2968-4d46-87c7-75bad9b4b21e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:41.550688 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 98/191] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:41.551543 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb64bc-6e1a-4fcd-89b6-0ab277fd2b0a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:41.616920 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b0616-2968-4d46-87c7-75bad9b4b21e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:41.643774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:41.659615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dac91-536d-4ff8-a77f-abbd2d0b5669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:41.660317 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dac91-536d-4ff8-a77f-abbd2d0b5669 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.660589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dac91-536d-4ff8-a77f-abbd2d0b5669 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.660861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dac91-536d-4ff8-a77f-abbd2d0b5669 None admin] PATH_INFO: `/v3/users/e0cbc4fb2d6d486da6f5a98008f5f55f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.666271 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb64bc-6e1a-4fcd-89b6-0ab277fd2b0a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:41.676587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dac91-536d-4ff8-a77f-abbd2d0b5669 None admin] RBAC: Authorizing `identity:get_user(user_id=e0cbc4fb2d6d486da6f5a98008f5f55f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:41.678684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dac91-536d-4ff8-a77f-abbd2d0b5669 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:41.680580 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 94/192] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:41 2022] GET /identity/v3/users/e0cbc4fb2d6d486da6f5a98008f5f55f => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:41.681866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dac91-536d-4ff8-a77f-abbd2d0b5669 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:41.686149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:41.713705 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977931e-4112-4360-ad87-8aef684caa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:41.715304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977931e-4112-4360-ad87-8aef684caa3e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.715709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977931e-4112-4360-ad87-8aef684caa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.716014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977931e-4112-4360-ad87-8aef684caa3e None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.716718 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977931e-4112-4360-ad87-8aef684caa3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:41.717019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977931e-4112-4360-ad87-8aef684caa3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:41.718410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977931e-4112-4360-ad87-8aef684caa3e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:41.732980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 99/193] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:24:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:41.732980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977931e-4112-4360-ad87-8aef684caa3e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:41.801637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dac91-536d-4ff8-a77f-abbd2d0b5669 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:41.841623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083b7a8-f10b-4dc4-9d88-e0358904325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:41.842243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083b7a8-f10b-4dc4-9d88-e0358904325f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.842585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083b7a8-f10b-4dc4-9d88-e0358904325f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.842861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083b7a8-f10b-4dc4-9d88-e0358904325f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.853349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083b7a8-f10b-4dc4-9d88-e0358904325f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:41.854385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977931e-4112-4360-ad87-8aef684caa3e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4083b7a8-f10b-4dc4-9d88-e0358904325f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:41.858557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:41.860504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 95/194] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:41.861912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083b7a8-f10b-4dc4-9d88-e0358904325f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:41.897060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514019f5-68f3-4fd6-893e-7bb329454b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:41.897667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514019f5-68f3-4fd6-893e-7bb329454b7c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.897938 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514019f5-68f3-4fd6-893e-7bb329454b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.898206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514019f5-68f3-4fd6-893e-7bb329454b7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.913287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:41.929337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:41.968075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083b7a8-f10b-4dc4-9d88-e0358904325f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:41.977929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514019f5-68f3-4fd6-893e-7bb329454b7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:41.979394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514019f5-68f3-4fd6-893e-7bb329454b7c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.008089 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210818c6-3064-4939-afff-0b5f927a5343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.008721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210818c6-3064-4939-afff-0b5f927a5343 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.009001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210818c6-3064-4939-afff-0b5f927a5343 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.009387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210818c6-3064-4939-afff-0b5f927a5343 None admin] PATH_INFO: `/v3/users/e0cbc4fb2d6d486da6f5a98008f5f55f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.010530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210818c6-3064-4939-afff-0b5f927a5343 None admin] RBAC: Authorizing `identity:get_user(user_id=e0cbc4fb2d6d486da6f5a98008f5f55f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.012860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210818c6-3064-4939-afff-0b5f927a5343 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.014469 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 96/195] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:41 2022] GET /identity/v3/users/e0cbc4fb2d6d486da6f5a98008f5f55f => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:42.015243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210818c6-3064-4939-afff-0b5f927a5343 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.087036 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 100/196] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:42.087036 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514019f5-68f3-4fd6-893e-7bb329454b7c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.127281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:42.139425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210818c6-3064-4939-afff-0b5f927a5343 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.173383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:42.178229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81f5e1-c622-41b0-967e-19e532c56276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.178868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81f5e1-c622-41b0-967e-19e532c56276 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.179144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81f5e1-c622-41b0-967e-19e532c56276 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.179409 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81f5e1-c622-41b0-967e-19e532c56276 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.180599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81f5e1-c622-41b0-967e-19e532c56276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.182037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81f5e1-c622-41b0-967e-19e532c56276 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.184632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 97/197] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:42.187447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81f5e1-c622-41b0-967e-19e532c56276 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.187557 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514019f5-68f3-4fd6-893e-7bb329454b7c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.220708 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ceb11-dce3-4c03-aff2-ed84f4993d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.221308 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ceb11-dce3-4c03-aff2-ed84f4993d83 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.221586 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ceb11-dce3-4c03-aff2-ed84f4993d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.221843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ceb11-dce3-4c03-aff2-ed84f4993d83 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.222503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ceb11-dce3-4c03-aff2-ed84f4993d83 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:42.222796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ceb11-dce3-4c03-aff2-ed84f4993d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.224202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ceb11-dce3-4c03-aff2-ed84f4993d83 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.233509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 101/198] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:42.234346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ceb11-dce3-4c03-aff2-ed84f4993d83 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.297910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81f5e1-c622-41b0-967e-19e532c56276 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.339875 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d231d-70cd-47eb-825c-1a5f4ccc9834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.340405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d231d-70cd-47eb-825c-1a5f4ccc9834 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.340684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d231d-70cd-47eb-825c-1a5f4ccc9834 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.340960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d231d-70cd-47eb-825c-1a5f4ccc9834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.342417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ceb11-dce3-4c03-aff2-ed84f4993d83 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.347376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:42.389307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56c545-cbe9-4aed-b64b-c599c9520352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.389950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56c545-cbe9-4aed-b64b-c599c9520352 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.390227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56c545-cbe9-4aed-b64b-c599c9520352 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.390504 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56c545-cbe9-4aed-b64b-c599c9520352 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.391650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56c545-cbe9-4aed-b64b-c599c9520352 None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.393214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56c545-cbe9-4aed-b64b-c599c9520352 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.394934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 102/199] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:42.395690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56c545-cbe9-4aed-b64b-c599c9520352 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.423011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:42.425711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d231d-70cd-47eb-825c-1a5f4ccc9834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.427172 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d231d-70cd-47eb-825c-1a5f4ccc9834 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.510118 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56c545-cbe9-4aed-b64b-c599c9520352 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.534238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 98/200] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:42.535148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d231d-70cd-47eb-825c-1a5f4ccc9834 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.545914 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261b0fc-6eab-4e11-a42d-f57ada71deef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.546528 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261b0fc-6eab-4e11-a42d-f57ada71deef None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.546805 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261b0fc-6eab-4e11-a42d-f57ada71deef None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.547080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261b0fc-6eab-4e11-a42d-f57ada71deef None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.547746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261b0fc-6eab-4e11-a42d-f57ada71deef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.549385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261b0fc-6eab-4e11-a42d-f57ada71deef None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.637568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:42.640462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d231d-70cd-47eb-825c-1a5f4ccc9834 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.655903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 103/201] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:24:42 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:42.660849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261b0fc-6eab-4e11-a42d-f57ada71deef None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.679142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e956b2-5e00-481a-85dd-1438cb1992af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.680555 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e956b2-5e00-481a-85dd-1438cb1992af None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.680838 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e956b2-5e00-481a-85dd-1438cb1992af None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.681112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e956b2-5e00-481a-85dd-1438cb1992af None admin] PATH_INFO: `/v3/users/c198ef5340e0496485b77d0e1d891035` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.682435 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e956b2-5e00-481a-85dd-1438cb1992af None admin] RBAC: Authorizing `identity:get_user(user_id=c198ef5340e0496485b77d0e1d891035)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.684918 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e956b2-5e00-481a-85dd-1438cb1992af None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.686674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 99/202] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/users/c198ef5340e0496485b77d0e1d891035 => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:42.687917 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e956b2-5e00-481a-85dd-1438cb1992af None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.703407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:42.789079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261b0fc-6eab-4e11-a42d-f57ada71deef None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.829763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e956b2-5e00-481a-85dd-1438cb1992af None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.831162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604be756-a99d-4888-88fc-fe29f86e4e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.831987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604be756-a99d-4888-88fc-fe29f86e4e61 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.832268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604be756-a99d-4888-88fc-fe29f86e4e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.833627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604be756-a99d-4888-88fc-fe29f86e4e61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.833627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604be756-a99d-4888-88fc-fe29f86e4e61 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=5feb6abf7be947c9b5eef75d51387fcf, user.id=e0cbc4fb2d6d486da6f5a98008f5f55f) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:42.833627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604be756-a99d-4888-88fc-fe29f86e4e61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.837460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604be756-a99d-4888-88fc-fe29f86e4e61 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.841813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 104/203] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/role_assignments?user.id=e0cbc4fb2d6d486da6f5a98008f5f55f&scope.project.id=5feb6abf7be947c9b5eef75d51387fcf&role.id=60abeefc9ac84e31a0162ac559220669 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:42.842726 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604be756-a99d-4888-88fc-fe29f86e4e61 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.877413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b7bf-5456-47a6-846b-8aba8ec9c6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.878104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b7bf-5456-47a6-846b-8aba8ec9c6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.878384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b7bf-5456-47a6-846b-8aba8ec9c6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.878656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b7bf-5456-47a6-846b-8aba8ec9c6b5 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.879977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438b7bf-5456-47a6-846b-8aba8ec9c6b5 None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.881533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438b7bf-5456-47a6-846b-8aba8ec9c6b5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.891560 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 100/204] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:42.891560 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b7bf-5456-47a6-846b-8aba8ec9c6b5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.945867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:42.980264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:42.993114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604be756-a99d-4888-88fc-fe29f86e4e61 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:43.052085 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f54767-27fb-45e9-a55a-eda5aec6ec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:43.052085 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f54767-27fb-45e9-a55a-eda5aec6ec49 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:43.052085 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f54767-27fb-45e9-a55a-eda5aec6ec49 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:43.052085 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f54767-27fb-45e9-a55a-eda5aec6ec49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:43.052595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b7bf-5456-47a6-846b-8aba8ec9c6b5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:43.102800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6fd9d-9daf-42c1-8be7-e113d2343523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:43.104130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6fd9d-9daf-42c1-8be7-e113d2343523 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:43.104981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6fd9d-9daf-42c1-8be7-e113d2343523 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:43.105486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6fd9d-9daf-42c1-8be7-e113d2343523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:43.106740 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6fd9d-9daf-42c1-8be7-e113d2343523 None admin] RBAC: Adding query filter params (role.id=2d3147d5707740a9995645aee5e671b3, scope.project.id=5feb6abf7be947c9b5eef75d51387fcf, user.id=e0cbc4fb2d6d486da6f5a98008f5f55f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:43.107263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6fd9d-9daf-42c1-8be7-e113d2343523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:43.109653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6fd9d-9daf-42c1-8be7-e113d2343523 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:43.117024 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 101/205] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/role_assignments?user.id=e0cbc4fb2d6d486da6f5a98008f5f55f&scope.project.id=5feb6abf7be947c9b5eef75d51387fcf&role.id=2d3147d5707740a9995645aee5e671b3 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:43.136357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f54767-27fb-45e9-a55a-eda5aec6ec49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:43.138412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f54767-27fb-45e9-a55a-eda5aec6ec49 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:43.278221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:43.289070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 105/206] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:43.295221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6fd9d-9daf-42c1-8be7-e113d2343523 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:43.452991 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:43.456004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6fd9d-9daf-42c1-8be7-e113d2343523 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:43.501236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4efa73-a8d3-4fef-8f35-a62bc3534b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:43.501881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4efa73-a8d3-4fef-8f35-a62bc3534b21 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:43.502163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4efa73-a8d3-4fef-8f35-a62bc3534b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:43.502441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4efa73-a8d3-4fef-8f35-a62bc3534b21 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:43.508454 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4efa73-a8d3-4fef-8f35-a62bc3534b21 None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:43.509987 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4efa73-a8d3-4fef-8f35-a62bc3534b21 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:43.512109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 102/207] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:43 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:43.517862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f54767-27fb-45e9-a55a-eda5aec6ec49 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:43.675108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f54767-27fb-45e9-a55a-eda5aec6ec49 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:43.730755 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c7023-0061-4893-8ed3-adc8c4c40b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:43.731425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c7023-0061-4893-8ed3-adc8c4c40b56 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:43.731702 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c7023-0061-4893-8ed3-adc8c4c40b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:43.732005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c7023-0061-4893-8ed3-adc8c4c40b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:43.732737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c7023-0061-4893-8ed3-adc8c4c40b56 None admin] RBAC: Adding query filter params (role.id=d9779f8bf7d746acbd4f8eb816c8e589, scope.project.id=640e6f0276c34a73896d6d942799e2d5, user.id=c198ef5340e0496485b77d0e1d891035) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:43.733039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c7023-0061-4893-8ed3-adc8c4c40b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:43.734484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c7023-0061-4893-8ed3-adc8c4c40b56 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:43.741188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 106/208] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:43 2022] GET /identity/v3/role_assignments?user.id=c198ef5340e0496485b77d0e1d891035&scope.project.id=640e6f0276c34a73896d6d942799e2d5&role.id=d9779f8bf7d746acbd4f8eb816c8e589 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:45.083542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2e18c-b618-4f55-bd62-3b4cb5d286fa None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.084144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2e18c-b618-4f55-bd62-3b4cb5d286fa None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.084524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2e18c-b618-4f55-bd62-3b4cb5d286fa None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.087170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 103/209] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:45.093137 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4879661-c7fe-4f3d-b9ed-59c956a36517 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.094043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4879661-c7fe-4f3d-b9ed-59c956a36517 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.094540 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4879661-c7fe-4f3d-b9ed-59c956a36517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.114448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a4879661-c7fe-4f3d-b9ed-59c956a36517 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:45.115995 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a4879661-c7fe-4f3d-b9ed-59c956a36517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:45.165626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169b490-53a1-4d24-b8df-4ac890fa40e4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.166275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169b490-53a1-4d24-b8df-4ac890fa40e4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.166762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169b490-53a1-4d24-b8df-4ac890fa40e4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.169377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 104/210] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:24:45.174599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:45.175410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470c01-cc8b-40f9-8b7c-c1d924ea15ea None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.175946 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470c01-cc8b-40f9-8b7c-c1d924ea15ea None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.176456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470c01-cc8b-40f9-8b7c-c1d924ea15ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.195755 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 107/211] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:45.205623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2b470c01-cc8b-40f9-8b7c-c1d924ea15ea None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:45.207398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2b470c01-cc8b-40f9-8b7c-c1d924ea15ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:45.216861 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eaa27-c68f-4490-be1d-1f04c177a3d2 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.217178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eaa27-c68f-4490-be1d-1f04c177a3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.217631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eaa27-c68f-4490-be1d-1f04c177a3d2 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.219905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 108/212] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:24:45.225267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f7f1b-41a3-4416-b0d4-7b5125a08ce7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.225497 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f7f1b-41a3-4416-b0d4-7b5125a08ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.225737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f7f1b-41a3-4416-b0d4-7b5125a08ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.248136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f75f7f1b-41a3-4416-b0d4-7b5125a08ce7 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:45.250090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f75f7f1b-41a3-4416-b0d4-7b5125a08ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:45.294335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 105/213] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:45.327267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580ba6d-a115-4a75-9d81-7453de8e9cbc None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.327595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580ba6d-a115-4a75-9d81-7453de8e9cbc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.327863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580ba6d-a115-4a75-9d81-7453de8e9cbc None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.329356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 106/214] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:24:45.334556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d503f68-8e97-4d8f-b163-2f40388f8579 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.334798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d503f68-8e97-4d8f-b163-2f40388f8579 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.335179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d503f68-8e97-4d8f-b163-2f40388f8579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.335823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 109/215] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:45.359704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0d503f68-8e97-4d8f-b163-2f40388f8579 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:45.360927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0d503f68-8e97-4d8f-b163-2f40388f8579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:45.446851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 107/216] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:45.496521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f7f1b-41a3-4416-b0d4-7b5125a08ce7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:45.592281 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d503f68-8e97-4d8f-b163-2f40388f8579 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:45.606154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f7f1b-41a3-4416-b0d4-7b5125a08ce7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:45.623664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:45.637103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:45.650661 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcacc1d-2568-45d6-985e-9552827551ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:45.653913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcacc1d-2568-45d6-985e-9552827551ec None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.653913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcacc1d-2568-45d6-985e-9552827551ec None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.653913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcacc1d-2568-45d6-985e-9552827551ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.662977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcacc1d-2568-45d6-985e-9552827551ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-fbcacc1d-2568-45d6-985e-9552827551ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:45.668428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:45.669370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:45.670169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 110/217] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:24:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:45.670851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcacc1d-2568-45d6-985e-9552827551ec None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:45.709098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d503f68-8e97-4d8f-b163-2f40388f8579 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:45.750870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986f3d2-29b7-4ca2-9518-14a4beaa0eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:45.751612 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986f3d2-29b7-4ca2-9518-14a4beaa0eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.751995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986f3d2-29b7-4ca2-9518-14a4beaa0eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.752264 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986f3d2-29b7-4ca2-9518-14a4beaa0eb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.753365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986f3d2-29b7-4ca2-9518-14a4beaa0eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:45.754801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986f3d2-29b7-4ca2-9518-14a4beaa0eb5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:45.756405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 108/218] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:45.760276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986f3d2-29b7-4ca2-9518-14a4beaa0eb5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:45.793332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcacc1d-2568-45d6-985e-9552827551ec None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:45.830512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bcda2-1606-4ce7-986b-4d0822bc95b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:45.831128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bcda2-1606-4ce7-986b-4d0822bc95b9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.831412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bcda2-1606-4ce7-986b-4d0822bc95b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.831680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bcda2-1606-4ce7-986b-4d0822bc95b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.845817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bcda2-1606-4ce7-986b-4d0822bc95b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-aa1bcda2-1606-4ce7-986b-4d0822bc95b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:45.847502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:45.848448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:45.849320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 111/219] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:45.849993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bcda2-1606-4ce7-986b-4d0822bc95b9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:45.865273 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:45.872318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986f3d2-29b7-4ca2-9518-14a4beaa0eb5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:45.888493 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:45.908474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a5f9f-c8bc-4da4-91b2-47c24a389020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:45.909436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a5f9f-c8bc-4da4-91b2-47c24a389020 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.909710 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a5f9f-c8bc-4da4-91b2-47c24a389020 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.909973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a5f9f-c8bc-4da4-91b2-47c24a389020 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.910633 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a5f9f-c8bc-4da4-91b2-47c24a389020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:45.910929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a5f9f-c8bc-4da4-91b2-47c24a389020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:45.912323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a5f9f-c8bc-4da4-91b2-47c24a389020 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:45.922949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 109/220] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:45.923797 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a5f9f-c8bc-4da4-91b2-47c24a389020 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:45.958502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bcda2-1606-4ce7-986b-4d0822bc95b9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:45.993662 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00bea3-134a-4ca0-a2f9-1562cb212dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:45.994295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00bea3-134a-4ca0-a2f9-1562cb212dbf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.994574 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00bea3-134a-4ca0-a2f9-1562cb212dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.994843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00bea3-134a-4ca0-a2f9-1562cb212dbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.007039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00bea3-134a-4ca0-a2f9-1562cb212dbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-bb00bea3-134a-4ca0-a2f9-1562cb212dbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:46.012607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:46.013632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 112/221] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:24:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:46.014523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00bea3-134a-4ca0-a2f9-1562cb212dbf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.032937 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a5f9f-c8bc-4da4-91b2-47c24a389020 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.068819 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb7582-9890-4fbc-8c00-409884edb798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.069474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb7582-9890-4fbc-8c00-409884edb798 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.069751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb7582-9890-4fbc-8c00-409884edb798 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.070018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb7582-9890-4fbc-8c00-409884edb798 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.070659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb7582-9890-4fbc-8c00-409884edb798 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.072136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb7582-9890-4fbc-8c00-409884edb798 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.114635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:46.123264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00bea3-134a-4ca0-a2f9-1562cb212dbf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.159806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6598c-911c-42e2-8986-b22320d6cd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.160406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6598c-911c-42e2-8986-b22320d6cd62 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.160682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6598c-911c-42e2-8986-b22320d6cd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.160949 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6598c-911c-42e2-8986-b22320d6cd62 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.161602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6598c-911c-42e2-8986-b22320d6cd62 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:46.161897 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6598c-911c-42e2-8986-b22320d6cd62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.163441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6598c-911c-42e2-8986-b22320d6cd62 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.171710 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 110/222] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:24:45 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:46.173229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 113/223] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:46.173337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb7582-9890-4fbc-8c00-409884edb798 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.173419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6598c-911c-42e2-8986-b22320d6cd62 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.195139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:46.303677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb7582-9890-4fbc-8c00-409884edb798 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.312720 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6598c-911c-42e2-8986-b22320d6cd62 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.352393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbc5d6-5aa4-4da8-8e10-9d9090eb6b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.353043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbc5d6-5aa4-4da8-8e10-9d9090eb6b22 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.353324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbc5d6-5aa4-4da8-8e10-9d9090eb6b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.353597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbc5d6-5aa4-4da8-8e10-9d9090eb6b22 None admin] PATH_INFO: `/v3/users/e0cbc4fb2d6d486da6f5a98008f5f55f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.355482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbc5d6-5aa4-4da8-8e10-9d9090eb6b22 None admin] RBAC: Authorizing `identity:get_user(user_id=e0cbc4fb2d6d486da6f5a98008f5f55f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.356996 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbc5d6-5aa4-4da8-8e10-9d9090eb6b22 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.359176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 111/224] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/users/e0cbc4fb2d6d486da6f5a98008f5f55f => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:46.359499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbc5d6-5aa4-4da8-8e10-9d9090eb6b22 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.363738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb19435-bd40-4470-b5e0-6c771ff15639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.363738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb19435-bd40-4470-b5e0-6c771ff15639 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.363738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb19435-bd40-4470-b5e0-6c771ff15639 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.363738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb19435-bd40-4470-b5e0-6c771ff15639 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.364059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb19435-bd40-4470-b5e0-6c771ff15639 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:46.364059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb19435-bd40-4470-b5e0-6c771ff15639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.364059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb19435-bd40-4470-b5e0-6c771ff15639 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.373805 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 114/225] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:46.374476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb19435-bd40-4470-b5e0-6c771ff15639 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.404119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:46.488073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:46.513657 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb19435-bd40-4470-b5e0-6c771ff15639 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.513877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbc5d6-5aa4-4da8-8e10-9d9090eb6b22 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.560408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35e0fa-f9a5-4156-86ab-95a67bb09751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.560610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeea821-14c3-497f-9090-f44cc43477af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.561064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeea821-14c3-497f-9090-f44cc43477af None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.561343 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeea821-14c3-497f-9090-f44cc43477af None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.561613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeea821-14c3-497f-9090-f44cc43477af None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.562156 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35e0fa-f9a5-4156-86ab-95a67bb09751 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.562663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35e0fa-f9a5-4156-86ab-95a67bb09751 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.562761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeea821-14c3-497f-9090-f44cc43477af None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.563234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35e0fa-f9a5-4156-86ab-95a67bb09751 None admin] PATH_INFO: `/v3/users/08f97967b98c41a0b88bed85628a638a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.564410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeea821-14c3-497f-9090-f44cc43477af None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.566561 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 115/226] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:46.571934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeea821-14c3-497f-9090-f44cc43477af None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.585152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35e0fa-f9a5-4156-86ab-95a67bb09751 None admin] RBAC: Authorizing `identity:get_user(user_id=08f97967b98c41a0b88bed85628a638a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.587609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35e0fa-f9a5-4156-86ab-95a67bb09751 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.590468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 112/227] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/users/08f97967b98c41a0b88bed85628a638a => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:46.591976 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35e0fa-f9a5-4156-86ab-95a67bb09751 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.696101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:46.706410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeea821-14c3-497f-9090-f44cc43477af None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.712332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35e0fa-f9a5-4156-86ab-95a67bb09751 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.749060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d89f4-5592-456b-a88c-744f2f50a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.749860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d89f4-5592-456b-a88c-744f2f50a16c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.750207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d89f4-5592-456b-a88c-744f2f50a16c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.750562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d89f4-5592-456b-a88c-744f2f50a16c None admin] PATH_INFO: `/v3/users/e0cbc4fb2d6d486da6f5a98008f5f55f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.751809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd849369-d255-4280-95db-4051812c383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.751982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d89f4-5592-456b-a88c-744f2f50a16c None admin] RBAC: Authorizing `identity:get_user(user_id=e0cbc4fb2d6d486da6f5a98008f5f55f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.752816 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd849369-d255-4280-95db-4051812c383e None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.753307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd849369-d255-4280-95db-4051812c383e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.753743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd849369-d255-4280-95db-4051812c383e None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf/users/e0cbc4fb2d6d486da6f5a98008f5f55f/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.753856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d89f4-5592-456b-a88c-744f2f50a16c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.757127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd849369-d255-4280-95db-4051812c383e None admin] RBAC: Authorizing `identity:create_grant(project_id=5feb6abf7be947c9b5eef75d51387fcf, user_id=e0cbc4fb2d6d486da6f5a98008f5f55f, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.757256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 116/228] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/users/e0cbc4fb2d6d486da6f5a98008f5f55f => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:46.757256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d89f4-5592-456b-a88c-744f2f50a16c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.762525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd849369-d255-4280-95db-4051812c383e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.865566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:46.869024 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 113/229] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:24:46 2022] PUT /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf/users/e0cbc4fb2d6d486da6f5a98008f5f55f/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:24:46.871062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd849369-d255-4280-95db-4051812c383e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.881316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d89f4-5592-456b-a88c-744f2f50a16c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.922346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d6ec5-4f11-4829-b739-643e93de7fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.923081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d6ec5-4f11-4829-b739-643e93de7fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.923362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d6ec5-4f11-4829-b739-643e93de7fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.923638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d6ec5-4f11-4829-b739-643e93de7fc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.977015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:47.013406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd849369-d255-4280-95db-4051812c383e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:47.059135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a16c4a-90ff-409f-b4d8-2f166984d5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:47.060213 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a16c4a-90ff-409f-b4d8-2f166984d5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:47.060502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a16c4a-90ff-409f-b4d8-2f166984d5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:47.060781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a16c4a-90ff-409f-b4d8-2f166984d5c7 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:47.062006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a16c4a-90ff-409f-b4d8-2f166984d5c7 None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:47.064278 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a16c4a-90ff-409f-b4d8-2f166984d5c7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:47.066162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 114/230] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:47.072146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a16c4a-90ff-409f-b4d8-2f166984d5c7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:47.087991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d6ec5-4f11-4829-b739-643e93de7fc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:47.090291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d6ec5-4f11-4829-b739-643e93de7fc2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:47.189430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:47.248890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a16c4a-90ff-409f-b4d8-2f166984d5c7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:47.258526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 117/231] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:47.267851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d6ec5-4f11-4829-b739-643e93de7fc2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:47.325416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a09aa-e006-4748-a96c-c638b4c476d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:47.326088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a09aa-e006-4748-a96c-c638b4c476d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:47.326423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a09aa-e006-4748-a96c-c638b4c476d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:47.326660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a09aa-e006-4748-a96c-c638b4c476d3 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf/users/e0cbc4fb2d6d486da6f5a98008f5f55f/roles/2d3147d5707740a9995645aee5e671b3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:47.336451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a09aa-e006-4748-a96c-c638b4c476d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5feb6abf7be947c9b5eef75d51387fcf, user_id=e0cbc4fb2d6d486da6f5a98008f5f55f, role_id=2d3147d5707740a9995645aee5e671b3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:47.336451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a09aa-e006-4748-a96c-c638b4c476d3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:47.371709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:47.424155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d6ec5-4f11-4829-b739-643e93de7fc2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:47.461949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 115/232] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:24:47 2022] PUT /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf/users/e0cbc4fb2d6d486da6f5a98008f5f55f/roles/2d3147d5707740a9995645aee5e671b3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:24:47.470051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73e03e-f0a3-4652-8cd1-9dca6b96f145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:47.470739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73e03e-f0a3-4652-8cd1-9dca6b96f145 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:47.471006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73e03e-f0a3-4652-8cd1-9dca6b96f145 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:47.471285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73e03e-f0a3-4652-8cd1-9dca6b96f145 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:47.472627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73e03e-f0a3-4652-8cd1-9dca6b96f145 None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:47.474433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73e03e-f0a3-4652-8cd1-9dca6b96f145 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:47.476533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 118/233] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:47 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:47.483638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a09aa-e006-4748-a96c-c638b4c476d3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:47.637358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a09aa-e006-4748-a96c-c638b4c476d3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:47.676704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:47.685790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e1f02-64a6-4f96-b360-2874d9222499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:47.686463 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e1f02-64a6-4f96-b360-2874d9222499 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:47.686827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e1f02-64a6-4f96-b360-2874d9222499 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:47.687050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e1f02-64a6-4f96-b360-2874d9222499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:47.687884 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e1f02-64a6-4f96-b360-2874d9222499 None admin] RBAC: Adding query filter params (role.id=aa830dbb276f42eebec54786852e6f47, scope.project.id=5feb6abf7be947c9b5eef75d51387fcf, user.id=08f97967b98c41a0b88bed85628a638a) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:47.688195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e1f02-64a6-4f96-b360-2874d9222499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:47.689723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e1f02-64a6-4f96-b360-2874d9222499 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:47.695678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 116/234] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:47 2022] GET /identity/v3/role_assignments?user.id=08f97967b98c41a0b88bed85628a638a&scope.project.id=5feb6abf7be947c9b5eef75d51387fcf&role.id=aa830dbb276f42eebec54786852e6f47 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:48.642456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b6941-0756-46eb-a9d4-bcb24f1d3e6d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:48.642952 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b6941-0756-46eb-a9d4-bcb24f1d3e6d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:48.642952 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b6941-0756-46eb-a9d4-bcb24f1d3e6d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:48.644581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 119/235] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:48.654774 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d9267-895f-4add-97ac-588efbe1e744 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:48.655263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d9267-895f-4add-97ac-588efbe1e744 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:48.655334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d9267-895f-4add-97ac-588efbe1e744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:48.679239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0a9d9267-895f-4add-97ac-588efbe1e744 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:48.680486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a9d9267-895f-4add-97ac-588efbe1e744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:48.692825 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db47470-e88b-46e9-8bd1-736c0a0ad14c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:48.693119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db47470-e88b-46e9-8bd1-736c0a0ad14c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:48.693376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db47470-e88b-46e9-8bd1-736c0a0ad14c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:48.694852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 120/236] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:24:48.700682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113a59-c227-4aa3-820c-09c52ea397fb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:48.701276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113a59-c227-4aa3-820c-09c52ea397fb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:48.701800 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113a59-c227-4aa3-820c-09c52ea397fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:48.721915 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5e113a59-c227-4aa3-820c-09c52ea397fb None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:48.723437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5e113a59-c227-4aa3-820c-09c52ea397fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:48.786047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 117/237] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:48.854939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 121/238] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:49.148830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d9267-895f-4add-97ac-588efbe1e744 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:49.177610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113a59-c227-4aa3-820c-09c52ea397fb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:49.255570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:49.306531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d9267-895f-4add-97ac-588efbe1e744 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:49.351737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113a59-c227-4aa3-820c-09c52ea397fb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:49.357661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:49.382248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d1d83-d45b-450d-bce0-a212aa4c7e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:49.383398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d1d83-d45b-450d-bce0-a212aa4c7e54 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:49.385339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d1d83-d45b-450d-bce0-a212aa4c7e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:49.385963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d1d83-d45b-450d-bce0-a212aa4c7e54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:49.395271 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbfef0-1d89-4b14-8b74-278cb1b964fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:49.396153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbfef0-1d89-4b14-8b74-278cb1b964fc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:49.396820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbfef0-1d89-4b14-8b74-278cb1b964fc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:49.397235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbfef0-1d89-4b14-8b74-278cb1b964fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:49.398486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbfef0-1d89-4b14-8b74-278cb1b964fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:49.400206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbfef0-1d89-4b14-8b74-278cb1b964fc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:49.400318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d1d83-d45b-450d-bce0-a212aa4c7e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:49.402908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 122/239] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:49.404227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e9f4b-cbe9-4476-a863-689b44e3e333 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:49.404666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e9f4b-cbe9-4476-a863-689b44e3e333 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:49.405071 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e9f4b-cbe9-4476-a863-689b44e3e333 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:49.406416 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 123/240] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:49.408218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e9f4b-cbe9-4476-a863-689b44e3e333 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5d5d1d83-d45b-450d-bce0-a212aa4c7e54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:49.411654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:49.412746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:49.413615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 118/241] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:49.419395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096428ff-645a-41a4-81fe-c0d16ecaba10 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:49.419938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096428ff-645a-41a4-81fe-c0d16ecaba10 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:49.420399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096428ff-645a-41a4-81fe-c0d16ecaba10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:49.439084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-096428ff-645a-41a4-81fe-c0d16ecaba10 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:49.440582 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-096428ff-645a-41a4-81fe-c0d16ecaba10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:49.524079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 119/242] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:49.525490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096428ff-645a-41a4-81fe-c0d16ecaba10 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:49.525600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e9f4b-cbe9-4476-a863-689b44e3e333 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:49.551931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:49.564779 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0924aa0-b3d0-4d3c-8868-c952c8cba881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:49.565660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0924aa0-b3d0-4d3c-8868-c952c8cba881 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:49.566094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0924aa0-b3d0-4d3c-8868-c952c8cba881 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:49.566518 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0924aa0-b3d0-4d3c-8868-c952c8cba881 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:49.567308 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0924aa0-b3d0-4d3c-8868-c952c8cba881 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:49.571388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0924aa0-b3d0-4d3c-8868-c952c8cba881 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:49.652792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096428ff-645a-41a4-81fe-c0d16ecaba10 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:49.666770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:49.689656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b277f-d08d-4b8f-86a8-36e642e41a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:49.690277 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b277f-d08d-4b8f-86a8-36e642e41a32 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:49.690556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b277f-d08d-4b8f-86a8-36e642e41a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:49.690833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b277f-d08d-4b8f-86a8-36e642e41a32 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:49.691555 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b277f-d08d-4b8f-86a8-36e642e41a32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:49.691916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b277f-d08d-4b8f-86a8-36e642e41a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:49.693349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b277f-d08d-4b8f-86a8-36e642e41a32 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:49.703966 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 120/243] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:49.705772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 124/244] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:24:49 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:49.711661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b277f-d08d-4b8f-86a8-36e642e41a32 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:49.861096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b277f-d08d-4b8f-86a8-36e642e41a32 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:49.910552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d027315-8ee3-4f92-852b-f17bbf59b96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:49.911501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d027315-8ee3-4f92-852b-f17bbf59b96d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:49.912005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d027315-8ee3-4f92-852b-f17bbf59b96d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:49.912446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d027315-8ee3-4f92-852b-f17bbf59b96d None admin] PATH_INFO: `/v3/users/ae3697534c974bcfb5a4801a421b45f2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:49.933549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d027315-8ee3-4f92-852b-f17bbf59b96d None admin] RBAC: Authorizing `identity:get_user(user_id=ae3697534c974bcfb5a4801a421b45f2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:49.935397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d027315-8ee3-4f92-852b-f17bbf59b96d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:49.937669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 121/245] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:49 2022] GET /identity/v3/users/ae3697534c974bcfb5a4801a421b45f2 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:49.943258 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0924aa0-b3d0-4d3c-8868-c952c8cba881 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:49.958244 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a3ee6-71e9-4de6-8bb3-aa0d8efa9ac6 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:49.958802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a3ee6-71e9-4de6-8bb3-aa0d8efa9ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:49.959239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a3ee6-71e9-4de6-8bb3-aa0d8efa9ac6 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:49.962919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 122/246] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:49.969826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6628-d567-41d9-aa03-d4ef8b491455 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:49.970592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6628-d567-41d9-aa03-d4ef8b491455 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:49.971039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6628-d567-41d9-aa03-d4ef8b491455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:49.994182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f12b6628-d567-41d9-aa03-d4ef8b491455 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:49.994769 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f12b6628-d567-41d9-aa03-d4ef8b491455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:50.036317 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:50.074845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0924aa0-b3d0-4d3c-8868-c952c8cba881 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:50.092096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 123/247] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:50.092953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b6628-d567-41d9-aa03-d4ef8b491455 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.154614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f489772-8c89-43aa-958f-303949d2d5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:50.155279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f489772-8c89-43aa-958f-303949d2d5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.156013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f489772-8c89-43aa-958f-303949d2d5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.156295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f489772-8c89-43aa-958f-303949d2d5d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.217380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:50.221931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b6628-d567-41d9-aa03-d4ef8b491455 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:50.245133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f489772-8c89-43aa-958f-303949d2d5d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:50.246629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f489772-8c89-43aa-958f-303949d2d5d4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:50.277170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af76b58-66c1-4312-95d8-cc93fe4d00e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:50.278496 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76b58-66c1-4312-95d8-cc93fe4d00e2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.278924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76b58-66c1-4312-95d8-cc93fe4d00e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.279611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76b58-66c1-4312-95d8-cc93fe4d00e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.295622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af76b58-66c1-4312-95d8-cc93fe4d00e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6af76b58-66c1-4312-95d8-cc93fe4d00e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:50.302033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:50.303039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:50.303865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 124/248] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:50.304543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1fe8-3b6b-4883-84be-f2c14341aaf0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.305355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1fe8-3b6b-4883-84be-f2c14341aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.305355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1fe8-3b6b-4883-84be-f2c14341aaf0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.316329 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 125/249] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:50.316329 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab1fe8-3b6b-4883-84be-f2c14341aaf0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.347438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:50.389687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 125/250] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:50.391212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6d7a7-4248-4f88-8fd4-bafab14b4284 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.395813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6d7a7-4248-4f88-8fd4-bafab14b4284 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.397744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6d7a7-4248-4f88-8fd4-bafab14b4284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.417519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-94b6d7a7-4248-4f88-8fd4-bafab14b4284 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:50.418816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-94b6d7a7-4248-4f88-8fd4-bafab14b4284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:50.443426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab1fe8-3b6b-4883-84be-f2c14341aaf0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:50.491369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb783ee-55c8-4b40-861e-f6a97200eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:50.491934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb783ee-55c8-4b40-861e-f6a97200eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.492215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb783ee-55c8-4b40-861e-f6a97200eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.492627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb783ee-55c8-4b40-861e-f6a97200eeb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.493447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb783ee-55c8-4b40-861e-f6a97200eeb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:50.493749 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb783ee-55c8-4b40-861e-f6a97200eeb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:50.495864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb783ee-55c8-4b40-861e-f6a97200eeb9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:50.500466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 126/251] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:50.501647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6d7a7-4248-4f88-8fd4-bafab14b4284 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.518182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 126/252] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:50.519361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb783ee-55c8-4b40-861e-f6a97200eeb9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.529502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:50.618175 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:50.639128 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb783ee-55c8-4b40-861e-f6a97200eeb9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:50.681831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e967fb3-de29-4577-8c0d-a9370774286a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:50.683861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e967fb3-de29-4577-8c0d-a9370774286a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.684351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e967fb3-de29-4577-8c0d-a9370774286a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.684822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e967fb3-de29-4577-8c0d-a9370774286a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.696783 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e967fb3-de29-4577-8c0d-a9370774286a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4e967fb3-de29-4577-8c0d-a9370774286a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:50.703464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:50.704398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:50.705198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:50.705198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:50.705198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:50.705198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:50.705198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:50.705198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:50.705198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:50.705198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:50.705198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:50.705198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:50.705198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:24:50.705198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:50.707631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 127/253] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:50.708678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e967fb3-de29-4577-8c0d-a9370774286a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.725847 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6d7a7-4248-4f88-8fd4-bafab14b4284 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:50.801629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b714a9-16b4-4de5-957f-d7e4f9df4acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:50.807745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b714a9-16b4-4de5-957f-d7e4f9df4acb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.807745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b714a9-16b4-4de5-957f-d7e4f9df4acb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.807745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b714a9-16b4-4de5-957f-d7e4f9df4acb None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.810314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b714a9-16b4-4de5-957f-d7e4f9df4acb None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:50.810314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b714a9-16b4-4de5-957f-d7e4f9df4acb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:50.811585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 127/254] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:50.815737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b714a9-16b4-4de5-957f-d7e4f9df4acb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.852287 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e967fb3-de29-4577-8c0d-a9370774286a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:50.888695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151d7ca-dac4-451c-885d-c392e28d809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:50.889491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151d7ca-dac4-451c-885d-c392e28d809d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.889781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151d7ca-dac4-451c-885d-c392e28d809d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.890057 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151d7ca-dac4-451c-885d-c392e28d809d None admin] PATH_INFO: `/v3/users/e0cbc4fb2d6d486da6f5a98008f5f55f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.891207 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151d7ca-dac4-451c-885d-c392e28d809d None admin] RBAC: Authorizing `identity:get_user(user_id=e0cbc4fb2d6d486da6f5a98008f5f55f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:50.892699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151d7ca-dac4-451c-885d-c392e28d809d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:50.894622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 128/255] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/users/e0cbc4fb2d6d486da6f5a98008f5f55f => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:50.895459 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151d7ca-dac4-451c-885d-c392e28d809d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.915055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:50.956491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:50.990139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b714a9-16b4-4de5-957f-d7e4f9df4acb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:51.019460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151d7ca-dac4-451c-885d-c392e28d809d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:51.034814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d414c8-a2dd-448c-90cb-7ca4833d64ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:51.035421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d414c8-a2dd-448c-90cb-7ca4833d64ed None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:51.035696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d414c8-a2dd-448c-90cb-7ca4833d64ed None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:51.036002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d414c8-a2dd-448c-90cb-7ca4833d64ed None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:51.037046 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d414c8-a2dd-448c-90cb-7ca4833d64ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:51.037347 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d414c8-a2dd-448c-90cb-7ca4833d64ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:51.038977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d414c8-a2dd-448c-90cb-7ca4833d64ed None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:51.051865 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 128/256] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:51.052954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d414c8-a2dd-448c-90cb-7ca4833d64ed None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:51.070121 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af185a5d-a9a4-4b4e-ba0e-1c57b1e099d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:51.070727 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af185a5d-a9a4-4b4e-ba0e-1c57b1e099d0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:51.071001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af185a5d-a9a4-4b4e-ba0e-1c57b1e099d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:51.071268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af185a5d-a9a4-4b4e-ba0e-1c57b1e099d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:51.072068 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af185a5d-a9a4-4b4e-ba0e-1c57b1e099d0 None admin] RBAC: Adding query filter params (role.id=d9779f8bf7d746acbd4f8eb816c8e589, scope.project.id=5feb6abf7be947c9b5eef75d51387fcf, user.id=ae3697534c974bcfb5a4801a421b45f2) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:51.072332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af185a5d-a9a4-4b4e-ba0e-1c57b1e099d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:51.074828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af185a5d-a9a4-4b4e-ba0e-1c57b1e099d0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:51.080557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 129/257] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/role_assignments?user.id=ae3697534c974bcfb5a4801a421b45f2&scope.project.id=5feb6abf7be947c9b5eef75d51387fcf&role.id=d9779f8bf7d746acbd4f8eb816c8e589 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:51.081491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af185a5d-a9a4-4b4e-ba0e-1c57b1e099d0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:51.169218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:51.171870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d414c8-a2dd-448c-90cb-7ca4833d64ed None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:51.195152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af185a5d-a9a4-4b4e-ba0e-1c57b1e099d0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:51.209973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa4bcc-3a55-43ef-9f6d-c63c9b9a1204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:51.211161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa4bcc-3a55-43ef-9f6d-c63c9b9a1204 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:51.211650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa4bcc-3a55-43ef-9f6d-c63c9b9a1204 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:51.212193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa4bcc-3a55-43ef-9f6d-c63c9b9a1204 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:51.220936 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:51.226189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa4bcc-3a55-43ef-9f6d-c63c9b9a1204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b4aa4bcc-3a55-43ef-9f6d-c63c9b9a1204 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:51.232484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:51.238828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 129/258] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:51.240352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa4bcc-3a55-43ef-9f6d-c63c9b9a1204 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:51.241129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88140941-71fa-493a-aaa5-a28ed4f0f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:51.241129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88140941-71fa-493a-aaa5-a28ed4f0f43c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:51.241129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88140941-71fa-493a-aaa5-a28ed4f0f43c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:51.241129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88140941-71fa-493a-aaa5-a28ed4f0f43c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:51.324689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88140941-71fa-493a-aaa5-a28ed4f0f43c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:51.327669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88140941-71fa-493a-aaa5-a28ed4f0f43c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:51.362007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa4bcc-3a55-43ef-9f6d-c63c9b9a1204 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:51.403825 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce2c79-8ae0-4e70-8a2d-ba4f2610c070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:51.404488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce2c79-8ae0-4e70-8a2d-ba4f2610c070 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:51.405558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce2c79-8ae0-4e70-8a2d-ba4f2610c070 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:51.406005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce2c79-8ae0-4e70-8a2d-ba4f2610c070 None admin] PATH_INFO: `/v3/users/e0cbc4fb2d6d486da6f5a98008f5f55f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:51.407537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce2c79-8ae0-4e70-8a2d-ba4f2610c070 None admin] RBAC: Authorizing `identity:get_user(user_id=e0cbc4fb2d6d486da6f5a98008f5f55f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:51.409584 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce2c79-8ae0-4e70-8a2d-ba4f2610c070 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:51.411566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 130/259] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:51 2022] GET /identity/v3/users/e0cbc4fb2d6d486da6f5a98008f5f55f => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:51.412822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce2c79-8ae0-4e70-8a2d-ba4f2610c070 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:51.496156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:51.549782 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:51.583236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 130/260] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:51.589652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88140941-71fa-493a-aaa5-a28ed4f0f43c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:51.592358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce2c79-8ae0-4e70-8a2d-ba4f2610c070 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:51.683787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f65b4-5c80-425e-b9e7-c60a73510f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:51.683787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f65b4-5c80-425e-b9e7-c60a73510f15 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:51.683787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f65b4-5c80-425e-b9e7-c60a73510f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:51.683787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f65b4-5c80-425e-b9e7-c60a73510f15 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:51.696024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f65b4-5c80-425e-b9e7-c60a73510f15 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:51.696367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f65b4-5c80-425e-b9e7-c60a73510f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:51.697823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f65b4-5c80-425e-b9e7-c60a73510f15 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:51.707647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 131/261] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:51.708380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f65b4-5c80-425e-b9e7-c60a73510f15 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:51.719632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88140941-71fa-493a-aaa5-a28ed4f0f43c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:51.760010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c841c06-ea86-4229-8aa9-59452ddd9fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:51.761427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841c06-ea86-4229-8aa9-59452ddd9fbe None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:51.761969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841c06-ea86-4229-8aa9-59452ddd9fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:51.762464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841c06-ea86-4229-8aa9-59452ddd9fbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:51.816859 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:51.844948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c841c06-ea86-4229-8aa9-59452ddd9fbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:51.846762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c841c06-ea86-4229-8aa9-59452ddd9fbe None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:51.960856 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 131/262] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:51.962096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c841c06-ea86-4229-8aa9-59452ddd9fbe None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:52.034477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f65b4-5c80-425e-b9e7-c60a73510f15 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:52.086017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:52.094358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:52.100412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01b01e-7deb-4ac4-b743-243ce2c9fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:52.101075 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01b01e-7deb-4ac4-b743-243ce2c9fc8f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.101427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01b01e-7deb-4ac4-b743-243ce2c9fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.101867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01b01e-7deb-4ac4-b743-243ce2c9fc8f None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.103026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01b01e-7deb-4ac4-b743-243ce2c9fc8f None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:52.105125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01b01e-7deb-4ac4-b743-243ce2c9fc8f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:52.107070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 132/263] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:51 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:52.107903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01b01e-7deb-4ac4-b743-243ce2c9fc8f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:52.161929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c841c06-ea86-4229-8aa9-59452ddd9fbe None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:52.239409 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5d36d-5b54-471d-a81d-1378d4e4818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:52.240083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5d36d-5b54-471d-a81d-1378d4e4818d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.240365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5d36d-5b54-471d-a81d-1378d4e4818d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.240639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5d36d-5b54-471d-a81d-1378d4e4818d None admin] PATH_INFO: `/v3/users/08f97967b98c41a0b88bed85628a638a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.241917 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5d36d-5b54-471d-a81d-1378d4e4818d None admin] RBAC: Authorizing `identity:get_user(user_id=08f97967b98c41a0b88bed85628a638a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:52.243371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5d36d-5b54-471d-a81d-1378d4e4818d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:52.247538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01b01e-7deb-4ac4-b743-243ce2c9fc8f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:52.249499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 132/264] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:51 2022] GET /identity/v3/users/08f97967b98c41a0b88bed85628a638a => generated 297 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:52.250342 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5d36d-5b54-471d-a81d-1378d4e4818d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:52.319258 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff282a9c-ed93-4318-a583-45a57cddbdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:52.319930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282a9c-ed93-4318-a583-45a57cddbdac None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.320216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282a9c-ed93-4318-a583-45a57cddbdac None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.320492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282a9c-ed93-4318-a583-45a57cddbdac None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.321690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff282a9c-ed93-4318-a583-45a57cddbdac None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:52.323192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff282a9c-ed93-4318-a583-45a57cddbdac None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:52.326358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 133/265] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:52 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:52.327203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff282a9c-ed93-4318-a583-45a57cddbdac None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:52.420488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5d36d-5b54-471d-a81d-1378d4e4818d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:52.448590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:52.462794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc50fa-c706-4f2c-8861-8a1d2be05b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:52.464284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc50fa-c706-4f2c-8861-8a1d2be05b9e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.464864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc50fa-c706-4f2c-8861-8a1d2be05b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.466377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc50fa-c706-4f2c-8861-8a1d2be05b9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.466377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc50fa-c706-4f2c-8861-8a1d2be05b9e None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=5feb6abf7be947c9b5eef75d51387fcf, user.id=e0cbc4fb2d6d486da6f5a98008f5f55f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:52.466547 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc50fa-c706-4f2c-8861-8a1d2be05b9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:52.468058 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc50fa-c706-4f2c-8861-8a1d2be05b9e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:52.475450 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 133/266] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:52 2022] GET /identity/v3/role_assignments?user.id=e0cbc4fb2d6d486da6f5a98008f5f55f&scope.project.id=5feb6abf7be947c9b5eef75d51387fcf&role.id=60abeefc9ac84e31a0162ac559220669 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:52.476705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc50fa-c706-4f2c-8861-8a1d2be05b9e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:52.491179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:52.512737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff282a9c-ed93-4318-a583-45a57cddbdac None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:52.565167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcc736-d355-467c-af8b-2306cc529e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:52.565870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcc736-d355-467c-af8b-2306cc529e67 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.566156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcc736-d355-467c-af8b-2306cc529e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.566427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcc736-d355-467c-af8b-2306cc529e67 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.567736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcc736-d355-467c-af8b-2306cc529e67 None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:52.569319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcc736-d355-467c-af8b-2306cc529e67 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:52.576491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 134/267] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:52 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:52.577950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91df2a6-c330-40aa-95c4-7ef033bb6147 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.578233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91df2a6-c330-40aa-95c4-7ef033bb6147 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.578505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91df2a6-c330-40aa-95c4-7ef033bb6147 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.580365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 135/268] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:52.581660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae11918-ef18-4b48-9cfa-668cbc7a8b16 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.582056 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae11918-ef18-4b48-9cfa-668cbc7a8b16 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.582330 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae11918-ef18-4b48-9cfa-668cbc7a8b16 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.588420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 136/269] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:52.590099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae11918-ef18-4b48-9cfa-668cbc7a8b16 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:52.618813 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc50fa-c706-4f2c-8861-8a1d2be05b9e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:52.670023 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f3455-276a-42dc-9616-29552fc7dbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:52.670756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f3455-276a-42dc-9616-29552fc7dbbf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.670981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f3455-276a-42dc-9616-29552fc7dbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.671250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f3455-276a-42dc-9616-29552fc7dbbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.672153 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f3455-276a-42dc-9616-29552fc7dbbf None admin] RBAC: Adding query filter params (role.id=2d3147d5707740a9995645aee5e671b3, scope.project.id=5feb6abf7be947c9b5eef75d51387fcf, user.id=e0cbc4fb2d6d486da6f5a98008f5f55f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:52.672509 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f3455-276a-42dc-9616-29552fc7dbbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:52.674040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f3455-276a-42dc-9616-29552fc7dbbf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:52.681746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 134/270] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:52 2022] GET /identity/v3/role_assignments?user.id=e0cbc4fb2d6d486da6f5a98008f5f55f&scope.project.id=5feb6abf7be947c9b5eef75d51387fcf&role.id=2d3147d5707740a9995645aee5e671b3 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:52.682891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e722c-3559-45f1-9bea-de0de796b42b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.683176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e722c-3559-45f1-9bea-de0de796b42b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.683448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e722c-3559-45f1-9bea-de0de796b42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.706873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ef0e722c-3559-45f1-9bea-de0de796b42b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:52.708461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ef0e722c-3559-45f1-9bea-de0de796b42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:52.733488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae11918-ef18-4b48-9cfa-668cbc7a8b16 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:52.775427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:52.784360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba47b35-5b47-49d1-bcc0-a00477dca2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:52.785060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba47b35-5b47-49d1-bcc0-a00477dca2a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.785596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba47b35-5b47-49d1-bcc0-a00477dca2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.785922 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba47b35-5b47-49d1-bcc0-a00477dca2a8 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf/users/08f97967b98c41a0b88bed85628a638a/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.788892 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba47b35-5b47-49d1-bcc0-a00477dca2a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5feb6abf7be947c9b5eef75d51387fcf, user_id=08f97967b98c41a0b88bed85628a638a, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:52.790878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba47b35-5b47-49d1-bcc0-a00477dca2a8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:52.796446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 135/271] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:52.798019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d254-50c7-44c1-81cb-e3bf266a67da None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.798390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d254-50c7-44c1-81cb-e3bf266a67da None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.798718 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d254-50c7-44c1-81cb-e3bf266a67da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.810591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:52.822855 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fbf3d254-50c7-44c1-81cb-e3bf266a67da None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:52.824813 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fbf3d254-50c7-44c1-81cb-e3bf266a67da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:52.864997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 137/272] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:24:52 2022] PUT /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf/users/08f97967b98c41a0b88bed85628a638a/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:24:52.917586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 136/273] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:53.112573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba47b35-5b47-49d1-bcc0-a00477dca2a8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:53.232192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d254-50c7-44c1-81cb-e3bf266a67da None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:53.237374 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba47b35-5b47-49d1-bcc0-a00477dca2a8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:53.283808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105f845-ae17-46d2-bcbe-bad2042557f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:53.284797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105f845-ae17-46d2-bcbe-bad2042557f9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:53.285300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105f845-ae17-46d2-bcbe-bad2042557f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:53.285789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105f845-ae17-46d2-bcbe-bad2042557f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:53.287159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105f845-ae17-46d2-bcbe-bad2042557f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:53.289562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105f845-ae17-46d2-bcbe-bad2042557f9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:53.292814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 138/274] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:53.298348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105f845-ae17-46d2-bcbe-bad2042557f9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:53.357677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d254-50c7-44c1-81cb-e3bf266a67da None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:53.374811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:53.396159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:53.400696 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d153-4cf6-406c-8068-78c1aea359a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:53.402074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d153-4cf6-406c-8068-78c1aea359a4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:53.402597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d153-4cf6-406c-8068-78c1aea359a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:53.403068 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d153-4cf6-406c-8068-78c1aea359a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:53.415599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80d153-4cf6-406c-8068-78c1aea359a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9e80d153-4cf6-406c-8068-78c1aea359a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:53.421346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:53.423150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:53.424035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:53.424035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:53.424035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:53.424035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:53.424035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:53.424035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:53.424035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:53.424035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:53.424035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:53.424035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:53.424035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:53.424035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:53.426439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 137/275] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:24:53.426643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105f845-ae17-46d2-bcbe-bad2042557f9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:53.436751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d153-4cf6-406c-8068-78c1aea359a4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:53.464452 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4505e-c668-4130-be8a-55580acb753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:53.465062 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4505e-c668-4130-be8a-55580acb753b None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:53.465440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4505e-c668-4130-be8a-55580acb753b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:53.465659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4505e-c668-4130-be8a-55580acb753b None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:53.466306 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4505e-c668-4130-be8a-55580acb753b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:53.467869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4505e-c668-4130-be8a-55580acb753b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:53.546663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d153-4cf6-406c-8068-78c1aea359a4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:53.570956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 139/276] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:24:53 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:24:53.572234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85c9d-e70d-4f2f-9755-daa801fce0b7 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:53.572517 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85c9d-e70d-4f2f-9755-daa801fce0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:53.572792 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85c9d-e70d-4f2f-9755-daa801fce0b7 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:53.583370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 140/277] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:53.583370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735fc0-0e96-4a65-88da-276c564a0917 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:53.583370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735fc0-0e96-4a65-88da-276c564a0917 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:53.583370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735fc0-0e96-4a65-88da-276c564a0917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:53.610075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1fe8b-b0bb-4fb0-98f0-20cdf77334f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:53.610745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1fe8b-b0bb-4fb0-98f0-20cdf77334f8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:53.611020 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1fe8b-b0bb-4fb0-98f0-20cdf77334f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:53.611286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1fe8b-b0bb-4fb0-98f0-20cdf77334f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:53.611982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1fe8b-b0bb-4fb0-98f0-20cdf77334f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:53.612280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1fe8b-b0bb-4fb0-98f0-20cdf77334f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:53.613682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1fe8b-b0bb-4fb0-98f0-20cdf77334f8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:53.616249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b2735fc0-0e96-4a65-88da-276c564a0917 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:53.617815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b2735fc0-0e96-4a65-88da-276c564a0917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:53.627266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 138/278] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:53.635844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1fe8b-b0bb-4fb0-98f0-20cdf77334f8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:53.711421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 141/279] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:53.730085 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:53.784536 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1fe8b-b0bb-4fb0-98f0-20cdf77334f8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:53.822105 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e83f7-eee7-484c-b809-0b393556e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:53.823425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e83f7-eee7-484c-b809-0b393556e2cb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:53.823881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e83f7-eee7-484c-b809-0b393556e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:53.824296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e83f7-eee7-484c-b809-0b393556e2cb None admin] PATH_INFO: `/v3/users/5fe589c694e3402eabd56ce047d3741e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:53.840440 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e83f7-eee7-484c-b809-0b393556e2cb None admin] RBAC: Authorizing `identity:get_user(user_id=5fe589c694e3402eabd56ce047d3741e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:53.842316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e83f7-eee7-484c-b809-0b393556e2cb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:53.844256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 139/280] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:53 2022] GET /identity/v3/users/5fe589c694e3402eabd56ce047d3741e => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:53.850444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2735fc0-0e96-4a65-88da-276c564a0917 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:53.905585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:53.962457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2735fc0-0e96-4a65-88da-276c564a0917 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:53.984376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e83f7-eee7-484c-b809-0b393556e2cb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:54.017414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da727625-8204-4177-a8c4-6792186cb46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:54.018091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da727625-8204-4177-a8c4-6792186cb46d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:54.018091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da727625-8204-4177-a8c4-6792186cb46d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:54.018358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da727625-8204-4177-a8c4-6792186cb46d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:54.019152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da727625-8204-4177-a8c4-6792186cb46d None admin] RBAC: Adding query filter params (role.id=aa830dbb276f42eebec54786852e6f47, user.id=5fe589c694e3402eabd56ce047d3741e, scope.system=all) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:54.019456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da727625-8204-4177-a8c4-6792186cb46d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:54.021873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da727625-8204-4177-a8c4-6792186cb46d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:54.028110 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 142/281] 10.222.0.91 () {56 vars in 1308 bytes} [Wed Aug 24 10:24:53 2022] GET /identity/v3/role_assignments?user.id=5fe589c694e3402eabd56ce047d3741e&scope.system=all&role.id=aa830dbb276f42eebec54786852e6f47 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:54.135305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e83f7-eee7-484c-b809-0b393556e2cb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:54.156728 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:54.189758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744d4da-2e25-4207-986e-23d352b0bb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:54.191098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744d4da-2e25-4207-986e-23d352b0bb3c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:54.191387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744d4da-2e25-4207-986e-23d352b0bb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:54.191661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744d4da-2e25-4207-986e-23d352b0bb3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:54.205675 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744d4da-2e25-4207-986e-23d352b0bb3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a744d4da-2e25-4207-986e-23d352b0bb3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:54.210508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:54.211401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:54.212223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 140/282] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:54.220225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da727625-8204-4177-a8c4-6792186cb46d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:54.336013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da727625-8204-4177-a8c4-6792186cb46d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:54.347904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:54.381539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5982c-a9db-4178-8496-7bc65382c2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:54.382170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5982c-a9db-4178-8496-7bc65382c2cc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:54.382449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5982c-a9db-4178-8496-7bc65382c2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:54.382722 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5982c-a9db-4178-8496-7bc65382c2cc None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:54.383398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5982c-a9db-4178-8496-7bc65382c2cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:54.383701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5982c-a9db-4178-8496-7bc65382c2cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:54.385128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5982c-a9db-4178-8496-7bc65382c2cc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:54.395132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 143/283] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:54.400938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744d4da-2e25-4207-986e-23d352b0bb3c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:54.551562 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744d4da-2e25-4207-986e-23d352b0bb3c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:54.601720 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b95519-5c85-4741-9637-368c6274133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:54.602367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b95519-5c85-4741-9637-368c6274133d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:54.602648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b95519-5c85-4741-9637-368c6274133d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:54.602920 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b95519-5c85-4741-9637-368c6274133d None admin] PATH_INFO: `/v3/users/ae3697534c974bcfb5a4801a421b45f2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:54.608531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b95519-5c85-4741-9637-368c6274133d None admin] RBAC: Authorizing `identity:get_user(user_id=ae3697534c974bcfb5a4801a421b45f2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:54.610015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b95519-5c85-4741-9637-368c6274133d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:54.611682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 141/284] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:54 2022] GET /identity/v3/users/ae3697534c974bcfb5a4801a421b45f2 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:54.617303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5982c-a9db-4178-8496-7bc65382c2cc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:54.749068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5982c-a9db-4178-8496-7bc65382c2cc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:54.791225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa0b77-106a-43d8-b30e-f1c33e7dc299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:54.792442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa0b77-106a-43d8-b30e-f1c33e7dc299 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:54.792727 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa0b77-106a-43d8-b30e-f1c33e7dc299 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:54.793043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa0b77-106a-43d8-b30e-f1c33e7dc299 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:54.794168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa0b77-106a-43d8-b30e-f1c33e7dc299 None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:54.795621 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa0b77-106a-43d8-b30e-f1c33e7dc299 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:54.797290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 144/285] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:54 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:54.803083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b95519-5c85-4741-9637-368c6274133d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:54.860281 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:54.958812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b95519-5c85-4741-9637-368c6274133d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:55.008985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f95a8-4f4d-45bb-85f4-e2bab8f04384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:55.009656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f95a8-4f4d-45bb-85f4-e2bab8f04384 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:55.009938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f95a8-4f4d-45bb-85f4-e2bab8f04384 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:55.010214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f95a8-4f4d-45bb-85f4-e2bab8f04384 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf/users/ae3697534c974bcfb5a4801a421b45f2/roles/d9779f8bf7d746acbd4f8eb816c8e589` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:55.012964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f95a8-4f4d-45bb-85f4-e2bab8f04384 None admin] RBAC: Authorizing `identity:create_grant(project_id=5feb6abf7be947c9b5eef75d51387fcf, user_id=ae3697534c974bcfb5a4801a421b45f2, role_id=d9779f8bf7d746acbd4f8eb816c8e589)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:55.014409 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f95a8-4f4d-45bb-85f4-e2bab8f04384 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:55.102030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 142/286] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:24:54 2022] PUT /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf/users/ae3697534c974bcfb5a4801a421b45f2/roles/d9779f8bf7d746acbd4f8eb816c8e589 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:24:55.453761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc478ad-6082-45c8-90ad-7ad8c7d08bc9 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:55.454276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc478ad-6082-45c8-90ad-7ad8c7d08bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:55.454351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc478ad-6082-45c8-90ad-7ad8c7d08bc9 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:55.456048 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 145/287] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:55.462743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2438b1-32f0-4210-b702-b0242c14ce1f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:55.463020 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2438b1-32f0-4210-b702-b0242c14ce1f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:55.463302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2438b1-32f0-4210-b702-b0242c14ce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:55.484906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ac2438b1-32f0-4210-b702-b0242c14ce1f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:55.486218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ac2438b1-32f0-4210-b702-b0242c14ce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:55.580688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 143/288] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:56.004487 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc478ad-6082-45c8-90ad-7ad8c7d08bc9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:56.064933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:56.111115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b6807-5b37-4430-9cd6-2809f2a7561b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.111622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b6807-5b37-4430-9cd6-2809f2a7561b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.111695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b6807-5b37-4430-9cd6-2809f2a7561b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:56.113316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 144/289] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:56.128680 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0bf87-14ba-4978-b1df-271c2ec25890 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.129286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0bf87-14ba-4978-b1df-271c2ec25890 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.129758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0bf87-14ba-4978-b1df-271c2ec25890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:56.154345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e8a0bf87-14ba-4978-b1df-271c2ec25890 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:56.156710 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e8a0bf87-14ba-4978-b1df-271c2ec25890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:56.177217 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc478ad-6082-45c8-90ad-7ad8c7d08bc9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:56.222266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b6160-1963-4841-a300-2029ffafb3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:56.222911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b6160-1963-4841-a300-2029ffafb3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.223193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b6160-1963-4841-a300-2029ffafb3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.223466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b6160-1963-4841-a300-2029ffafb3b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:56.225240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:56.246783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b6160-1963-4841-a300-2029ffafb3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d54b6160-1963-4841-a300-2029ffafb3b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:56.253404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:56.254799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:56.256059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 146/290] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:56.256911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2d4da-fcfa-4a43-96fe-696e92f6e7d6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.262693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2d4da-fcfa-4a43-96fe-696e92f6e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.263289 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2d4da-fcfa-4a43-96fe-696e92f6e7d6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:56.265231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 147/291] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:56.266019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2d4da-fcfa-4a43-96fe-696e92f6e7d6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:56.289866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 145/292] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:56.291740 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa1117-8f7a-4d77-b1c3-391642c619b3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.292612 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa1117-8f7a-4d77-b1c3-391642c619b3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.293269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa1117-8f7a-4d77-b1c3-391642c619b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:56.314460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-55aa1117-8f7a-4d77-b1c3-391642c619b3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:56.315733 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-55aa1117-8f7a-4d77-b1c3-391642c619b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:56.407576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:56.407797 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 146/293] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:56.416493 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2d4da-fcfa-4a43-96fe-696e92f6e7d6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:56.462158 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f361e-0fc9-4b35-9185-bef07243d356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:56.464115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f361e-0fc9-4b35-9185-bef07243d356 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.464632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f361e-0fc9-4b35-9185-bef07243d356 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.465104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f361e-0fc9-4b35-9185-bef07243d356 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:56.465979 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f361e-0fc9-4b35-9185-bef07243d356 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:56.466481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f361e-0fc9-4b35-9185-bef07243d356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:56.468114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f361e-0fc9-4b35-9185-bef07243d356 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:56.478088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 148/294] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:56.484046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa1117-8f7a-4d77-b1c3-391642c619b3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:56.612489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:56.627384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa1117-8f7a-4d77-b1c3-391642c619b3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:56.679649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464f322-93d6-4160-92a3-f6cda2f8624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:56.680315 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f322-93d6-4160-92a3-f6cda2f8624c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.680588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f322-93d6-4160-92a3-f6cda2f8624c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.680916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f322-93d6-4160-92a3-f6cda2f8624c None admin] PATH_INFO: `/v3/users/08f97967b98c41a0b88bed85628a638a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:56.682051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464f322-93d6-4160-92a3-f6cda2f8624c None admin] RBAC: Authorizing `identity:get_user(user_id=08f97967b98c41a0b88bed85628a638a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:56.684525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464f322-93d6-4160-92a3-f6cda2f8624c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:56.686427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 147/295] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:56 2022] GET /identity/v3/users/08f97967b98c41a0b88bed85628a638a => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:56.692160 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f361e-0fc9-4b35-9185-bef07243d356 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:56.694245 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3617-0b80-4814-9c47-9f63536479d2 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.694532 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3617-0b80-4814-9c47-9f63536479d2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.694807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3617-0b80-4814-9c47-9f63536479d2 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:56.696458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 148/296] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:56.707770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0b5ff-4ab0-4787-92ac-6a48a34412c6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.707770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0b5ff-4ab0-4787-92ac-6a48a34412c6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.707770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0b5ff-4ab0-4787-92ac-6a48a34412c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:56.722478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f4e0b5ff-4ab0-4787-92ac-6a48a34412c6 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:56.723688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f4e0b5ff-4ab0-4787-92ac-6a48a34412c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:56.800675 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 149/297] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:24:56.801668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0b5ff-4ab0-4787-92ac-6a48a34412c6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:56.839797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f361e-0fc9-4b35-9185-bef07243d356 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:56.876439 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755bb22-46e0-4ade-9c22-c21a5d65d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:56.876973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755bb22-46e0-4ade-9c22-c21a5d65d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.877253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755bb22-46e0-4ade-9c22-c21a5d65d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.877523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755bb22-46e0-4ade-9c22-c21a5d65d1a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:56.903748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:56.913157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:56.917937 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0b5ff-4ab0-4787-92ac-6a48a34412c6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:56.955500 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755bb22-46e0-4ade-9c22-c21a5d65d1a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:56.955689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15ccc4-1591-4a89-91cb-b2ef3db43759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:56.956311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15ccc4-1591-4a89-91cb-b2ef3db43759 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.956594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15ccc4-1591-4a89-91cb-b2ef3db43759 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.956872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15ccc4-1591-4a89-91cb-b2ef3db43759 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:56.957370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755bb22-46e0-4ade-9c22-c21a5d65d1a1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:56.969181 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15ccc4-1591-4a89-91cb-b2ef3db43759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ef15ccc4-1591-4a89-91cb-b2ef3db43759 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:56.974218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:56.975145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:24:56.975979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 150/298] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:56.976644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15ccc4-1591-4a89-91cb-b2ef3db43759 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:57.069580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 149/299] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:57.070469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755bb22-46e0-4ade-9c22-c21a5d65d1a1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:57.097014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15ccc4-1591-4a89-91cb-b2ef3db43759 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:57.135831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b328486-9c04-470e-8c66-590322de7ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:57.136545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b328486-9c04-470e-8c66-590322de7ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:57.136735 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b328486-9c04-470e-8c66-590322de7ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:57.137009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b328486-9c04-470e-8c66-590322de7ce2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:57.138144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b328486-9c04-470e-8c66-590322de7ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:57.139640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b328486-9c04-470e-8c66-590322de7ce2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:57.139892 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:57.145784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 151/300] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:57.145784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b328486-9c04-470e-8c66-590322de7ce2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:57.162764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:57.188194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755bb22-46e0-4ade-9c22-c21a5d65d1a1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:57.227008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff6681-7d41-4d93-ad51-dfdefa4c412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:57.227615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff6681-7d41-4d93-ad51-dfdefa4c412f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:57.227925 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff6681-7d41-4d93-ad51-dfdefa4c412f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:57.228202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff6681-7d41-4d93-ad51-dfdefa4c412f None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:57.228896 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff6681-7d41-4d93-ad51-dfdefa4c412f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:57.229248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff6681-7d41-4d93-ad51-dfdefa4c412f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:57.231025 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff6681-7d41-4d93-ad51-dfdefa4c412f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:57.240015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 150/301] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:57.240864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff6681-7d41-4d93-ad51-dfdefa4c412f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:57.306723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b328486-9c04-470e-8c66-590322de7ce2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:57.349676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec73af-da0d-42a6-a0c7-3fe77fd807be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:57.350321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec73af-da0d-42a6-a0c7-3fe77fd807be None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:57.350601 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec73af-da0d-42a6-a0c7-3fe77fd807be None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:57.350874 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec73af-da0d-42a6-a0c7-3fe77fd807be None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:57.352102 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec73af-da0d-42a6-a0c7-3fe77fd807be None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:57.353587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec73af-da0d-42a6-a0c7-3fe77fd807be None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:57.354602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff6681-7d41-4d93-ad51-dfdefa4c412f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:57.355528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 152/302] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:57 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:57.356335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec73af-da0d-42a6-a0c7-3fe77fd807be None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:57.390787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:57.403010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92daada-707d-481d-9d48-7152987a10dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:57.403764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92daada-707d-481d-9d48-7152987a10dc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:57.403943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92daada-707d-481d-9d48-7152987a10dc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:57.404227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92daada-707d-481d-9d48-7152987a10dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:57.415532 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92daada-707d-481d-9d48-7152987a10dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a92daada-707d-481d-9d48-7152987a10dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:57.422252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:57.423207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 151/303] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:57.428940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92daada-707d-481d-9d48-7152987a10dc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:57.468380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:57.487793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec73af-da0d-42a6-a0c7-3fe77fd807be None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:57.529987 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f856b44-73e4-4a61-a422-b1afa1f73da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:57.530614 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f856b44-73e4-4a61-a422-b1afa1f73da4 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:57.530892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f856b44-73e4-4a61-a422-b1afa1f73da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:57.531154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f856b44-73e4-4a61-a422-b1afa1f73da4 None admin] PATH_INFO: `/v3/groups` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:57.531819 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f856b44-73e4-4a61-a422-b1afa1f73da4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:57.533267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f856b44-73e4-4a61-a422-b1afa1f73da4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:57.554108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92daada-707d-481d-9d48-7152987a10dc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:57.592736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10a1b6-942d-4b1b-8756-8375a3e03e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:57.593183 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10a1b6-942d-4b1b-8756-8375a3e03e64 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:57.593466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10a1b6-942d-4b1b-8756-8375a3e03e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:57.593743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10a1b6-942d-4b1b-8756-8375a3e03e64 None admin] PATH_INFO: `/v3/users/91bc90bf6469492fb924c113ebf0bb76` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:57.608614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10a1b6-942d-4b1b-8756-8375a3e03e64 None admin] RBAC: Authorizing `identity:get_user(user_id=91bc90bf6469492fb924c113ebf0bb76)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:57.610003 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10a1b6-942d-4b1b-8756-8375a3e03e64 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:57.615851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 152/304] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:57 2022] GET /identity/v3/users/91bc90bf6469492fb924c113ebf0bb76 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:57.615851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10a1b6-942d-4b1b-8756-8375a3e03e64 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:57.645802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 153/305] 10.222.0.91 () {60 vars in 1134 bytes} [Wed Aug 24 10:24:57 2022] POST /identity/v3/groups => generated 229 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:57.647212 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f856b44-73e4-4a61-a422-b1afa1f73da4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:57.686785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:57.767601 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10a1b6-942d-4b1b-8756-8375a3e03e64 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:57.790613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f856b44-73e4-4a61-a422-b1afa1f73da4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:57.807548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c117ea-4be4-47c6-ac4f-1080cb29f4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:57.808457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c117ea-4be4-47c6-ac4f-1080cb29f4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:57.808898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c117ea-4be4-47c6-ac4f-1080cb29f4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:57.809174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c117ea-4be4-47c6-ac4f-1080cb29f4c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:57.809901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c117ea-4be4-47c6-ac4f-1080cb29f4c0 None admin] RBAC: Adding query filter params (role.id=aa830dbb276f42eebec54786852e6f47, scope.project.id=5feb6abf7be947c9b5eef75d51387fcf, user.id=08f97967b98c41a0b88bed85628a638a) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:57.810206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c117ea-4be4-47c6-ac4f-1080cb29f4c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:57.811666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c117ea-4be4-47c6-ac4f-1080cb29f4c0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:57.817692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 153/306] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:57 2022] GET /identity/v3/role_assignments?user.id=08f97967b98c41a0b88bed85628a638a&scope.project.id=5feb6abf7be947c9b5eef75d51387fcf&role.id=aa830dbb276f42eebec54786852e6f47 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:57.818585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c117ea-4be4-47c6-ac4f-1080cb29f4c0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:57.833383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92861e-5815-4411-9c6f-037da3e14e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:57.834629 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92861e-5815-4411-9c6f-037da3e14e2e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:57.835234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92861e-5815-4411-9c6f-037da3e14e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:57.835743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92861e-5815-4411-9c6f-037da3e14e2e None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:57.836908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92861e-5815-4411-9c6f-037da3e14e2e None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:57.837445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92861e-5815-4411-9c6f-037da3e14e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:57.840776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92861e-5815-4411-9c6f-037da3e14e2e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:57.854950 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 154/307] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:57.857392 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cccde-1d30-4ccf-b5fd-5dcde59e221a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:57.857896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cccde-1d30-4ccf-b5fd-5dcde59e221a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:57.858376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cccde-1d30-4ccf-b5fd-5dcde59e221a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:57.860722 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 155/308] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:57.862103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cccde-1d30-4ccf-b5fd-5dcde59e221a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:57.872963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:57.965064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c117ea-4be4-47c6-ac4f-1080cb29f4c0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:57.982375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:58.021867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddacee-10cd-408f-aeba-ee8ffa675ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:58.022495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddacee-10cd-408f-aeba-ee8ffa675ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:58.022774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddacee-10cd-408f-aeba-ee8ffa675ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:58.023049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddacee-10cd-408f-aeba-ee8ffa675ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:58.023840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddacee-10cd-408f-aeba-ee8ffa675ff1 None admin] RBAC: Adding query filter params (role.id=d9779f8bf7d746acbd4f8eb816c8e589, user.id=91bc90bf6469492fb924c113ebf0bb76, scope.system=all) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:58.024164 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddacee-10cd-408f-aeba-ee8ffa675ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:58.028689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddacee-10cd-408f-aeba-ee8ffa675ff1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:58.036525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cccde-1d30-4ccf-b5fd-5dcde59e221a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:58.038088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 154/309] 10.222.0.91 () {56 vars in 1308 bytes} [Wed Aug 24 10:24:57 2022] GET /identity/v3/role_assignments?user.id=91bc90bf6469492fb924c113ebf0bb76&scope.system=all&role.id=d9779f8bf7d746acbd4f8eb816c8e589 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:58.039338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602305c-9493-4e13-aa6d-80a780c9314d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:58.044158 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602305c-9493-4e13-aa6d-80a780c9314d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:58.044539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602305c-9493-4e13-aa6d-80a780c9314d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:58.069272 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6602305c-9493-4e13-aa6d-80a780c9314d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:58.070501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6602305c-9493-4e13-aa6d-80a780c9314d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:58.084947 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007935f-a55d-48fe-9f0a-ee41fadf470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:58.086551 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007935f-a55d-48fe-9f0a-ee41fadf470b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:58.087049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007935f-a55d-48fe-9f0a-ee41fadf470b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:58.087538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007935f-a55d-48fe-9f0a-ee41fadf470b None admin] PATH_INFO: `/v3/users/5fe589c694e3402eabd56ce047d3741e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:58.090213 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007935f-a55d-48fe-9f0a-ee41fadf470b None admin] RBAC: Authorizing `identity:get_user(user_id=5fe589c694e3402eabd56ce047d3741e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:58.092414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007935f-a55d-48fe-9f0a-ee41fadf470b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:58.094628 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 156/310] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:57 2022] GET /identity/v3/users/5fe589c694e3402eabd56ce047d3741e => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:58.100575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007935f-a55d-48fe-9f0a-ee41fadf470b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:58.175586 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 155/311] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:24:58.199106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:58.231818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007935f-a55d-48fe-9f0a-ee41fadf470b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:58.271526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fd810-37ec-46ce-9591-55eef3a24d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:58.272534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fd810-37ec-46ce-9591-55eef3a24d2a None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:58.273013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fd810-37ec-46ce-9591-55eef3a24d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:58.273482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fd810-37ec-46ce-9591-55eef3a24d2a None admin] PATH_INFO: `/v3/system/users/5fe589c694e3402eabd56ce047d3741e/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:58.275104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fd810-37ec-46ce-9591-55eef3a24d2a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5fe589c694e3402eabd56ce047d3741e, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:58.277770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fd810-37ec-46ce-9591-55eef3a24d2a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:58.376655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 157/312] 10.222.0.91 () {58 vars in 1334 bytes} [Wed Aug 24 10:24:58 2022] PUT /identity/v3/system/users/5fe589c694e3402eabd56ce047d3741e/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:24:58.471580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602305c-9493-4e13-aa6d-80a780c9314d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:58.600330 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:58.603501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602305c-9493-4e13-aa6d-80a780c9314d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:58.641598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9170e81-f43d-4e0d-bdb6-d0abe2a90436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:58.642292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9170e81-f43d-4e0d-bdb6-d0abe2a90436 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:58.642606 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9170e81-f43d-4e0d-bdb6-d0abe2a90436 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:58.642882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9170e81-f43d-4e0d-bdb6-d0abe2a90436 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:58.654820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9170e81-f43d-4e0d-bdb6-d0abe2a90436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d9170e81-f43d-4e0d-bdb6-d0abe2a90436 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:58.659633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:58.660549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:24:58.661357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 156/313] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:58.669270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fd810-37ec-46ce-9591-55eef3a24d2a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:58.777461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fd810-37ec-46ce-9591-55eef3a24d2a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:58.813676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110152fb-2b2c-4df8-ac84-aa36257947e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:58.814696 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110152fb-2b2c-4df8-ac84-aa36257947e0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:58.815177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110152fb-2b2c-4df8-ac84-aa36257947e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:58.815636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110152fb-2b2c-4df8-ac84-aa36257947e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:58.816518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110152fb-2b2c-4df8-ac84-aa36257947e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:58.817043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110152fb-2b2c-4df8-ac84-aa36257947e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:58.818672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110152fb-2b2c-4df8-ac84-aa36257947e0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:58.825706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:58.830236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 158/314] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:24:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:58.835854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9170e81-f43d-4e0d-bdb6-d0abe2a90436 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:58.957098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9170e81-f43d-4e0d-bdb6-d0abe2a90436 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:58.992903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f16b2-9222-4fe1-abf2-4fdeecb926b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:58.993876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f16b2-9222-4fe1-abf2-4fdeecb926b4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:58.994355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f16b2-9222-4fe1-abf2-4fdeecb926b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:58.995531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f16b2-9222-4fe1-abf2-4fdeecb926b4 None admin] PATH_INFO: `/v3/users/ae3697534c974bcfb5a4801a421b45f2` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:58.996988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f16b2-9222-4fe1-abf2-4fdeecb926b4 None admin] RBAC: Authorizing `identity:get_user(user_id=ae3697534c974bcfb5a4801a421b45f2)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:58.998697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f16b2-9222-4fe1-abf2-4fdeecb926b4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:59.000881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 157/315] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:24:58 2022] GET /identity/v3/users/ae3697534c974bcfb5a4801a421b45f2 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:59.006410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110152fb-2b2c-4df8-ac84-aa36257947e0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:59.114143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110152fb-2b2c-4df8-ac84-aa36257947e0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:59.153899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d326b0-cb1e-4763-bb47-d9caccdfe66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:59.154830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d326b0-cb1e-4763-bb47-d9caccdfe66b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:59.155218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d326b0-cb1e-4763-bb47-d9caccdfe66b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:59.155597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d326b0-cb1e-4763-bb47-d9caccdfe66b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:59.228314 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:59.231267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d326b0-cb1e-4763-bb47-d9caccdfe66b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:59.232756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d326b0-cb1e-4763-bb47-d9caccdfe66b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:59.355367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 159/316] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:59.364878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f16b2-9222-4fe1-abf2-4fdeecb926b4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:59.402504 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:59.484666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f16b2-9222-4fe1-abf2-4fdeecb926b4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:59.521479 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c89820-38cf-4cf8-9bda-5114abfbf4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:59.522133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c89820-38cf-4cf8-9bda-5114abfbf4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:59.522468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c89820-38cf-4cf8-9bda-5114abfbf4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:59.522745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c89820-38cf-4cf8-9bda-5114abfbf4f8 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:59.524057 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c89820-38cf-4cf8-9bda-5114abfbf4f8 None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:59.525554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c89820-38cf-4cf8-9bda-5114abfbf4f8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:59.527885 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 158/317] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:24:59 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:59.536264 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d326b0-cb1e-4763-bb47-d9caccdfe66b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:59.641586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:59.644401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d326b0-cb1e-4763-bb47-d9caccdfe66b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:59.685241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1139631-4c29-4cc7-878a-70703ba193a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:59.685856 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1139631-4c29-4cc7-878a-70703ba193a2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:59.686130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1139631-4c29-4cc7-878a-70703ba193a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:59.686398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1139631-4c29-4cc7-878a-70703ba193a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:59.687126 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1139631-4c29-4cc7-878a-70703ba193a2 None admin] RBAC: Adding query filter params (role.id=d9779f8bf7d746acbd4f8eb816c8e589, scope.project.id=5feb6abf7be947c9b5eef75d51387fcf, user.id=ae3697534c974bcfb5a4801a421b45f2) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:59.687429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1139631-4c29-4cc7-878a-70703ba193a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:59.688904 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1139631-4c29-4cc7-878a-70703ba193a2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:59.695687 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 160/318] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:59 2022] GET /identity/v3/role_assignments?user.id=ae3697534c974bcfb5a4801a421b45f2&scope.project.id=5feb6abf7be947c9b5eef75d51387fcf&role.id=d9779f8bf7d746acbd4f8eb816c8e589 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:59.769769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c3d36-dbf5-45be-b8e5-7c0051b87ef5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:59.770356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c3d36-dbf5-45be-b8e5-7c0051b87ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:59.770356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c3d36-dbf5-45be-b8e5-7c0051b87ef5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:59.772286 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 159/319] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:59.778747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57740ae8-3821-4074-ade5-107503c1221d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:59.779055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57740ae8-3821-4074-ade5-107503c1221d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:59.779292 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57740ae8-3821-4074-ade5-107503c1221d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:59.800186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-57740ae8-3821-4074-ade5-107503c1221d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:59.801422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-57740ae8-3821-4074-ade5-107503c1221d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:59.903833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 161/320] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:00.181440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c3d36-dbf5-45be-b8e5-7c0051b87ef5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:00.211217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c02bf-6944-4715-bc36-d585054a8115 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:00.211523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c02bf-6944-4715-bc36-d585054a8115 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:00.211779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c02bf-6944-4715-bc36-d585054a8115 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:00.213979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 162/321] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:00.220098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad60fb-160d-4e8f-9415-b26404950cf4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:00.220380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad60fb-160d-4e8f-9415-b26404950cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:00.220643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad60fb-160d-4e8f-9415-b26404950cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:00.240907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-39ad60fb-160d-4e8f-9415-b26404950cf4 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:00.242091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-39ad60fb-160d-4e8f-9415-b26404950cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:00.291219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:00.301184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c3d36-dbf5-45be-b8e5-7c0051b87ef5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:00.325638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 163/322] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:00.347424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0bf75-19b2-4b93-8ef7-42849323ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:00.347664 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0bf75-19b2-4b93-8ef7-42849323ca02 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:00.347945 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0bf75-19b2-4b93-8ef7-42849323ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:00.348285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0bf75-19b2-4b93-8ef7-42849323ca02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:00.349502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0bf75-19b2-4b93-8ef7-42849323ca02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:00.351098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0bf75-19b2-4b93-8ef7-42849323ca02 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:00.352893 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 160/323] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:00.359009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad60fb-160d-4e8f-9415-b26404950cf4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:00.390464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c85f3-ad48-42fe-90b7-375a932a08b5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:00.391060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c85f3-ad48-42fe-90b7-375a932a08b5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:00.391433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c85f3-ad48-42fe-90b7-375a932a08b5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:00.392413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:00.394290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 161/324] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:00.400638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedd754-5af1-4dea-8608-d0670b54de54 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:00.400931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedd754-5af1-4dea-8608-d0670b54de54 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:00.401305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedd754-5af1-4dea-8608-d0670b54de54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:00.455124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4fedd754-5af1-4dea-8608-d0670b54de54 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:00.455124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4fedd754-5af1-4dea-8608-d0670b54de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:00.568114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 162/325] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:25:00.574857 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad60fb-160d-4e8f-9415-b26404950cf4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:00.618150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedd754-5af1-4dea-8608-d0670b54de54 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:00.679655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461e95f-de00-4f75-a70c-ac99a9792a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:00.687751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461e95f-de00-4f75-a70c-ac99a9792a38 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:00.687751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461e95f-de00-4f75-a70c-ac99a9792a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:00.687751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461e95f-de00-4f75-a70c-ac99a9792a38 None admin] PATH_INFO: `/v3/groups` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:00.687751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461e95f-de00-4f75-a70c-ac99a9792a38 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:00.687751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461e95f-de00-4f75-a70c-ac99a9792a38 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:00.774873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:00.781393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedd754-5af1-4dea-8608-d0670b54de54 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:00.805931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 164/326] 10.222.0.91 () {60 vars in 1134 bytes} [Wed Aug 24 10:25:00 2022] POST /identity/v3/groups => generated 226 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:25:00.845866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461e95f-de00-4f75-a70c-ac99a9792a38 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:00.848643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e111f-0785-4a2e-89cc-1ab342046d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:00.849314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e111f-0785-4a2e-89cc-1ab342046d59 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:00.849592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e111f-0785-4a2e-89cc-1ab342046d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:00.849867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e111f-0785-4a2e-89cc-1ab342046d59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:00.874930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e111f-0785-4a2e-89cc-1ab342046d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d82e111f-0785-4a2e-89cc-1ab342046d59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:00.881814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:00.882812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:00.883641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 163/327] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:00.890711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e111f-0785-4a2e-89cc-1ab342046d59 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:00.989004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:01.009326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461e95f-de00-4f75-a70c-ac99a9792a38 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:01.023663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e111f-0785-4a2e-89cc-1ab342046d59 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:01.059164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3ad10-3f98-4fb3-9ac5-6a4e325fee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:01.059782 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3ad10-3f98-4fb3-9ac5-6a4e325fee02 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:01.060060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3ad10-3f98-4fb3-9ac5-6a4e325fee02 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:01.060319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3ad10-3f98-4fb3-9ac5-6a4e325fee02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:01.063965 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5704b4e-67f2-46d4-9b30-de28447f898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:01.064583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5704b4e-67f2-46d4-9b30-de28447f898e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:01.065973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5704b4e-67f2-46d4-9b30-de28447f898e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:01.066253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5704b4e-67f2-46d4-9b30-de28447f898e None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:01.066923 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5704b4e-67f2-46d4-9b30-de28447f898e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:01.067254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5704b4e-67f2-46d4-9b30-de28447f898e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:01.068667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5704b4e-67f2-46d4-9b30-de28447f898e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:01.074546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3ad10-3f98-4fb3-9ac5-6a4e325fee02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:01.078291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 164/328] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:25:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1ff3ad10-3f98-4fb3-9ac5-6a4e325fee02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:01.080061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:01.080929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:01.081723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 165/329] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:01.084569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5704b4e-67f2-46d4-9b30-de28447f898e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:01.090217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3ad10-3f98-4fb3-9ac5-6a4e325fee02 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:01.112273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:01.216442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5704b4e-67f2-46d4-9b30-de28447f898e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:01.239319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3ad10-3f98-4fb3-9ac5-6a4e325fee02 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:01.268761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4201790-05c9-4da5-b0fe-5e03344292c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:01.269406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4201790-05c9-4da5-b0fe-5e03344292c3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:01.269682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4201790-05c9-4da5-b0fe-5e03344292c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:01.269950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4201790-05c9-4da5-b0fe-5e03344292c3 None admin] PATH_INFO: `/v3/users/91bc90bf6469492fb924c113ebf0bb76` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:01.271396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4201790-05c9-4da5-b0fe-5e03344292c3 None admin] RBAC: Authorizing `identity:get_user(user_id=91bc90bf6469492fb924c113ebf0bb76)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:01.272869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4201790-05c9-4da5-b0fe-5e03344292c3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:01.275379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 165/330] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:25:01 2022] GET /identity/v3/users/91bc90bf6469492fb924c113ebf0bb76 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:01.280439 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4201790-05c9-4da5-b0fe-5e03344292c3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:01.299052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a8c0a-2c2e-46fe-bef4-0d24a5aeccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:01.300601 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8c0a-2c2e-46fe-bef4-0d24a5aeccd8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:01.301122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8c0a-2c2e-46fe-bef4-0d24a5aeccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:01.301498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8c0a-2c2e-46fe-bef4-0d24a5aeccd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:01.302291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a8c0a-2c2e-46fe-bef4-0d24a5aeccd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:01.302693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a8c0a-2c2e-46fe-bef4-0d24a5aeccd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:01.304466 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a8c0a-2c2e-46fe-bef4-0d24a5aeccd8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:01.319952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 166/331] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:01.323448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a8c0a-2c2e-46fe-bef4-0d24a5aeccd8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:01.340418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:01.426763 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:01.461746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4201790-05c9-4da5-b0fe-5e03344292c3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:01.517687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340214b3-10ab-4ee7-8db8-a5d7b3d4a7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:01.518742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340214b3-10ab-4ee7-8db8-a5d7b3d4a7fc None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:01.519228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340214b3-10ab-4ee7-8db8-a5d7b3d4a7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:01.519786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340214b3-10ab-4ee7-8db8-a5d7b3d4a7fc None admin] PATH_INFO: `/v3/system/users/91bc90bf6469492fb924c113ebf0bb76/roles/d9779f8bf7d746acbd4f8eb816c8e589` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:01.522790 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340214b3-10ab-4ee7-8db8-a5d7b3d4a7fc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=91bc90bf6469492fb924c113ebf0bb76, role_id=d9779f8bf7d746acbd4f8eb816c8e589)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:01.524614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340214b3-10ab-4ee7-8db8-a5d7b3d4a7fc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:01.530181 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a8c0a-2c2e-46fe-bef4-0d24a5aeccd8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:01.570689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aa379-64a4-4eef-ba27-dfe0efe2ee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:01.571254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aa379-64a4-4eef-ba27-dfe0efe2ee69 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:01.571543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aa379-64a4-4eef-ba27-dfe0efe2ee69 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:01.571822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aa379-64a4-4eef-ba27-dfe0efe2ee69 None admin] PATH_INFO: `/v3/users/5fe589c694e3402eabd56ce047d3741e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:01.573558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aa379-64a4-4eef-ba27-dfe0efe2ee69 None admin] RBAC: Authorizing `identity:get_user(user_id=5fe589c694e3402eabd56ce047d3741e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:01.575034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aa379-64a4-4eef-ba27-dfe0efe2ee69 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:01.581687 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 167/332] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:25:01 2022] GET /identity/v3/users/5fe589c694e3402eabd56ce047d3741e => generated 293 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:01.582909 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aa379-64a4-4eef-ba27-dfe0efe2ee69 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:01.605180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 166/333] 10.222.0.91 () {58 vars in 1334 bytes} [Wed Aug 24 10:25:01 2022] PUT /identity/v3/system/users/91bc90bf6469492fb924c113ebf0bb76/roles/d9779f8bf7d746acbd4f8eb816c8e589 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:25:01.685997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:01.717406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aa379-64a4-4eef-ba27-dfe0efe2ee69 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:01.761075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b60508-a19c-44c8-9ef0-15656591d09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:01.761887 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b60508-a19c-44c8-9ef0-15656591d09d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:01.762171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b60508-a19c-44c8-9ef0-15656591d09d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:01.762446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b60508-a19c-44c8-9ef0-15656591d09d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:01.763203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b60508-a19c-44c8-9ef0-15656591d09d None admin] RBAC: Adding query filter params (role.id=aa830dbb276f42eebec54786852e6f47, user.id=5fe589c694e3402eabd56ce047d3741e, scope.system=all) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:01.763573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b60508-a19c-44c8-9ef0-15656591d09d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:01.765209 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b60508-a19c-44c8-9ef0-15656591d09d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:01.782251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 168/334] 10.222.0.91 () {56 vars in 1308 bytes} [Wed Aug 24 10:25:01 2022] GET /identity/v3/role_assignments?user.id=5fe589c694e3402eabd56ce047d3741e&scope.system=all&role.id=aa830dbb276f42eebec54786852e6f47 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:03.179166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff038548-142b-4f0d-9cfe-66ac4ecd0dde None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:03.180153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff038548-142b-4f0d-9cfe-66ac4ecd0dde None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:03.180649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff038548-142b-4f0d-9cfe-66ac4ecd0dde None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:03.183066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 167/335] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:03.190306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48023c11-731a-4912-a6db-ce180ee017ec None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:03.191235 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48023c11-731a-4912-a6db-ce180ee017ec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:03.191768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48023c11-731a-4912-a6db-ce180ee017ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:03.214844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-48023c11-731a-4912-a6db-ce180ee017ec None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:03.216415 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-48023c11-731a-4912-a6db-ce180ee017ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:03.306579 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 169/336] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:25:03.368849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b7c6e-0a3c-4c0e-902b-b71e758cc944 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:03.369189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b7c6e-0a3c-4c0e-902b-b71e758cc944 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:03.369428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b7c6e-0a3c-4c0e-902b-b71e758cc944 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:03.371844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 168/337] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:03.377347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c20780-236f-4c67-a518-f6384601034b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:03.377948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c20780-236f-4c67-a518-f6384601034b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:03.378426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c20780-236f-4c67-a518-f6384601034b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:03.407863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-81c20780-236f-4c67-a518-f6384601034b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:03.409430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-81c20780-236f-4c67-a518-f6384601034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:03.488097 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:03.502048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 170/338] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:03.687174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b7c6e-0a3c-4c0e-902b-b71e758cc944 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:03.816455 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b7c6e-0a3c-4c0e-902b-b71e758cc944 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:03.861411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b47afb-ee31-4816-b409-bc077daf3b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:03.862265 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b47afb-ee31-4816-b409-bc077daf3b48 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:03.862693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b47afb-ee31-4816-b409-bc077daf3b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:03.862977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b47afb-ee31-4816-b409-bc077daf3b48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:03.882058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b47afb-ee31-4816-b409-bc077daf3b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-78b47afb-ee31-4816-b409-bc077daf3b48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:03.892021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:03.892964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:03.893776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 169/339] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:03.899746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c20780-236f-4c67-a518-f6384601034b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:03.969351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b47afb-ee31-4816-b409-bc077daf3b48 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:03.986582 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:04.065127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c20780-236f-4c67-a518-f6384601034b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:04.113165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada97f94-206c-4b59-b1d4-6916c07eaa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:04.113981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97f94-206c-4b59-b1d4-6916c07eaa74 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:04.114364 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97f94-206c-4b59-b1d4-6916c07eaa74 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:04.114687 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97f94-206c-4b59-b1d4-6916c07eaa74 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:04.116087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada97f94-206c-4b59-b1d4-6916c07eaa74 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:04.116403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada97f94-206c-4b59-b1d4-6916c07eaa74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:04.117792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada97f94-206c-4b59-b1d4-6916c07eaa74 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:04.135991 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 171/340] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:25:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:04.144451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada97f94-206c-4b59-b1d4-6916c07eaa74 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:04.173857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b47afb-ee31-4816-b409-bc077daf3b48 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:04.250189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9092ea-1216-46fe-963c-726ba5b20e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:04.250799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9092ea-1216-46fe-963c-726ba5b20e45 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:04.251083 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9092ea-1216-46fe-963c-726ba5b20e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:04.251354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9092ea-1216-46fe-963c-726ba5b20e45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:04.257016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:04.269476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9092ea-1216-46fe-963c-726ba5b20e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4c9092ea-1216-46fe-963c-726ba5b20e45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:04.278010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:04.278909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:04.279737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 170/341] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:25:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:04.287703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9092ea-1216-46fe-963c-726ba5b20e45 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:04.350556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada97f94-206c-4b59-b1d4-6916c07eaa74 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:04.397012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27834bcd-4d52-4743-8d41-b9f735c07756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:04.398005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27834bcd-4d52-4743-8d41-b9f735c07756 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:04.398520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27834bcd-4d52-4743-8d41-b9f735c07756 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:04.399000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27834bcd-4d52-4743-8d41-b9f735c07756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:04.450148 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:04.489300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27834bcd-4d52-4743-8d41-b9f735c07756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:04.491327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27834bcd-4d52-4743-8d41-b9f735c07756 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:04.526395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9092ea-1216-46fe-963c-726ba5b20e45 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:04.557746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:04.605126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279605d-c2af-41b6-bb67-ea7309953131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:04.605686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279605d-c2af-41b6-bb67-ea7309953131 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:04.605940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279605d-c2af-41b6-bb67-ea7309953131 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:04.606212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279605d-c2af-41b6-bb67-ea7309953131 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:04.606888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279605d-c2af-41b6-bb67-ea7309953131 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:04.607189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279605d-c2af-41b6-bb67-ea7309953131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:04.608648 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279605d-c2af-41b6-bb67-ea7309953131 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:04.617705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 172/342] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:04.619297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda2f5a-e94f-42ae-baf2-a19df0b2a498 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:04.620177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda2f5a-e94f-42ae-baf2-a19df0b2a498 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:04.620978 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda2f5a-e94f-42ae-baf2-a19df0b2a498 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:04.627797 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 173/343] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:04.627960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 171/344] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:04.628382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279605d-c2af-41b6-bb67-ea7309953131 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:04.632519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda2f5a-e94f-42ae-baf2-a19df0b2a498 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:04.746516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279605d-c2af-41b6-bb67-ea7309953131 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:04.753255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda2f5a-e94f-42ae-baf2-a19df0b2a498 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:04.785707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:04.790064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955647d-fd42-42e6-8e22-af4928822b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:04.791822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955647d-fd42-42e6-8e22-af4928822b57 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:04.791822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955647d-fd42-42e6-8e22-af4928822b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:04.792457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955647d-fd42-42e6-8e22-af4928822b57 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:04.793811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955647d-fd42-42e6-8e22-af4928822b57 None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:04.795499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955647d-fd42-42e6-8e22-af4928822b57 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:04.797684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a56b0-e23f-492f-8c1f-718df77f703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:04.798293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a56b0-e23f-492f-8c1f-718df77f703e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:04.798571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a56b0-e23f-492f-8c1f-718df77f703e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:04.798842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a56b0-e23f-492f-8c1f-718df77f703e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:04.799871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 172/345] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:04 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:04.801253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a9c63-4fb0-4f4a-8ec4-51a56ec35272 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:04.801728 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a9c63-4fb0-4f4a-8ec4-51a56ec35272 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:04.802364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a9c63-4fb0-4f4a-8ec4-51a56ec35272 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:04.803836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 173/346] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:04.808272 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e4ffd-d2c0-4c42-a882-9e000c829639 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:04.808805 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e4ffd-d2c0-4c42-a882-9e000c829639 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:04.809296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e4ffd-d2c0-4c42-a882-9e000c829639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:04.835410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:04.837537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b37e4ffd-d2c0-4c42-a882-9e000c829639 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:04.839121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b37e4ffd-d2c0-4c42-a882-9e000c829639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:04.900746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a56b0-e23f-492f-8c1f-718df77f703e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:04.902243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a56b0-e23f-492f-8c1f-718df77f703e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:04.939864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 174/347] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:04.941706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5b72c-5c6c-4233-9b76-653eec8ec31d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:04.942197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5b72c-5c6c-4233-9b76-653eec8ec31d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:04.942671 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5b72c-5c6c-4233-9b76-653eec8ec31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:04.972888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b5e5b72c-5c6c-4233-9b76-653eec8ec31d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:04.974478 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b5e5b72c-5c6c-4233-9b76-653eec8ec31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:05.034429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 174/348] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:05.035192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a56b0-e23f-492f-8c1f-718df77f703e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:05.083702 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 175/349] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:05.089325 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5b72c-5c6c-4233-9b76-653eec8ec31d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:05.104816 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:05.161453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a56b0-e23f-492f-8c1f-718df77f703e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:05.201943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:05.203281 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f15d39-3237-46e9-984c-91a1f29aab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:05.204026 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f15d39-3237-46e9-984c-91a1f29aab73 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:05.204305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f15d39-3237-46e9-984c-91a1f29aab73 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:05.204597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f15d39-3237-46e9-984c-91a1f29aab73 None admin] PATH_INFO: `/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:05.211965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f15d39-3237-46e9-984c-91a1f29aab73 None admin] RBAC: Authorizing `identity:get_group(group_id=9e27d3ac5cdd40c094de36ecf77e95f4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:05.213993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f15d39-3237-46e9-984c-91a1f29aab73 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:05.216154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 175/350] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:05 2022] GET /identity/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:05.222427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f15d39-3237-46e9-984c-91a1f29aab73 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:05.283602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5b72c-5c6c-4233-9b76-653eec8ec31d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:05.345525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f15d39-3237-46e9-984c-91a1f29aab73 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:05.365291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:05.368308 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb9fd7-b6e6-4827-8c25-3751d9a063c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:05.369089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb9fd7-b6e6-4827-8c25-3751d9a063c6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:05.370059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb9fd7-b6e6-4827-8c25-3751d9a063c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:05.370697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb9fd7-b6e6-4827-8c25-3751d9a063c6 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:05.376639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb9fd7-b6e6-4827-8c25-3751d9a063c6 None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:05.378152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb9fd7-b6e6-4827-8c25-3751d9a063c6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:05.380321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 176/351] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:05 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:05.387364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb9fd7-b6e6-4827-8c25-3751d9a063c6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:05.387597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c3482-625a-4b07-aaec-2bf848ad8765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:05.388482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3482-625a-4b07-aaec-2bf848ad8765 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:05.388902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3482-625a-4b07-aaec-2bf848ad8765 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:05.389377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3482-625a-4b07-aaec-2bf848ad8765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:05.390474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c3482-625a-4b07-aaec-2bf848ad8765 None admin] RBAC: Adding query filter params (group.id=9e27d3ac5cdd40c094de36ecf77e95f4, role.id=aa830dbb276f42eebec54786852e6f47, scope.project.id=640e6f0276c34a73896d6d942799e2d5) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:05.390926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c3482-625a-4b07-aaec-2bf848ad8765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:05.392908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c3482-625a-4b07-aaec-2bf848ad8765 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:05.408723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 176/352] 10.222.0.91 () {56 vars in 1376 bytes} [Wed Aug 24 10:25:05 2022] GET /identity/v3/role_assignments?group.id=9e27d3ac5cdd40c094de36ecf77e95f4&scope.project.id=640e6f0276c34a73896d6d942799e2d5&role.id=aa830dbb276f42eebec54786852e6f47 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:05.540673 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c3482-625a-4b07-aaec-2bf848ad8765 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:05.590576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb9fd7-b6e6-4827-8c25-3751d9a063c6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:05.656650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:05.686788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733024c8-b49a-41a4-b2f1-f785ffe6db9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:05.687602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733024c8-b49a-41a4-b2f1-f785ffe6db9b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:05.688051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733024c8-b49a-41a4-b2f1-f785ffe6db9b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:05.688378 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733024c8-b49a-41a4-b2f1-f785ffe6db9b None admin] PATH_INFO: `/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:05.692471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733024c8-b49a-41a4-b2f1-f785ffe6db9b None admin] RBAC: Authorizing `identity:get_group(group_id=9e27d3ac5cdd40c094de36ecf77e95f4)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:05.694052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733024c8-b49a-41a4-b2f1-f785ffe6db9b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:05.695892 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 177/353] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:05 2022] GET /identity/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4 => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:05.698722 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47c0a4-ce11-4d1f-8554-42f0ce424747 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:05.699067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47c0a4-ce11-4d1f-8554-42f0ce424747 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:05.699431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47c0a4-ce11-4d1f-8554-42f0ce424747 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:05.706888 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c3482-625a-4b07-aaec-2bf848ad8765 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:05.708689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 178/354] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:05.710104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47c0a4-ce11-4d1f-8554-42f0ce424747 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:05.758691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7a864-3be6-4ca7-924d-db66b2cf1dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:05.759334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7a864-3be6-4ca7-924d-db66b2cf1dad None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:05.759608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7a864-3be6-4ca7-924d-db66b2cf1dad None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:05.759919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7a864-3be6-4ca7-924d-db66b2cf1dad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:05.776050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7a864-3be6-4ca7-924d-db66b2cf1dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2ff7a864-3be6-4ca7-924d-db66b2cf1dad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:05.783203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:05.784168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 177/355] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:05.784986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7a864-3be6-4ca7-924d-db66b2cf1dad None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:05.842777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:05.879926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47c0a4-ce11-4d1f-8554-42f0ce424747 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:05.931120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a49de1-d3c2-4fbb-90bf-4c628ecc1f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:05.931676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a49de1-d3c2-4fbb-90bf-4c628ecc1f44 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:05.932613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a49de1-d3c2-4fbb-90bf-4c628ecc1f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:05.933078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a49de1-d3c2-4fbb-90bf-4c628ecc1f44 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:05.940315 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7a864-3be6-4ca7-924d-db66b2cf1dad None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:05.950966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a49de1-d3c2-4fbb-90bf-4c628ecc1f44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-39a49de1-d3c2-4fbb-90bf-4c628ecc1f44 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:05.956641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:05.957551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:05.958354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:05.958354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:05.958354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:05.958354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:05.958354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:05.958354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:05.958354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:05.958354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:05.958354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:05.958354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:05.958354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:25:05.958354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:05.960794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 179/356] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:05.962405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce08bc-e7e6-4f70-a56e-92a5b56cc3ad None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:05.962969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce08bc-e7e6-4f70-a56e-92a5b56cc3ad None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:05.963512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce08bc-e7e6-4f70-a56e-92a5b56cc3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:05.985404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-26ce08bc-e7e6-4f70-a56e-92a5b56cc3ad None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:05.986622 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-26ce08bc-e7e6-4f70-a56e-92a5b56cc3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:05.999251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a79f2-056f-4885-8e1f-5a06603b790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:05.999903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a79f2-056f-4885-8e1f-5a06603b790a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:06.000217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a79f2-056f-4885-8e1f-5a06603b790a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:06.000494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a79f2-056f-4885-8e1f-5a06603b790a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:06.001237 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a79f2-056f-4885-8e1f-5a06603b790a None admin] RBAC: Adding query filter params (group.id=9e27d3ac5cdd40c094de36ecf77e95f4, role.id=2d3147d5707740a9995645aee5e671b3, scope.project.id=640e6f0276c34a73896d6d942799e2d5) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:06.001575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a79f2-056f-4885-8e1f-5a06603b790a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:06.003083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a79f2-056f-4885-8e1f-5a06603b790a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:06.009843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 178/357] 10.222.0.91 () {56 vars in 1376 bytes} [Wed Aug 24 10:25:05 2022] GET /identity/v3/role_assignments?group.id=9e27d3ac5cdd40c094de36ecf77e95f4&scope.project.id=640e6f0276c34a73896d6d942799e2d5&role.id=2d3147d5707740a9995645aee5e671b3 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:06.012247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a79f2-056f-4885-8e1f-5a06603b790a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:06.072230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:06.101644 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 180/358] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:06.103197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769761e-171f-4859-bff3-6f0815f58369 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:06.105580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769761e-171f-4859-bff3-6f0815f58369 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:06.106157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769761e-171f-4859-bff3-6f0815f58369 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:06.108388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 181/359] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:06.109352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769761e-171f-4859-bff3-6f0815f58369 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:06.219344 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a79f2-056f-4885-8e1f-5a06603b790a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:06.231563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:06.266140 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769761e-171f-4859-bff3-6f0815f58369 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:06.316507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf183ad9-c72f-4b21-bfba-e89860990418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:06.317130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf183ad9-c72f-4b21-bfba-e89860990418 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:06.317408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf183ad9-c72f-4b21-bfba-e89860990418 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:06.317674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf183ad9-c72f-4b21-bfba-e89860990418 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:06.318472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf183ad9-c72f-4b21-bfba-e89860990418 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:06.318865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf183ad9-c72f-4b21-bfba-e89860990418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:06.320382 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf183ad9-c72f-4b21-bfba-e89860990418 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:06.321512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f47d-fd15-4835-8923-dd17e11df2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:06.324291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f47d-fd15-4835-8923-dd17e11df2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:06.324750 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f47d-fd15-4835-8923-dd17e11df2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:06.325184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f47d-fd15-4835-8923-dd17e11df2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:06.326056 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602f47d-fd15-4835-8923-dd17e11df2b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:06.326497 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602f47d-fd15-4835-8923-dd17e11df2b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:06.328803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602f47d-fd15-4835-8923-dd17e11df2b2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:06.338664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 179/360] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:06.338664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f0096-2f85-4e77-86bc-fe6e6c3c8e5d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:06.338664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f0096-2f85-4e77-86bc-fe6e6c3c8e5d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:06.338664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f0096-2f85-4e77-86bc-fe6e6c3c8e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:06.343867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 182/361] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:25:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:06.346674 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f47d-fd15-4835-8923-dd17e11df2b2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:06.384125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fe4f0096-2f85-4e77-86bc-fe6e6c3c8e5d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:06.385331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fe4f0096-2f85-4e77-86bc-fe6e6c3c8e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:06.408826 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:06.468605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f47d-fd15-4835-8923-dd17e11df2b2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:06.520873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab4e7-0d73-4f8a-a3d8-375093b03a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:06.522353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab4e7-0d73-4f8a-a3d8-375093b03a19 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:06.524259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 180/362] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:06.524701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab4e7-0d73-4f8a-a3d8-375093b03a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:06.525115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab4e7-0d73-4f8a-a3d8-375093b03a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:06.527689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f0096-2f85-4e77-86bc-fe6e6c3c8e5d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:06.639837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ab4e7-0d73-4f8a-a3d8-375093b03a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:06.641621 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ab4e7-0d73-4f8a-a3d8-375093b03a19 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:06.665334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:06.670016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f0096-2f85-4e77-86bc-fe6e6c3c8e5d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:06.705825 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:06.707534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5bc45-f842-408f-9793-a657833268b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:06.708220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5bc45-f842-408f-9793-a657833268b2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:06.708536 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5bc45-f842-408f-9793-a657833268b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:06.708773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5bc45-f842-408f-9793-a657833268b2 None admin] PATH_INFO: `/v3/users/91bc90bf6469492fb924c113ebf0bb76` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:06.709988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5bc45-f842-408f-9793-a657833268b2 None admin] RBAC: Authorizing `identity:get_user(user_id=91bc90bf6469492fb924c113ebf0bb76)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:06.711798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5bc45-f842-408f-9793-a657833268b2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:06.717339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 181/363] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:25:06 2022] GET /identity/v3/users/91bc90bf6469492fb924c113ebf0bb76 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:06.717339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5bc45-f842-408f-9793-a657833268b2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:06.773547 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 183/364] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:06.774622 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab4e7-0d73-4f8a-a3d8-375093b03a19 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:06.828608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5bc45-f842-408f-9793-a657833268b2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:06.866238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5250e-3a96-4a53-bc1a-a45bf042dca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:06.866878 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5250e-3a96-4a53-bc1a-a45bf042dca6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:06.867162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5250e-3a96-4a53-bc1a-a45bf042dca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:06.867436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5250e-3a96-4a53-bc1a-a45bf042dca6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:06.882387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5250e-3a96-4a53-bc1a-a45bf042dca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-afa5250e-3a96-4a53-bc1a-a45bf042dca6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:06.888750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:06.889891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:06.890805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 182/365] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:06.891490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5250e-3a96-4a53-bc1a-a45bf042dca6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:06.906372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab4e7-0d73-4f8a-a3d8-375093b03a19 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:06.932133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:06.958929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca7138-52d8-4bce-878f-fcf089a94c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:06.959821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca7138-52d8-4bce-878f-fcf089a94c2a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:06.960243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca7138-52d8-4bce-878f-fcf089a94c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:06.960685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca7138-52d8-4bce-878f-fcf089a94c2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:06.961633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca7138-52d8-4bce-878f-fcf089a94c2a None admin] RBAC: Adding query filter params (role.id=d9779f8bf7d746acbd4f8eb816c8e589, user.id=91bc90bf6469492fb924c113ebf0bb76, scope.system=all) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:06.962200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca7138-52d8-4bce-878f-fcf089a94c2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:06.964966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca7138-52d8-4bce-878f-fcf089a94c2a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:06.980865 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 184/366] 10.222.0.91 () {56 vars in 1308 bytes} [Wed Aug 24 10:25:06 2022] GET /identity/v3/role_assignments?user.id=91bc90bf6469492fb924c113ebf0bb76&scope.system=all&role.id=d9779f8bf7d746acbd4f8eb816c8e589 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:06.981977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca7138-52d8-4bce-878f-fcf089a94c2a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:06.990646 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:07.023699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5250e-3a96-4a53-bc1a-a45bf042dca6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:07.077619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907d9c1-deb9-403e-9ad3-43177c2cc028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:07.078269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907d9c1-deb9-403e-9ad3-43177c2cc028 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:07.078546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907d9c1-deb9-403e-9ad3-43177c2cc028 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:07.078815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907d9c1-deb9-403e-9ad3-43177c2cc028 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:07.080152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907d9c1-deb9-403e-9ad3-43177c2cc028 None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:07.081910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907d9c1-deb9-403e-9ad3-43177c2cc028 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:07.084434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 183/367] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:06 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:07.091525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907d9c1-deb9-403e-9ad3-43177c2cc028 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:07.177919 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca7138-52d8-4bce-878f-fcf089a94c2a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:07.219646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:07.228143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907d9c1-deb9-403e-9ad3-43177c2cc028 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:07.273785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a953928-4230-4a73-be87-56b1b044f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:07.274724 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a953928-4230-4a73-be87-56b1b044f171 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:07.275139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a953928-4230-4a73-be87-56b1b044f171 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:07.276125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a953928-4230-4a73-be87-56b1b044f171 None admin] PATH_INFO: `/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:07.277803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a953928-4230-4a73-be87-56b1b044f171 None admin] RBAC: Authorizing `identity:get_group(group_id=9e27d3ac5cdd40c094de36ecf77e95f4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:07.279498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a953928-4230-4a73-be87-56b1b044f171 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:07.281634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 184/368] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:07 2022] GET /identity/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:07.282532 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a953928-4230-4a73-be87-56b1b044f171 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:07.296527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60d07d-d7be-4e3c-a7b9-2aefceba753f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:07.297163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60d07d-d7be-4e3c-a7b9-2aefceba753f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:07.298231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60d07d-d7be-4e3c-a7b9-2aefceba753f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:07.298231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60d07d-d7be-4e3c-a7b9-2aefceba753f None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:07.298415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60d07d-d7be-4e3c-a7b9-2aefceba753f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:07.298688 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60d07d-d7be-4e3c-a7b9-2aefceba753f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:07.300100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60d07d-d7be-4e3c-a7b9-2aefceba753f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:07.309919 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 185/369] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:07.311323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60d07d-d7be-4e3c-a7b9-2aefceba753f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:07.413392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:07.450173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a953928-4230-4a73-be87-56b1b044f171 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:07.455742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60d07d-d7be-4e3c-a7b9-2aefceba753f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:07.491121 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edae78-aa8c-41e1-8c5a-9454bfb07dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:07.491804 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edae78-aa8c-41e1-8c5a-9454bfb07dbe None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:07.492087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edae78-aa8c-41e1-8c5a-9454bfb07dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:07.492360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edae78-aa8c-41e1-8c5a-9454bfb07dbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:07.496391 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b32417-05da-42cc-8602-45855e36a10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:07.497011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b32417-05da-42cc-8602-45855e36a10f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:07.497291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b32417-05da-42cc-8602-45855e36a10f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:07.497566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b32417-05da-42cc-8602-45855e36a10f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:07.498305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b32417-05da-42cc-8602-45855e36a10f None admin] RBAC: Adding query filter params (group.id=9e27d3ac5cdd40c094de36ecf77e95f4, role.id=aa830dbb276f42eebec54786852e6f47, scope.project.id=5feb6abf7be947c9b5eef75d51387fcf) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:07.498617 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b32417-05da-42cc-8602-45855e36a10f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:07.500472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b32417-05da-42cc-8602-45855e36a10f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:07.505979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edae78-aa8c-41e1-8c5a-9454bfb07dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:07.506822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 186/370] 10.222.0.91 () {56 vars in 1376 bytes} [Wed Aug 24 10:25:07 2022] GET /identity/v3/role_assignments?group.id=9e27d3ac5cdd40c094de36ecf77e95f4&scope.project.id=5feb6abf7be947c9b5eef75d51387fcf&role.id=aa830dbb276f42eebec54786852e6f47 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:07.507701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b32417-05da-42cc-8602-45855e36a10f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-01edae78-aa8c-41e1-8c5a-9454bfb07dbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:07.511623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:07.512637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:07.513423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 185/371] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:07.519268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edae78-aa8c-41e1-8c5a-9454bfb07dbe None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:07.551101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:07.626574 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b32417-05da-42cc-8602-45855e36a10f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:07.643431 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edae78-aa8c-41e1-8c5a-9454bfb07dbe None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:07.665333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:07.671812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222a9c2-8fae-4ec6-9706-1895af551e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:07.672423 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222a9c2-8fae-4ec6-9706-1895af551e4e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:07.672816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222a9c2-8fae-4ec6-9706-1895af551e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:07.673095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222a9c2-8fae-4ec6-9706-1895af551e4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:07.685504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97977ec1-8d10-44db-813f-82aa7bad1753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:07.686127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97977ec1-8d10-44db-813f-82aa7bad1753 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:07.686410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97977ec1-8d10-44db-813f-82aa7bad1753 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:07.686681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97977ec1-8d10-44db-813f-82aa7bad1753 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:07.687362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97977ec1-8d10-44db-813f-82aa7bad1753 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:07.689656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97977ec1-8d10-44db-813f-82aa7bad1753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:07.689656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97977ec1-8d10-44db-813f-82aa7bad1753 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:07.701022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 186/372] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:07.708218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97977ec1-8d10-44db-813f-82aa7bad1753 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:07.756229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222a9c2-8fae-4ec6-9706-1895af551e4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:07.757870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222a9c2-8fae-4ec6-9706-1895af551e4e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:07.816116 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:07.846892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97977ec1-8d10-44db-813f-82aa7bad1753 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:07.890373 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc32b-f519-478c-9174-900969e47b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:07.891090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc32b-f519-478c-9174-900969e47b0c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:07.891370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc32b-f519-478c-9174-900969e47b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:07.891642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc32b-f519-478c-9174-900969e47b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:07.900138 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 187/373] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:07.901911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16583200-d93b-410b-b961-b498365ce7e3 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:07.902190 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16583200-d93b-410b-b961-b498365ce7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:07.902464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16583200-d93b-410b-b961-b498365ce7e3 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:07.904666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 188/374] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:07.908676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16583200-d93b-410b-b961-b498365ce7e3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:07.964481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:07.987294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dc32b-f519-478c-9174-900969e47b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:07.988807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dc32b-f519-478c-9174-900969e47b0c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:08.060679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16583200-d93b-410b-b961-b498365ce7e3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:08.079963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:08.097130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 187/375] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:25:08.098518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e124-9c3e-47b3-a4db-5e67b45e4032 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:08.098806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e124-9c3e-47b3-a4db-5e67b45e4032 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:08.099076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926e124-9c3e-47b3-a4db-5e67b45e4032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:08.125060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7926e124-9c3e-47b3-a4db-5e67b45e4032 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:08.126271 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7926e124-9c3e-47b3-a4db-5e67b45e4032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:08.139372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4877159-c505-465a-97af-3df2f6805c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:08.140133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4877159-c505-465a-97af-3df2f6805c4d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:08.140421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4877159-c505-465a-97af-3df2f6805c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:08.140743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4877159-c505-465a-97af-3df2f6805c4d None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:08.141983 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4877159-c505-465a-97af-3df2f6805c4d None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:08.143487 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4877159-c505-465a-97af-3df2f6805c4d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:08.145331 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 189/376] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:07 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:08.146432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4877159-c505-465a-97af-3df2f6805c4d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:08.235508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 188/377] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:08.237148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926e124-9c3e-47b3-a4db-5e67b45e4032 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:08.286752 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:08.290745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4877159-c505-465a-97af-3df2f6805c4d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:08.332924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31025c-d44b-4ae6-b4b4-cdbb9811bb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:08.333478 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31025c-d44b-4ae6-b4b4-cdbb9811bb59 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:08.333752 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31025c-d44b-4ae6-b4b4-cdbb9811bb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:08.334016 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31025c-d44b-4ae6-b4b4-cdbb9811bb59 None admin] PATH_INFO: `/v3/projects/8164e47598a34978921b5d7bbf1d90ac` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:08.335223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31025c-d44b-4ae6-b4b4-cdbb9811bb59 None admin] RBAC: Authorizing `identity:get_project(project_id=8164e47598a34978921b5d7bbf1d90ac)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:08.336906 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31025c-d44b-4ae6-b4b4-cdbb9811bb59 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:08.339119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 190/378] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:08 2022] GET /identity/v3/projects/8164e47598a34978921b5d7bbf1d90ac => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:08.345059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31025c-d44b-4ae6-b4b4-cdbb9811bb59 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:08.355610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926e124-9c3e-47b3-a4db-5e67b45e4032 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:08.374093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:08.406374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af343d59-3593-4503-ac72-9408cb6f0100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:08.407114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af343d59-3593-4503-ac72-9408cb6f0100 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:08.407396 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af343d59-3593-4503-ac72-9408cb6f0100 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:08.407667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af343d59-3593-4503-ac72-9408cb6f0100 None admin] PATH_INFO: `/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:08.408851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af343d59-3593-4503-ac72-9408cb6f0100 None admin] RBAC: Authorizing `identity:get_group(group_id=9e27d3ac5cdd40c094de36ecf77e95f4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:08.410526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af343d59-3593-4503-ac72-9408cb6f0100 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:08.412487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 189/379] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:08 2022] GET /identity/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:08.420891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af343d59-3593-4503-ac72-9408cb6f0100 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:08.469685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31025c-d44b-4ae6-b4b4-cdbb9811bb59 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:08.512738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b231b-47ed-4920-bd79-4cd88127147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:08.513471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b231b-47ed-4920-bd79-4cd88127147e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:08.513750 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b231b-47ed-4920-bd79-4cd88127147e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:08.514018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b231b-47ed-4920-bd79-4cd88127147e None admin] PATH_INFO: `/v3/groups/fe2e89a4233a4cbd80d31a2af89a258f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:08.524474 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b231b-47ed-4920-bd79-4cd88127147e None admin] RBAC: Authorizing `identity:get_group(group_id=fe2e89a4233a4cbd80d31a2af89a258f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:08.526677 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b231b-47ed-4920-bd79-4cd88127147e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:08.532107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 191/380] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:08 2022] GET /identity/v3/groups/fe2e89a4233a4cbd80d31a2af89a258f => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:08.534770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b231b-47ed-4920-bd79-4cd88127147e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:08.558394 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af343d59-3593-4503-ac72-9408cb6f0100 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:08.601848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:08.618554 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5c061-3d94-43ca-955b-a0be6fd6c8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:08.619493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5c061-3d94-43ca-955b-a0be6fd6c8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:08.619493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5c061-3d94-43ca-955b-a0be6fd6c8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:08.625179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5c061-3d94-43ca-955b-a0be6fd6c8a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:08.625179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5c061-3d94-43ca-955b-a0be6fd6c8a0 None admin] RBAC: Adding query filter params (group.id=9e27d3ac5cdd40c094de36ecf77e95f4, role.id=2d3147d5707740a9995645aee5e671b3, scope.project.id=5feb6abf7be947c9b5eef75d51387fcf) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:08.625179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5c061-3d94-43ca-955b-a0be6fd6c8a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:08.625179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5c061-3d94-43ca-955b-a0be6fd6c8a0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:08.637293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 190/381] 10.222.0.91 () {56 vars in 1376 bytes} [Wed Aug 24 10:25:08 2022] GET /identity/v3/role_assignments?group.id=9e27d3ac5cdd40c094de36ecf77e95f4&scope.project.id=5feb6abf7be947c9b5eef75d51387fcf&role.id=2d3147d5707740a9995645aee5e671b3 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:08.667781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b231b-47ed-4920-bd79-4cd88127147e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:08.683514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5c061-3d94-43ca-955b-a0be6fd6c8a0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:08.715355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31a7d5-4319-42a0-8f64-4438dbbe9c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:08.716041 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31a7d5-4319-42a0-8f64-4438dbbe9c94 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:08.716319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31a7d5-4319-42a0-8f64-4438dbbe9c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:08.716591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31a7d5-4319-42a0-8f64-4438dbbe9c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:08.717447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31a7d5-4319-42a0-8f64-4438dbbe9c94 None admin] RBAC: Adding query filter params (group.id=fe2e89a4233a4cbd80d31a2af89a258f, role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=8164e47598a34978921b5d7bbf1d90ac) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:08.717758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31a7d5-4319-42a0-8f64-4438dbbe9c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:08.719452 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31a7d5-4319-42a0-8f64-4438dbbe9c94 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:08.727908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 192/382] 10.222.0.91 () {56 vars in 1376 bytes} [Wed Aug 24 10:25:08 2022] GET /identity/v3/role_assignments?group.id=fe2e89a4233a4cbd80d31a2af89a258f&scope.project.id=8164e47598a34978921b5d7bbf1d90ac&role.id=60abeefc9ac84e31a0162ac559220669 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:08.746814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:08.823813 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5c061-3d94-43ca-955b-a0be6fd6c8a0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:08.866308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d72d1c-ef31-4ea3-a0b5-d99e4b1f68af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:08.866879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d72d1c-ef31-4ea3-a0b5-d99e4b1f68af None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:08.867155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d72d1c-ef31-4ea3-a0b5-d99e4b1f68af None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:08.867428 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d72d1c-ef31-4ea3-a0b5-d99e4b1f68af None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:08.881412 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d72d1c-ef31-4ea3-a0b5-d99e4b1f68af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-69d72d1c-ef31-4ea3-a0b5-d99e4b1f68af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:08.887402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:08.889689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:08.891573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 191/383] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:08.897239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31a7d5-4319-42a0-8f64-4438dbbe9c94 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:09.018864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31a7d5-4319-42a0-8f64-4438dbbe9c94 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:09.020533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:09.060394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0458c1-160a-4d92-8edc-e9da887c7807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:09.061015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0458c1-160a-4d92-8edc-e9da887c7807 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:09.061292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0458c1-160a-4d92-8edc-e9da887c7807 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:09.061562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0458c1-160a-4d92-8edc-e9da887c7807 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:09.062350 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0458c1-160a-4d92-8edc-e9da887c7807 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:09.062652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0458c1-160a-4d92-8edc-e9da887c7807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:09.064379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0458c1-160a-4d92-8edc-e9da887c7807 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:09.074638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 193/384] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:25:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:09.079936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d72d1c-ef31-4ea3-a0b5-d99e4b1f68af None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:09.204807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d72d1c-ef31-4ea3-a0b5-d99e4b1f68af None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:09.213368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:09.246400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c1468-2954-4a5e-967a-6d0b172e7dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:09.247049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c1468-2954-4a5e-967a-6d0b172e7dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:09.247325 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c1468-2954-4a5e-967a-6d0b172e7dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:09.247665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c1468-2954-4a5e-967a-6d0b172e7dc1 None admin] PATH_INFO: `/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:09.248969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c1468-2954-4a5e-967a-6d0b172e7dc1 None admin] RBAC: Authorizing `identity:get_group(group_id=9e27d3ac5cdd40c094de36ecf77e95f4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:09.250573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c1468-2954-4a5e-967a-6d0b172e7dc1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:09.252678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 192/385] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:09 2022] GET /identity/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:09.257963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0458c1-160a-4d92-8edc-e9da887c7807 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:09.270833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ddbf0-1aa7-4905-a024-6eca324ee14c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:09.271433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ddbf0-1aa7-4905-a024-6eca324ee14c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:09.271632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ddbf0-1aa7-4905-a024-6eca324ee14c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:09.273154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 193/386] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:09.280682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a28c-1031-49bb-9720-5ddf5bbb15f3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:09.280990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a28c-1031-49bb-9720-5ddf5bbb15f3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:09.281216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a28c-1031-49bb-9720-5ddf5bbb15f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:09.324285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c289a28c-1031-49bb-9720-5ddf5bbb15f3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:09.325593 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c289a28c-1031-49bb-9720-5ddf5bbb15f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:09.415443 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0458c1-160a-4d92-8edc-e9da887c7807 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:09.435705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 194/387] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:09.463961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e40568-148e-4ec5-9e9e-7e3a23071a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:09.464518 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e40568-148e-4ec5-9e9e-7e3a23071a1b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:09.464785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e40568-148e-4ec5-9e9e-7e3a23071a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:09.465057 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e40568-148e-4ec5-9e9e-7e3a23071a1b None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:09.466259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e40568-148e-4ec5-9e9e-7e3a23071a1b None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:09.467740 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e40568-148e-4ec5-9e9e-7e3a23071a1b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:09.473135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 194/388] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:09 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:09.477126 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289a28c-1031-49bb-9720-5ddf5bbb15f3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:09.617749 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289a28c-1031-49bb-9720-5ddf5bbb15f3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:09.620807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:09.665921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf58b2d-2120-4de3-a243-3e75acc42332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:09.667409 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf58b2d-2120-4de3-a243-3e75acc42332 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:09.667707 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf58b2d-2120-4de3-a243-3e75acc42332 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:09.668003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf58b2d-2120-4de3-a243-3e75acc42332 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5/groups/9e27d3ac5cdd40c094de36ecf77e95f4/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:09.672993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf58b2d-2120-4de3-a243-3e75acc42332 None admin] RBAC: Authorizing `identity:create_grant(project_id=640e6f0276c34a73896d6d942799e2d5, group_id=9e27d3ac5cdd40c094de36ecf77e95f4, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:09.674665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf58b2d-2120-4de3-a243-3e75acc42332 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:09.752748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 195/389] 10.222.0.91 () {58 vars in 1442 bytes} [Wed Aug 24 10:25:09 2022] PUT /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5/groups/9e27d3ac5cdd40c094de36ecf77e95f4/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:25:09.876603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e40568-148e-4ec5-9e9e-7e3a23071a1b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:09.912078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:10.008593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e40568-148e-4ec5-9e9e-7e3a23071a1b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:10.051211 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58153e0c-60a1-452c-8750-683340468511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:10.052257 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58153e0c-60a1-452c-8750-683340468511 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:10.052758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58153e0c-60a1-452c-8750-683340468511 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:10.053246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58153e0c-60a1-452c-8750-683340468511 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:10.067609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58153e0c-60a1-452c-8750-683340468511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-58153e0c-60a1-452c-8750-683340468511 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:10.073619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:10.074609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:10.075436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:10.075436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:10.075436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:10.075436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:10.075436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:10.075436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:10.075436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:10.075436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:10.075436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:10.075436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:10.075436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:10.075436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:10.078224 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 195/390] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:25:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:10.083951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf58b2d-2120-4de3-a243-3e75acc42332 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:10.199589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf58b2d-2120-4de3-a243-3e75acc42332 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:10.218857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75992521-dc32-41f4-b568-919c1c65c936 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:10.219511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75992521-dc32-41f4-b568-919c1c65c936 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:10.220004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75992521-dc32-41f4-b568-919c1c65c936 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:10.221563 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 196/391] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:25:10.227003 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d3753-f09c-47b6-a7a0-e10983cd3741 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:10.227283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d3753-f09c-47b6-a7a0-e10983cd3741 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:10.227564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d3753-f09c-47b6-a7a0-e10983cd3741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:10.247878 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d384b-ecad-4e69-820e-472c191255eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:10.248898 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d384b-ecad-4e69-820e-472c191255eb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:10.249382 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d384b-ecad-4e69-820e-472c191255eb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:10.249870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d384b-ecad-4e69-820e-472c191255eb None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:10.250736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d384b-ecad-4e69-820e-472c191255eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:10.251242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d384b-ecad-4e69-820e-472c191255eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:10.252866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d384b-ecad-4e69-820e-472c191255eb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:10.263854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 196/392] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:10.264835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d20d3753-f09c-47b6-a7a0-e10983cd3741 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:10.266000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d20d3753-f09c-47b6-a7a0-e10983cd3741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:10.271621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d384b-ecad-4e69-820e-472c191255eb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:10.315354 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:10.392851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 197/393] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:10.454234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d384b-ecad-4e69-820e-472c191255eb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:10.497091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2571ae-22ed-49b6-93f8-d2f4bd09e3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:10.497754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2571ae-22ed-49b6-93f8-d2f4bd09e3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:10.498041 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2571ae-22ed-49b6-93f8-d2f4bd09e3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:10.498300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2571ae-22ed-49b6-93f8-d2f4bd09e3f7 None admin] PATH_INFO: `/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:10.499490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2571ae-22ed-49b6-93f8-d2f4bd09e3f7 None admin] RBAC: Authorizing `identity:get_group(group_id=9e27d3ac5cdd40c094de36ecf77e95f4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:10.501034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2571ae-22ed-49b6-93f8-d2f4bd09e3f7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:10.503053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 197/394] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:10 2022] GET /identity/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:10.508674 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d3753-f09c-47b6-a7a0-e10983cd3741 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:10.526876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:10.635751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d3753-f09c-47b6-a7a0-e10983cd3741 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:10.678624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084080c-c29c-4d52-8a8e-83638547bf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:10.679272 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084080c-c29c-4d52-8a8e-83638547bf10 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:10.679553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084080c-c29c-4d52-8a8e-83638547bf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:10.679873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084080c-c29c-4d52-8a8e-83638547bf10 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:10.684472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084080c-c29c-4d52-8a8e-83638547bf10 None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:10.685931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084080c-c29c-4d52-8a8e-83638547bf10 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:10.687983 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 198/395] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:10 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:10.693488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2571ae-22ed-49b6-93f8-d2f4bd09e3f7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:10.731357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084080c-c29c-4d52-8a8e-83638547bf10 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:10.864806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:10.894932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084080c-c29c-4d52-8a8e-83638547bf10 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:10.900082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:10.908564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2571ae-22ed-49b6-93f8-d2f4bd09e3f7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:10.943045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac3b0e-e3c1-4515-b0f0-1b0ced552e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:10.943694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac3b0e-e3c1-4515-b0f0-1b0ced552e2f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:10.943996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac3b0e-e3c1-4515-b0f0-1b0ced552e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:10.944276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac3b0e-e3c1-4515-b0f0-1b0ced552e2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:10.954287 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce03a8f-5660-497c-8301-10e130b28d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:10.957358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce03a8f-5660-497c-8301-10e130b28d94 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:10.957859 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce03a8f-5660-497c-8301-10e130b28d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:10.958337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce03a8f-5660-497c-8301-10e130b28d94 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5/groups/9e27d3ac5cdd40c094de36ecf77e95f4/roles/2d3147d5707740a9995645aee5e671b3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:10.962188 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce03a8f-5660-497c-8301-10e130b28d94 None admin] RBAC: Authorizing `identity:create_grant(project_id=640e6f0276c34a73896d6d942799e2d5, group_id=9e27d3ac5cdd40c094de36ecf77e95f4, role_id=2d3147d5707740a9995645aee5e671b3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:10.965504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce03a8f-5660-497c-8301-10e130b28d94 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:10.973066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac3b0e-e3c1-4515-b0f0-1b0ced552e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-84ac3b0e-e3c1-4515-b0f0-1b0ced552e2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:10.980663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:10.981701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:10.982488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:10.982488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:10.982488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:10.982488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:10.982488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:10.982488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:10.982488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:10.982488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:10.982488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:10.982488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:10.982488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:10.982488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:10.985253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 199/396] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:10.990613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac3b0e-e3c1-4515-b0f0-1b0ced552e2f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:11.048655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 198/397] 10.222.0.91 () {58 vars in 1442 bytes} [Wed Aug 24 10:25:10 2022] PUT /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5/groups/9e27d3ac5cdd40c094de36ecf77e95f4/roles/2d3147d5707740a9995645aee5e671b3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:25:11.124556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac3b0e-e3c1-4515-b0f0-1b0ced552e2f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:11.181585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683208d1-76c7-4200-bb5e-e3c2af1adaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:11.183019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683208d1-76c7-4200-bb5e-e3c2af1adaaa None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:11.183702 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683208d1-76c7-4200-bb5e-e3c2af1adaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:11.184533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683208d1-76c7-4200-bb5e-e3c2af1adaaa None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:11.185545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683208d1-76c7-4200-bb5e-e3c2af1adaaa None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:11.186068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683208d1-76c7-4200-bb5e-e3c2af1adaaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:11.187738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683208d1-76c7-4200-bb5e-e3c2af1adaaa None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:11.198347 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 200/398] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:11.203545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce03a8f-5660-497c-8301-10e130b28d94 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:11.255993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eff97-98fc-47b1-9dbe-a1fbeacaba3a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:11.256634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eff97-98fc-47b1-9dbe-a1fbeacaba3a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:11.257106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eff97-98fc-47b1-9dbe-a1fbeacaba3a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:11.259022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 201/399] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:25:11.265653 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f4eef-ca09-4a73-bcf2-c5e6140742f7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:11.266321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f4eef-ca09-4a73-bcf2-c5e6140742f7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:11.266809 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f4eef-ca09-4a73-bcf2-c5e6140742f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:11.274889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:11.290036 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-386f4eef-ca09-4a73-bcf2-c5e6140742f7 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:11.292815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-386f4eef-ca09-4a73-bcf2-c5e6140742f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:11.356289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce03a8f-5660-497c-8301-10e130b28d94 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:11.400860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851bbc-6272-4f1b-895d-dce10672d8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:11.402092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851bbc-6272-4f1b-895d-dce10672d8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:11.403007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851bbc-6272-4f1b-895d-dce10672d8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:11.403676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851bbc-6272-4f1b-895d-dce10672d8a1 None admin] PATH_INFO: `/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:11.405829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9851bbc-6272-4f1b-895d-dce10672d8a1 None admin] RBAC: Authorizing `identity:get_group(group_id=9e27d3ac5cdd40c094de36ecf77e95f4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:11.407645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9851bbc-6272-4f1b-895d-dce10672d8a1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:11.409970 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 199/400] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:11 2022] GET /identity/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:11.414050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 202/401] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:25:11.417298 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851bbc-6272-4f1b-895d-dce10672d8a1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:11.461825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:11.528144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851bbc-6272-4f1b-895d-dce10672d8a1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:11.564857 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8e036-600b-4365-9a26-5afc930e2ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:11.565499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8e036-600b-4365-9a26-5afc930e2ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:11.565777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8e036-600b-4365-9a26-5afc930e2ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:11.566105 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8e036-600b-4365-9a26-5afc930e2ef3 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:11.567300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8e036-600b-4365-9a26-5afc930e2ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:11.568775 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8e036-600b-4365-9a26-5afc930e2ef3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:11.570637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 200/402] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:11 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:11.577195 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f4eef-ca09-4a73-bcf2-c5e6140742f7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:11.625011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c158fe5-d5d8-4e4c-a7f2-f90ed113b528 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:11.625365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c158fe5-d5d8-4e4c-a7f2-f90ed113b528 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:11.625558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c158fe5-d5d8-4e4c-a7f2-f90ed113b528 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:11.627075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 201/403] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:11.633254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6223b-a72c-46fd-934a-1898ed289de5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:11.633526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6223b-a72c-46fd-934a-1898ed289de5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:11.633799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6223b-a72c-46fd-934a-1898ed289de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:11.658230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-caa6223b-a72c-46fd-934a-1898ed289de5 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:11.659690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-caa6223b-a72c-46fd-934a-1898ed289de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:11.750730 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f4eef-ca09-4a73-bcf2-c5e6140742f7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:11.771846 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 202/404] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:11.774467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6223b-a72c-46fd-934a-1898ed289de5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:11.824335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b772229-5a0e-4614-a894-da041743605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:11.825097 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:11.825449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b772229-5a0e-4614-a894-da041743605f None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:11.825736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b772229-5a0e-4614-a894-da041743605f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:11.826033 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b772229-5a0e-4614-a894-da041743605f None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf/groups/9e27d3ac5cdd40c094de36ecf77e95f4/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:11.830042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b772229-5a0e-4614-a894-da041743605f None admin] RBAC: Authorizing `identity:create_grant(project_id=5feb6abf7be947c9b5eef75d51387fcf, group_id=9e27d3ac5cdd40c094de36ecf77e95f4, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:11.831509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b772229-5a0e-4614-a894-da041743605f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:11.839153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:11.927984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6223b-a72c-46fd-934a-1898ed289de5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:11.969547 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 203/405] 10.222.0.91 () {58 vars in 1442 bytes} [Wed Aug 24 10:25:11 2022] PUT /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf/groups/9e27d3ac5cdd40c094de36ecf77e95f4/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:25:11.980225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c88a04-32c3-465a-aefe-2248a859d4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:11.980881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c88a04-32c3-465a-aefe-2248a859d4bb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:11.981156 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c88a04-32c3-465a-aefe-2248a859d4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:11.981485 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c88a04-32c3-465a-aefe-2248a859d4bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:11.996118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c88a04-32c3-465a-aefe-2248a859d4bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-41c88a04-32c3-465a-aefe-2248a859d4bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:12.003302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:12.004295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:12.005599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 203/406] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:25:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:12.012300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b772229-5a0e-4614-a894-da041743605f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:12.096176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c88a04-32c3-465a-aefe-2248a859d4bb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:12.176293 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b772229-5a0e-4614-a894-da041743605f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:12.216465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267bfdc-beb2-4900-9ff0-9fd71158c504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:12.217476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267bfdc-beb2-4900-9ff0-9fd71158c504 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:12.218033 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267bfdc-beb2-4900-9ff0-9fd71158c504 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:12.218528 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267bfdc-beb2-4900-9ff0-9fd71158c504 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:12.219286 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267bfdc-beb2-4900-9ff0-9fd71158c504 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:12.219652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267bfdc-beb2-4900-9ff0-9fd71158c504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:12.221293 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267bfdc-beb2-4900-9ff0-9fd71158c504 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:12.223766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:12.231113 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 204/407] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:12.242218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267bfdc-beb2-4900-9ff0-9fd71158c504 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:12.255957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c88a04-32c3-465a-aefe-2248a859d4bb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:12.303510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686e62d-cfdb-47bd-9b89-d8e87d584f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:12.304556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686e62d-cfdb-47bd-9b89-d8e87d584f16 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:12.305053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686e62d-cfdb-47bd-9b89-d8e87d584f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:12.305533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686e62d-cfdb-47bd-9b89-d8e87d584f16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:12.321876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686e62d-cfdb-47bd-9b89-d8e87d584f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3686e62d-cfdb-47bd-9b89-d8e87d584f16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:12.327585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:12.328552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:12.329331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:12.329331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:12.329331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:12.329331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:12.329331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:12.329331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:12.329331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:12.329331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:12.329331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:12.329331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:12.329331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:12.329331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:12.331971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 204/408] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:12.337426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686e62d-cfdb-47bd-9b89-d8e87d584f16 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:12.365640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:12.466876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267bfdc-beb2-4900-9ff0-9fd71158c504 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:12.534741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686e62d-cfdb-47bd-9b89-d8e87d584f16 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:12.539458 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6962f2c-714b-4f65-bd30-ad7e30e2a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:12.540131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6962f2c-714b-4f65-bd30-ad7e30e2a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:12.540403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6962f2c-714b-4f65-bd30-ad7e30e2a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:12.540669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6962f2c-714b-4f65-bd30-ad7e30e2a7a5 None admin] PATH_INFO: `/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:12.542287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6962f2c-714b-4f65-bd30-ad7e30e2a7a5 None admin] RBAC: Authorizing `identity:get_group(group_id=9e27d3ac5cdd40c094de36ecf77e95f4)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:12.543807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6962f2c-714b-4f65-bd30-ad7e30e2a7a5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:12.545678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 205/409] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:12 2022] GET /identity/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4 => generated 226 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:12.551048 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6962f2c-714b-4f65-bd30-ad7e30e2a7a5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:12.605138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2dfed-3ba4-4355-ad93-bf0557440b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:12.605859 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2dfed-3ba4-4355-ad93-bf0557440b30 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:12.606144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2dfed-3ba4-4355-ad93-bf0557440b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:12.606419 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2dfed-3ba4-4355-ad93-bf0557440b30 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:12.607098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2dfed-3ba4-4355-ad93-bf0557440b30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:12.607409 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2dfed-3ba4-4355-ad93-bf0557440b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:12.608826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2dfed-3ba4-4355-ad93-bf0557440b30 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:12.627194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 205/410] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:12.632576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2dfed-3ba4-4355-ad93-bf0557440b30 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:12.638587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:12.663298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6962f2c-714b-4f65-bd30-ad7e30e2a7a5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:12.689673 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:12.701766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0e286-15cc-4a39-9e7d-a8a6c42eb5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:12.702471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0e286-15cc-4a39-9e7d-a8a6c42eb5fb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:12.702747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0e286-15cc-4a39-9e7d-a8a6c42eb5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:12.703017 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0e286-15cc-4a39-9e7d-a8a6c42eb5fb None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:12.704209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0e286-15cc-4a39-9e7d-a8a6c42eb5fb None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:12.705674 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0e286-15cc-4a39-9e7d-a8a6c42eb5fb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:12.707670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 206/411] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:12 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:12.713887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0e286-15cc-4a39-9e7d-a8a6c42eb5fb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:12.825535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0e286-15cc-4a39-9e7d-a8a6c42eb5fb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:12.863646 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d983174-60c5-4e42-a2b6-2f405fe19f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:12.864342 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d983174-60c5-4e42-a2b6-2f405fe19f95 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:12.864614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d983174-60c5-4e42-a2b6-2f405fe19f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:12.864884 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d983174-60c5-4e42-a2b6-2f405fe19f95 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf/groups/9e27d3ac5cdd40c094de36ecf77e95f4/roles/2d3147d5707740a9995645aee5e671b3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:12.865437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2dfed-3ba4-4355-ad93-bf0557440b30 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:12.868008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d983174-60c5-4e42-a2b6-2f405fe19f95 None admin] RBAC: Authorizing `identity:create_grant(project_id=5feb6abf7be947c9b5eef75d51387fcf, group_id=9e27d3ac5cdd40c094de36ecf77e95f4, role_id=2d3147d5707740a9995645aee5e671b3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:12.869930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d983174-60c5-4e42-a2b6-2f405fe19f95 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:12.903245 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e70e5-68c2-4776-b77d-cd8636146b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:12.904042 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e70e5-68c2-4776-b77d-cd8636146b55 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:12.904683 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e70e5-68c2-4776-b77d-cd8636146b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:12.904683 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e70e5-68c2-4776-b77d-cd8636146b55 None admin] PATH_INFO: `/v3/groups/fe2e89a4233a4cbd80d31a2af89a258f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:12.905986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e70e5-68c2-4776-b77d-cd8636146b55 None admin] RBAC: Authorizing `identity:get_group(group_id=fe2e89a4233a4cbd80d31a2af89a258f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:12.907445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e70e5-68c2-4776-b77d-cd8636146b55 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:12.913184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 206/412] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:12 2022] GET /identity/v3/groups/fe2e89a4233a4cbd80d31a2af89a258f => generated 229 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:12.913184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175802f6-eaec-4a50-a995-33c0f670cfcb None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:12.913184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175802f6-eaec-4a50-a995-33c0f670cfcb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:12.913184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175802f6-eaec-4a50-a995-33c0f670cfcb None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:12.915806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 207/413] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:12.917316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175802f6-eaec-4a50-a995-33c0f670cfcb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:13.003703 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:13.003936 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 207/414] 10.222.0.91 () {58 vars in 1442 bytes} [Wed Aug 24 10:25:12 2022] PUT /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf/groups/9e27d3ac5cdd40c094de36ecf77e95f4/roles/2d3147d5707740a9995645aee5e671b3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:25:13.005323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758f4fe-eb30-4727-bfa6-60c92101c27a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:13.005604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758f4fe-eb30-4727-bfa6-60c92101c27a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:13.005874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758f4fe-eb30-4727-bfa6-60c92101c27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:13.050154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175802f6-eaec-4a50-a995-33c0f670cfcb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:13.057067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b758f4fe-eb30-4727-bfa6-60c92101c27a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:13.058511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b758f4fe-eb30-4727-bfa6-60c92101c27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:13.096865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743ae03-a725-478e-8a5e-d7257e2bd747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:13.097895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743ae03-a725-478e-8a5e-d7257e2bd747 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:13.098402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743ae03-a725-478e-8a5e-d7257e2bd747 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:13.098852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743ae03-a725-478e-8a5e-d7257e2bd747 None admin] PATH_INFO: `/v3/projects/8164e47598a34978921b5d7bbf1d90ac` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:13.100315 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743ae03-a725-478e-8a5e-d7257e2bd747 None admin] RBAC: Authorizing `identity:get_project(project_id=8164e47598a34978921b5d7bbf1d90ac)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:13.102395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743ae03-a725-478e-8a5e-d7257e2bd747 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:13.105652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 208/415] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:12 2022] GET /identity/v3/projects/8164e47598a34978921b5d7bbf1d90ac => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:13.116939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743ae03-a725-478e-8a5e-d7257e2bd747 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:13.230081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:13.255780 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743ae03-a725-478e-8a5e-d7257e2bd747 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:13.263417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 208/416] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:13.298385 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441773a4-0e27-4968-a0af-0c32483a03ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:13.299237 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441773a4-0e27-4968-a0af-0c32483a03ef None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:13.299517 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441773a4-0e27-4968-a0af-0c32483a03ef None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:13.299990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441773a4-0e27-4968-a0af-0c32483a03ef None admin] PATH_INFO: `/v3/projects/8164e47598a34978921b5d7bbf1d90ac/groups/fe2e89a4233a4cbd80d31a2af89a258f/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:13.301961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441773a4-0e27-4968-a0af-0c32483a03ef None admin] RBAC: Authorizing `identity:create_grant(project_id=8164e47598a34978921b5d7bbf1d90ac, group_id=fe2e89a4233a4cbd80d31a2af89a258f, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:13.303421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441773a4-0e27-4968-a0af-0c32483a03ef None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:13.371266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:13.378217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 209/417] 10.222.0.91 () {58 vars in 1442 bytes} [Wed Aug 24 10:25:13 2022] PUT /identity/v3/projects/8164e47598a34978921b5d7bbf1d90ac/groups/fe2e89a4233a4cbd80d31a2af89a258f/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:25:13.680072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758f4fe-eb30-4727-bfa6-60c92101c27a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:13.784589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77624a-3d82-49fe-b990-a25345778fdc None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:13.785275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77624a-3d82-49fe-b990-a25345778fdc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:13.785777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77624a-3d82-49fe-b990-a25345778fdc None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:13.787746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 210/418] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:13.797183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e49944-5df3-43f6-9d4b-b45c68271b00 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:13.797793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e49944-5df3-43f6-9d4b-b45c68271b00 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:13.798288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e49944-5df3-43f6-9d4b-b45c68271b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:13.812446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758f4fe-eb30-4727-bfa6-60c92101c27a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:13.829127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-80e49944-5df3-43f6-9d4b-b45c68271b00 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:13.830758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-80e49944-5df3-43f6-9d4b-b45c68271b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:13.863743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdbf3a-d0b3-4ab4-a682-7c1b6697a86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:13.864393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdbf3a-d0b3-4ab4-a682-7c1b6697a86b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:13.864668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdbf3a-d0b3-4ab4-a682-7c1b6697a86b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:13.866433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdbf3a-d0b3-4ab4-a682-7c1b6697a86b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:13.890574 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdbf3a-d0b3-4ab4-a682-7c1b6697a86b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-75fdbf3a-d0b3-4ab4-a682-7c1b6697a86b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:13.902315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:13.903267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:13.904114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 209/419] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:13.910833 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdbf3a-d0b3-4ab4-a682-7c1b6697a86b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:13.983881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:14.002346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 211/420] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:25:14.069753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdbf3a-d0b3-4ab4-a682-7c1b6697a86b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:14.125226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f42d2-42f8-421e-9c5c-7fe7e5b9ff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:14.126723 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f42d2-42f8-421e-9c5c-7fe7e5b9ff12 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:14.127486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f42d2-42f8-421e-9c5c-7fe7e5b9ff12 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:14.128068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f42d2-42f8-421e-9c5c-7fe7e5b9ff12 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:14.128975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f42d2-42f8-421e-9c5c-7fe7e5b9ff12 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:14.129491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f42d2-42f8-421e-9c5c-7fe7e5b9ff12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:14.131110 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f42d2-42f8-421e-9c5c-7fe7e5b9ff12 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:14.148079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 210/421] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:25:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:14.154324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e49944-5df3-43f6-9d4b-b45c68271b00 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:14.280366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf96c1-93b0-4a11-9a93-0c79ee9a2b17 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:14.280658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf96c1-93b0-4a11-9a93-0c79ee9a2b17 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:14.280844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf96c1-93b0-4a11-9a93-0c79ee9a2b17 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:14.282501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 211/422] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:25:14.287846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80641b-2e29-42a0-bc84-433d5446f2f3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:14.288138 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80641b-2e29-42a0-bc84-433d5446f2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:14.288416 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80641b-2e29-42a0-bc84-433d5446f2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:14.308405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7b80641b-2e29-42a0-bc84-433d5446f2f3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:14.309621 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7b80641b-2e29-42a0-bc84-433d5446f2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:14.324699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e49944-5df3-43f6-9d4b-b45c68271b00 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:14.380115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:14.396418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532466f6-7b82-40c8-8cc6-749f8905edf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:14.397039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532466f6-7b82-40c8-8cc6-749f8905edf1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:14.405897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532466f6-7b82-40c8-8cc6-749f8905edf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:14.405897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532466f6-7b82-40c8-8cc6-749f8905edf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:14.431139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 212/423] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:25:14.433615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80641b-2e29-42a0-bc84-433d5446f2f3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:14.479438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:14.553858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532466f6-7b82-40c8-8cc6-749f8905edf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:14.555232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532466f6-7b82-40c8-8cc6-749f8905edf1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:14.563381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80641b-2e29-42a0-bc84-433d5446f2f3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:14.606274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b4cff-bb45-41f0-aecd-1c8ec578c718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:14.606920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b4cff-bb45-41f0-aecd-1c8ec578c718 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:14.607201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b4cff-bb45-41f0-aecd-1c8ec578c718 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:14.607473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b4cff-bb45-41f0-aecd-1c8ec578c718 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:14.622288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b4cff-bb45-41f0-aecd-1c8ec578c718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-8a2b4cff-bb45-41f0-aecd-1c8ec578c718 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:14.628213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:14.629130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:14.629929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 213/424] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:25:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:14.639323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b4cff-bb45-41f0-aecd-1c8ec578c718 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:14.790798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:14.800258 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b4cff-bb45-41f0-aecd-1c8ec578c718 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:14.811919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 212/425] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:14.813513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532466f6-7b82-40c8-8cc6-749f8905edf1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:14.847228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b745bb-bcb5-4e78-98da-40e84f012dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:14.847901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b745bb-bcb5-4e78-98da-40e84f012dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:14.848266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b745bb-bcb5-4e78-98da-40e84f012dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:14.848551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b745bb-bcb5-4e78-98da-40e84f012dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:14.849625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b745bb-bcb5-4e78-98da-40e84f012dd9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:14.849931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b745bb-bcb5-4e78-98da-40e84f012dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:14.852188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b745bb-bcb5-4e78-98da-40e84f012dd9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:14.863535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 214/426] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:14.866252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b745bb-bcb5-4e78-98da-40e84f012dd9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:14.884375 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:14.974824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532466f6-7b82-40c8-8cc6-749f8905edf1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:15.010817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b745bb-bcb5-4e78-98da-40e84f012dd9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:15.019095 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24279f9-eb6d-44a1-a808-8ddf0dc77c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:15.021140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24279f9-eb6d-44a1-a808-8ddf0dc77c98 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:15.021575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24279f9-eb6d-44a1-a808-8ddf0dc77c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:15.022010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24279f9-eb6d-44a1-a808-8ddf0dc77c98 None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:15.023781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24279f9-eb6d-44a1-a808-8ddf0dc77c98 None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:15.026282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24279f9-eb6d-44a1-a808-8ddf0dc77c98 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:15.030155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 213/427] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:14 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:15.031494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24279f9-eb6d-44a1-a808-8ddf0dc77c98 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:15.061591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462424e-f634-4e08-98c0-ae9988669f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:15.063226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462424e-f634-4e08-98c0-ae9988669f03 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:15.063737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462424e-f634-4e08-98c0-ae9988669f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:15.064273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462424e-f634-4e08-98c0-ae9988669f03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:15.084761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462424e-f634-4e08-98c0-ae9988669f03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-6462424e-f634-4e08-98c0-ae9988669f03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:15.092246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:15.093208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:15.094024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:15.094024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:15.094024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:15.094024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:15.094024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:15.094024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:15.094024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:15.094024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:15.094024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:15.094024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:15.094024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:25:15.094024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:15.098298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 215/428] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:15.098298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462424e-f634-4e08-98c0-ae9988669f03 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:15.129240 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:15.169202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:15.181026 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24279f9-eb6d-44a1-a808-8ddf0dc77c98 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:15.246933 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22eae2-e824-4d98-ac43-de162095ed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:15.248253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22eae2-e824-4d98-ac43-de162095ed15 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:15.249066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22eae2-e824-4d98-ac43-de162095ed15 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:15.249790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22eae2-e824-4d98-ac43-de162095ed15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:15.294706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462424e-f634-4e08-98c0-ae9988669f03 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:15.362255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd96f2-d4c5-48ba-b2bd-ad73536f2c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:15.363153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd96f2-d4c5-48ba-b2bd-ad73536f2c60 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:15.363613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd96f2-d4c5-48ba-b2bd-ad73536f2c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:15.364126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd96f2-d4c5-48ba-b2bd-ad73536f2c60 None admin] PATH_INFO: `/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:15.365911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd96f2-d4c5-48ba-b2bd-ad73536f2c60 None admin] RBAC: Authorizing `identity:get_group(group_id=9e27d3ac5cdd40c094de36ecf77e95f4)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:15.368307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd96f2-d4c5-48ba-b2bd-ad73536f2c60 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:15.375756 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 216/429] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:15 2022] GET /identity/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:15.375756 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd96f2-d4c5-48ba-b2bd-ad73536f2c60 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:15.380074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22eae2-e824-4d98-ac43-de162095ed15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:15.385625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22eae2-e824-4d98-ac43-de162095ed15 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:15.491302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:15.492131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:15.503679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 214/430] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:15.503679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bccc49-7f80-46ed-ba26-fa220ee3e285 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:15.503679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bccc49-7f80-46ed-ba26-fa220ee3e285 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:15.503679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bccc49-7f80-46ed-ba26-fa220ee3e285 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:15.506980 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 215/431] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:15.507777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bccc49-7f80-46ed-ba26-fa220ee3e285 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:15.513489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd96f2-d4c5-48ba-b2bd-ad73536f2c60 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:15.550626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91891a-668b-42f0-8ba8-16fb217da75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:15.551660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91891a-668b-42f0-8ba8-16fb217da75b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:15.551985 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91891a-668b-42f0-8ba8-16fb217da75b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:15.552267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91891a-668b-42f0-8ba8-16fb217da75b None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:15.553413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91891a-668b-42f0-8ba8-16fb217da75b None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:15.553694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91891a-668b-42f0-8ba8-16fb217da75b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:15.555449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91891a-668b-42f0-8ba8-16fb217da75b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:15.566329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 217/432] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:25:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:15.571397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91891a-668b-42f0-8ba8-16fb217da75b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:15.624217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bccc49-7f80-46ed-ba26-fa220ee3e285 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:15.669138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab2dc9-32b2-452d-9414-b21b2bbcf55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:15.670018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab2dc9-32b2-452d-9414-b21b2bbcf55b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:15.670018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab2dc9-32b2-452d-9414-b21b2bbcf55b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:15.670254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab2dc9-32b2-452d-9414-b21b2bbcf55b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:15.671012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab2dc9-32b2-452d-9414-b21b2bbcf55b None admin] RBAC: Adding query filter params (group.id=9e27d3ac5cdd40c094de36ecf77e95f4, role.id=aa830dbb276f42eebec54786852e6f47, scope.project.id=640e6f0276c34a73896d6d942799e2d5) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:15.671316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab2dc9-32b2-452d-9414-b21b2bbcf55b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:15.672868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab2dc9-32b2-452d-9414-b21b2bbcf55b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:15.679535 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 216/433] 10.222.0.91 () {56 vars in 1376 bytes} [Wed Aug 24 10:25:15 2022] GET /identity/v3/role_assignments?group.id=9e27d3ac5cdd40c094de36ecf77e95f4&scope.project.id=640e6f0276c34a73896d6d942799e2d5&role.id=aa830dbb276f42eebec54786852e6f47 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:15.680760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9b64c-c701-488e-99d9-5a0640900299 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:15.681041 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9b64c-c701-488e-99d9-5a0640900299 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:15.681312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9b64c-c701-488e-99d9-5a0640900299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:15.705189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-02d9b64c-c701-488e-99d9-5a0640900299 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:15.706758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-02d9b64c-c701-488e-99d9-5a0640900299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:15.715230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91891a-668b-42f0-8ba8-16fb217da75b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:15.770770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c96706-8991-454b-a8b6-f3eb97dfc22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:15.772119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c96706-8991-454b-a8b6-f3eb97dfc22b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:15.772402 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c96706-8991-454b-a8b6-f3eb97dfc22b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:15.772675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c96706-8991-454b-a8b6-f3eb97dfc22b None admin] PATH_INFO: `/v3/projects/640e6f0276c34a73896d6d942799e2d5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:15.774003 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c96706-8991-454b-a8b6-f3eb97dfc22b None admin] RBAC: Authorizing `identity:get_project(project_id=640e6f0276c34a73896d6d942799e2d5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:15.776687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c96706-8991-454b-a8b6-f3eb97dfc22b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:15.777983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:15.783249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 218/434] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:15 2022] GET /identity/v3/projects/640e6f0276c34a73896d6d942799e2d5 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:15.783249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c96706-8991-454b-a8b6-f3eb97dfc22b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:15.797247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 217/435] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:15.798610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060dbcd-9a29-4449-85a4-1242e971d6ad None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:15.801946 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060dbcd-9a29-4449-85a4-1242e971d6ad None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:15.801946 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060dbcd-9a29-4449-85a4-1242e971d6ad None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:15.801946 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 218/436] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:15.801946 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060dbcd-9a29-4449-85a4-1242e971d6ad None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:15.808691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:15.934616 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c96706-8991-454b-a8b6-f3eb97dfc22b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:15.954231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060dbcd-9a29-4449-85a4-1242e971d6ad None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:15.990655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eaf80-c838-436e-aeee-640c0306ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:15.991290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eaf80-c838-436e-aeee-640c0306ea6b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:15.991566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eaf80-c838-436e-aeee-640c0306ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:15.991920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eaf80-c838-436e-aeee-640c0306ea6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:16.004259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382308ee-4839-44d7-a0dd-6fd1e432f03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:16.004901 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382308ee-4839-44d7-a0dd-6fd1e432f03e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:16.005348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382308ee-4839-44d7-a0dd-6fd1e432f03e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:16.005815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382308ee-4839-44d7-a0dd-6fd1e432f03e None admin] PATH_INFO: `/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:16.007091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382308ee-4839-44d7-a0dd-6fd1e432f03e None admin] RBAC: Authorizing `identity:get_group(group_id=9e27d3ac5cdd40c094de36ecf77e95f4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:16.008589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382308ee-4839-44d7-a0dd-6fd1e432f03e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:16.010848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 219/437] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:15 2022] GET /identity/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:16.014207 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ce6c-15a1-43ae-b50c-36268c9301ae None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:16.014491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ce6c-15a1-43ae-b50c-36268c9301ae None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:16.014763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ce6c-15a1-43ae-b50c-36268c9301ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:16.034631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-74f4ce6c-15a1-43ae-b50c-36268c9301ae None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:16.036603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-74f4ce6c-15a1-43ae-b50c-36268c9301ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:16.092912 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eaf80-c838-436e-aeee-640c0306ea6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:16.095611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eaf80-c838-436e-aeee-640c0306ea6b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:16.106348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:16.115506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:16.125802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 220/438] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:16.126682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4ce6c-15a1-43ae-b50c-36268c9301ae None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:16.237696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 219/439] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:16.242703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eaf80-c838-436e-aeee-640c0306ea6b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:16.265437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4ce6c-15a1-43ae-b50c-36268c9301ae None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:16.307525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b0d18-4fd2-464a-b358-eb6a7e5412f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:16.308169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b0d18-4fd2-464a-b358-eb6a7e5412f1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:16.308488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b0d18-4fd2-464a-b358-eb6a7e5412f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:16.308716 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b0d18-4fd2-464a-b358-eb6a7e5412f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:16.309449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b0d18-4fd2-464a-b358-eb6a7e5412f1 None admin] RBAC: Adding query filter params (group.id=9e27d3ac5cdd40c094de36ecf77e95f4, role.id=2d3147d5707740a9995645aee5e671b3, scope.project.id=640e6f0276c34a73896d6d942799e2d5) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:16.309763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b0d18-4fd2-464a-b358-eb6a7e5412f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:16.311182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b0d18-4fd2-464a-b358-eb6a7e5412f1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:16.317313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 221/440] 10.222.0.91 () {56 vars in 1376 bytes} [Wed Aug 24 10:25:16 2022] GET /identity/v3/role_assignments?group.id=9e27d3ac5cdd40c094de36ecf77e95f4&scope.project.id=640e6f0276c34a73896d6d942799e2d5&role.id=2d3147d5707740a9995645aee5e671b3 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:16.318131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b0d18-4fd2-464a-b358-eb6a7e5412f1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:16.390424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eaf80-c838-436e-aeee-640c0306ea6b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:16.408374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:16.421456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:16.444057 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b1f48-4039-43f1-9095-d08b56346d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:16.444698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b1f48-4039-43f1-9095-d08b56346d8c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:16.444971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b1f48-4039-43f1-9095-d08b56346d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:16.445237 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b1f48-4039-43f1-9095-d08b56346d8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:16.456793 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b1f48-4039-43f1-9095-d08b56346d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c28b1f48-4039-43f1-9095-d08b56346d8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:16.461798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:16.463466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 220/441] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:25:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:16.468128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b1f48-4039-43f1-9095-d08b56346d8c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:16.483115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b0d18-4fd2-464a-b358-eb6a7e5412f1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:16.524954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf2750-e8fa-46fa-a9c9-2898d8d5ed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:16.526262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf2750-e8fa-46fa-a9c9-2898d8d5ed8d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:16.526374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf2750-e8fa-46fa-a9c9-2898d8d5ed8d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:16.526597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf2750-e8fa-46fa-a9c9-2898d8d5ed8d None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:16.527990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf2750-e8fa-46fa-a9c9-2898d8d5ed8d None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:16.529444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf2750-e8fa-46fa-a9c9-2898d8d5ed8d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:16.531088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 222/442] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:16 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:16.533315 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf2750-e8fa-46fa-a9c9-2898d8d5ed8d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:16.599140 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b1f48-4039-43f1-9095-d08b56346d8c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:16.647909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f422e-76b5-4532-bab4-8097ac98a99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:16.648552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f422e-76b5-4532-bab4-8097ac98a99f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:16.648826 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f422e-76b5-4532-bab4-8097ac98a99f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:16.649101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f422e-76b5-4532-bab4-8097ac98a99f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:16.662303 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf2750-e8fa-46fa-a9c9-2898d8d5ed8d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:16.667424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f422e-76b5-4532-bab4-8097ac98a99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f92f422e-76b5-4532-bab4-8097ac98a99f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:16.672758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:16.673877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 221/443] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:16.674882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f422e-76b5-4532-bab4-8097ac98a99f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:16.690302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:16.707986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fec2f-0b7d-4ff6-8427-75d2546cf728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:16.708600 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fec2f-0b7d-4ff6-8427-75d2546cf728 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:16.708880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fec2f-0b7d-4ff6-8427-75d2546cf728 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:16.709153 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fec2f-0b7d-4ff6-8427-75d2546cf728 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:16.709832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fec2f-0b7d-4ff6-8427-75d2546cf728 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:16.710134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fec2f-0b7d-4ff6-8427-75d2546cf728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:16.711559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fec2f-0b7d-4ff6-8427-75d2546cf728 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:16.714205 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:16.721477 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 223/444] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:16.722316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fec2f-0b7d-4ff6-8427-75d2546cf728 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:16.783178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f422e-76b5-4532-bab4-8097ac98a99f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:16.818820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9380f2-4573-4856-811a-0cfa56847a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:16.819624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9380f2-4573-4856-811a-0cfa56847a04 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:16.819773 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9380f2-4573-4856-811a-0cfa56847a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:16.823863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9380f2-4573-4856-811a-0cfa56847a04 None admin] PATH_INFO: `/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:16.823863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9380f2-4573-4856-811a-0cfa56847a04 None admin] RBAC: Authorizing `identity:get_group(group_id=9e27d3ac5cdd40c094de36ecf77e95f4)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:16.823863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9380f2-4573-4856-811a-0cfa56847a04 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:16.825352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 222/445] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:16 2022] GET /identity/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:16.826142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9380f2-4573-4856-811a-0cfa56847a04 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:16.831925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fec2f-0b7d-4ff6-8427-75d2546cf728 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:16.870486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dd010-5c1f-430b-8bbd-0368843ee8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:16.871089 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dd010-5c1f-430b-8bbd-0368843ee8de None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:16.871361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dd010-5c1f-430b-8bbd-0368843ee8de None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:16.871625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dd010-5c1f-430b-8bbd-0368843ee8de None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:16.872314 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dd010-5c1f-430b-8bbd-0368843ee8de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:16.872605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dd010-5c1f-430b-8bbd-0368843ee8de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:16.873984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dd010-5c1f-430b-8bbd-0368843ee8de None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:16.884035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 224/446] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:16.885467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dd010-5c1f-430b-8bbd-0368843ee8de None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:16.936643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:16.938301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9380f2-4573-4856-811a-0cfa56847a04 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:16.939894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:16.974686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321766-a2ff-4679-9bd8-2a87112e8a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:16.975281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321766-a2ff-4679-9bd8-2a87112e8a0b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:16.975554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321766-a2ff-4679-9bd8-2a87112e8a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:16.975853 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321766-a2ff-4679-9bd8-2a87112e8a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:16.998903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dd010-5c1f-430b-8bbd-0368843ee8de None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:17.034855 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117f750-a954-412e-a23e-aaec4be48389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:17.035900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117f750-a954-412e-a23e-aaec4be48389 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:17.036164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117f750-a954-412e-a23e-aaec4be48389 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:17.036526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117f750-a954-412e-a23e-aaec4be48389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:17.037346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117f750-a954-412e-a23e-aaec4be48389 None admin] RBAC: Adding query filter params (group.id=9e27d3ac5cdd40c094de36ecf77e95f4, role.id=aa830dbb276f42eebec54786852e6f47, scope.project.id=5feb6abf7be947c9b5eef75d51387fcf) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:17.037788 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117f750-a954-412e-a23e-aaec4be48389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:17.039379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117f750-a954-412e-a23e-aaec4be48389 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:17.045883 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 225/447] 10.222.0.91 () {56 vars in 1376 bytes} [Wed Aug 24 10:25:16 2022] GET /identity/v3/role_assignments?group.id=9e27d3ac5cdd40c094de36ecf77e95f4&scope.project.id=5feb6abf7be947c9b5eef75d51387fcf&role.id=aa830dbb276f42eebec54786852e6f47 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:17.046688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117f750-a954-412e-a23e-aaec4be48389 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:17.049642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321766-a2ff-4679-9bd8-2a87112e8a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:17.051120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321766-a2ff-4679-9bd8-2a87112e8a0b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:17.177046 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 223/448] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:17.179524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117f750-a954-412e-a23e-aaec4be48389 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:17.184550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321766-a2ff-4679-9bd8-2a87112e8a0b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:17.187095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:17.191071 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:17.229512 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8137da-3d19-434c-a1c4-c3779e95e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:17.231004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8137da-3d19-434c-a1c4-c3779e95e45d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:17.231282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8137da-3d19-434c-a1c4-c3779e95e45d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:17.231609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8137da-3d19-434c-a1c4-c3779e95e45d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:17.305512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321766-a2ff-4679-9bd8-2a87112e8a0b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:17.314887 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8137da-3d19-434c-a1c4-c3779e95e45d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:17.316483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8137da-3d19-434c-a1c4-c3779e95e45d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:17.359261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b204ec-9687-4545-9d8a-3a4fdc51cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:17.359939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b204ec-9687-4545-9d8a-3a4fdc51cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:17.360740 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b204ec-9687-4545-9d8a-3a4fdc51cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:17.360740 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b204ec-9687-4545-9d8a-3a4fdc51cfe9 None admin] PATH_INFO: `/v3/projects/5feb6abf7be947c9b5eef75d51387fcf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:17.363452 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b204ec-9687-4545-9d8a-3a4fdc51cfe9 None admin] RBAC: Authorizing `identity:get_project(project_id=5feb6abf7be947c9b5eef75d51387fcf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:17.363948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b204ec-9687-4545-9d8a-3a4fdc51cfe9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:17.365928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 224/449] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:17 2022] GET /identity/v3/projects/5feb6abf7be947c9b5eef75d51387fcf => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:17.373338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b204ec-9687-4545-9d8a-3a4fdc51cfe9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:17.441976 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 226/450] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:17.448115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8137da-3d19-434c-a1c4-c3779e95e45d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:17.453969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:17.457565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:17.486097 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b204ec-9687-4545-9d8a-3a4fdc51cfe9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:17.526896 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aebb42-a976-45a3-bd52-fe7fe8c63131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:17.527524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aebb42-a976-45a3-bd52-fe7fe8c63131 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:17.527837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aebb42-a976-45a3-bd52-fe7fe8c63131 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:17.528113 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aebb42-a976-45a3-bd52-fe7fe8c63131 None admin] PATH_INFO: `/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:17.529262 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aebb42-a976-45a3-bd52-fe7fe8c63131 None admin] RBAC: Authorizing `identity:get_group(group_id=9e27d3ac5cdd40c094de36ecf77e95f4)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:17.530703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aebb42-a976-45a3-bd52-fe7fe8c63131 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:17.532393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 225/451] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:17 2022] GET /identity/v3/groups/9e27d3ac5cdd40c094de36ecf77e95f4 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:17.538191 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aebb42-a976-45a3-bd52-fe7fe8c63131 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:17.552926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8137da-3d19-434c-a1c4-c3779e95e45d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:17.588429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29cf4f-304a-42d5-9757-d31594bb1fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:17.588971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29cf4f-304a-42d5-9757-d31594bb1fcc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:17.589255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29cf4f-304a-42d5-9757-d31594bb1fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:17.589526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29cf4f-304a-42d5-9757-d31594bb1fcc None admin] PATH_INFO: `/v3/projects/8164e47598a34978921b5d7bbf1d90ac` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:17.590682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29cf4f-304a-42d5-9757-d31594bb1fcc None admin] RBAC: Authorizing `identity:get_project(project_id=8164e47598a34978921b5d7bbf1d90ac)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:17.592382 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29cf4f-304a-42d5-9757-d31594bb1fcc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:17.594322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 227/452] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:25:17 2022] GET /identity/v3/projects/8164e47598a34978921b5d7bbf1d90ac => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:17.600183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29cf4f-304a-42d5-9757-d31594bb1fcc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:17.647572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aebb42-a976-45a3-bd52-fe7fe8c63131 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:17.682688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:17.687264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339e5ce-3c3c-4abe-91aa-130b902d17d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:17.687903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339e5ce-3c3c-4abe-91aa-130b902d17d9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:17.688183 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339e5ce-3c3c-4abe-91aa-130b902d17d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:17.688456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339e5ce-3c3c-4abe-91aa-130b902d17d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:17.689181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339e5ce-3c3c-4abe-91aa-130b902d17d9 None admin] RBAC: Adding query filter params (group.id=9e27d3ac5cdd40c094de36ecf77e95f4, role.id=2d3147d5707740a9995645aee5e671b3, scope.project.id=5feb6abf7be947c9b5eef75d51387fcf) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:17.689484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339e5ce-3c3c-4abe-91aa-130b902d17d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:17.690913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339e5ce-3c3c-4abe-91aa-130b902d17d9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:17.696667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 226/453] 10.222.0.91 () {56 vars in 1376 bytes} [Wed Aug 24 10:25:17 2022] GET /identity/v3/role_assignments?group.id=9e27d3ac5cdd40c094de36ecf77e95f4&scope.project.id=5feb6abf7be947c9b5eef75d51387fcf&role.id=2d3147d5707740a9995645aee5e671b3 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:17.706712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29cf4f-304a-42d5-9757-d31594bb1fcc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:17.747168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38fd42-dd03-49e4-b6dc-ce5001ed5635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:17.747964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38fd42-dd03-49e4-b6dc-ce5001ed5635 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:17.748262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38fd42-dd03-49e4-b6dc-ce5001ed5635 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:17.748725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38fd42-dd03-49e4-b6dc-ce5001ed5635 None admin] PATH_INFO: `/v3/groups/fe2e89a4233a4cbd80d31a2af89a258f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:17.750682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38fd42-dd03-49e4-b6dc-ce5001ed5635 None admin] RBAC: Authorizing `identity:get_group(group_id=fe2e89a4233a4cbd80d31a2af89a258f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:17.753242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38fd42-dd03-49e4-b6dc-ce5001ed5635 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:17.755202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 228/454] 10.222.0.91 () {56 vars in 1180 bytes} [Wed Aug 24 10:25:17 2022] GET /identity/v3/groups/fe2e89a4233a4cbd80d31a2af89a258f => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:17.762419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339e5ce-3c3c-4abe-91aa-130b902d17d9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:17.765549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:17.872212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339e5ce-3c3c-4abe-91aa-130b902d17d9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:17.913450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542774cb-c2e6-4848-9900-4d150fda5259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:17.914055 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542774cb-c2e6-4848-9900-4d150fda5259 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:17.914332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542774cb-c2e6-4848-9900-4d150fda5259 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:17.914600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542774cb-c2e6-4848-9900-4d150fda5259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:17.915879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542774cb-c2e6-4848-9900-4d150fda5259 None admin] RBAC: Adding query filter params (group.id=fe2e89a4233a4cbd80d31a2af89a258f, role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=8164e47598a34978921b5d7bbf1d90ac) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:17.915879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542774cb-c2e6-4848-9900-4d150fda5259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:17.917652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542774cb-c2e6-4848-9900-4d150fda5259 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:17.924262 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 227/455] 10.222.0.91 () {56 vars in 1376 bytes} [Wed Aug 24 10:25:17 2022] GET /identity/v3/role_assignments?group.id=fe2e89a4233a4cbd80d31a2af89a258f&scope.project.id=8164e47598a34978921b5d7bbf1d90ac&role.id=60abeefc9ac84e31a0162ac559220669 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:20.276310 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a521f1-9f08-409b-991c-ea8665307442 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:20.277327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a521f1-9f08-409b-991c-ea8665307442 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:20.277809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a521f1-9f08-409b-991c-ea8665307442 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:20.279663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 229/456] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:20.287165 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478a898-91a6-4df0-a191-24cea53766cd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:20.288485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478a898-91a6-4df0-a191-24cea53766cd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:20.288968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478a898-91a6-4df0-a191-24cea53766cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:20.315933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b478a898-91a6-4df0-a191-24cea53766cd None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:20.317135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b478a898-91a6-4df0-a191-24cea53766cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:20.404094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:20.416499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 228/457] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:20.765092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f317-3052-4eb3-b706-e7014f9252a3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:20.765473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f317-3052-4eb3-b706-e7014f9252a3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:20.765648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f317-3052-4eb3-b706-e7014f9252a3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:20.767261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 230/458] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:20.772802 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ad68e-cdd7-434f-93df-8d7becf93dbb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:20.773119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ad68e-cdd7-434f-93df-8d7becf93dbb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:20.773399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ad68e-cdd7-434f-93df-8d7becf93dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:20.798637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3f0ad68e-cdd7-434f-93df-8d7becf93dbb None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:20.799859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3f0ad68e-cdd7-434f-93df-8d7becf93dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:20.847733 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10f317-3052-4eb3-b706-e7014f9252a3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:20.885604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 229/459] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:25:21.024907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10f317-3052-4eb3-b706-e7014f9252a3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:21.060623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736fe82-be2b-4650-95cb-3ea29c04b689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:21.061268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736fe82-be2b-4650-95cb-3ea29c04b689 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:21.061546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736fe82-be2b-4650-95cb-3ea29c04b689 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:21.061818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736fe82-be2b-4650-95cb-3ea29c04b689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:21.073386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736fe82-be2b-4650-95cb-3ea29c04b689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:21.074838 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736fe82-be2b-4650-95cb-3ea29c04b689 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:21.077560 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0736fe82-be2b-4650-95cb-3ea29c04b689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:21.092335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:21.096665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:21.097515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:21.097515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:21.097515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:21.097515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 231/460] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:21.099424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ad68e-cdd7-434f-93df-8d7becf93dbb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:21.136676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb097-f8c7-459c-be04-256d19369757 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:21.136984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb097-f8c7-459c-be04-256d19369757 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:21.137216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb097-f8c7-459c-be04-256d19369757 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:21.138840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 232/461] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:21.144352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3671-5273-4a92-bcd6-76dad10f231a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:21.144659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3671-5273-4a92-bcd6-76dad10f231a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:21.144899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3671-5273-4a92-bcd6-76dad10f231a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:21.183349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e78e3671-5273-4a92-bcd6-76dad10f231a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:21.185171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e78e3671-5273-4a92-bcd6-76dad10f231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:21.259297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ad68e-cdd7-434f-93df-8d7becf93dbb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:21.274514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 233/462] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:25:21.276134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e3671-5273-4a92-bcd6-76dad10f231a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:21.293988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:21.303352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa1c7b-c10f-4d33-9662-9f28114a729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:21.304163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa1c7b-c10f-4d33-9662-9f28114a729b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:21.304376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa1c7b-c10f-4d33-9662-9f28114a729b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:21.308007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa1c7b-c10f-4d33-9662-9f28114a729b None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:21.308007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa1c7b-c10f-4d33-9662-9f28114a729b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:21.308007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa1c7b-c10f-4d33-9662-9f28114a729b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:21.308007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa1c7b-c10f-4d33-9662-9f28114a729b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:21.327457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 230/463] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:21.336834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa1c7b-c10f-4d33-9662-9f28114a729b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:21.388516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e3671-5273-4a92-bcd6-76dad10f231a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:21.422686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:21.427166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a598bc-68df-4df6-b887-fb18345d31dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:21.428126 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a598bc-68df-4df6-b887-fb18345d31dc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:21.428658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a598bc-68df-4df6-b887-fb18345d31dc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:21.429116 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a598bc-68df-4df6-b887-fb18345d31dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:21.443808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a598bc-68df-4df6-b887-fb18345d31dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:21.446352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a598bc-68df-4df6-b887-fb18345d31dc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:21.457236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa1c7b-c10f-4d33-9662-9f28114a729b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d7a598bc-68df-4df6-b887-fb18345d31dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:21.466470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:21.467534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:21.468421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:21.468421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:21.468421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:21.469399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 234/464] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:21.473001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829831a-70ea-427c-88e3-12c2e17f3ad3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:21.473497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829831a-70ea-427c-88e3-12c2e17f3ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:21.473952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829831a-70ea-427c-88e3-12c2e17f3ad3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:21.476068 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 235/465] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:21.477231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829831a-70ea-427c-88e3-12c2e17f3ad3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:21.510239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e402ea-4b98-42ca-bdc0-d36d9c40aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:21.511052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e402ea-4b98-42ca-bdc0-d36d9c40aa00 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:21.511336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e402ea-4b98-42ca-bdc0-d36d9c40aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:21.511615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e402ea-4b98-42ca-bdc0-d36d9c40aa00 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:21.512315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e402ea-4b98-42ca-bdc0-d36d9c40aa00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:21.514700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e402ea-4b98-42ca-bdc0-d36d9c40aa00 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:21.605557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829831a-70ea-427c-88e3-12c2e17f3ad3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:21.626448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 231/466] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:25:21 2022] POST /identity/v3/users => generated 246 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:25:21.626448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae245f-c3a7-4413-8b06-5b566c667be0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:21.626448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae245f-c3a7-4413-8b06-5b566c667be0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:21.626448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae245f-c3a7-4413-8b06-5b566c667be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:21.643805 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-71ae245f-c3a7-4413-8b06-5b566c667be0 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:21.645212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-71ae245f-c3a7-4413-8b06-5b566c667be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:21.656515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ec514-602b-4c33-a05b-e8944f21cb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:21.657132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ec514-602b-4c33-a05b-e8944f21cb67 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:21.657405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ec514-602b-4c33-a05b-e8944f21cb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:21.657794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ec514-602b-4c33-a05b-e8944f21cb67 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:21.658512 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ec514-602b-4c33-a05b-e8944f21cb67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:21.658816 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ec514-602b-4c33-a05b-e8944f21cb67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:21.660485 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ec514-602b-4c33-a05b-e8944f21cb67 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:21.678727 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 236/467] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:21.684178 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ec514-602b-4c33-a05b-e8944f21cb67 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:21.698806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:21.743929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:21.755745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 232/468] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:21.755745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae245f-c3a7-4413-8b06-5b566c667be0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:21.855962 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ec514-602b-4c33-a05b-e8944f21cb67 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:21.896577 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eac72-1e6d-434b-be13-6675c9ce57ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:21.897222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eac72-1e6d-434b-be13-6675c9ce57ba None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:21.897502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eac72-1e6d-434b-be13-6675c9ce57ba None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:21.897743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eac72-1e6d-434b-be13-6675c9ce57ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:21.914478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eac72-1e6d-434b-be13-6675c9ce57ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:21.916062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eac72-1e6d-434b-be13-6675c9ce57ba None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:21.919868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae245f-c3a7-4413-8b06-5b566c667be0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a10eac72-1e6d-434b-be13-6675c9ce57ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:21.933352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:21.934316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:21.935148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:21.935148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:21.935148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:21.935148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 237/469] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:21.941299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eac72-1e6d-434b-be13-6675c9ce57ba None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:21.968018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a0227-8145-4b3e-894f-d06727ad9a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:21.969127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a0227-8145-4b3e-894f-d06727ad9a71 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:21.969595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a0227-8145-4b3e-894f-d06727ad9a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:21.970143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a0227-8145-4b3e-894f-d06727ad9a71 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:21.971002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a0227-8145-4b3e-894f-d06727ad9a71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:21.972946 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a0227-8145-4b3e-894f-d06727ad9a71 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:22.046125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:22.061739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 233/470] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:25:21 2022] POST /identity/v3/users => generated 248 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:25:22.066265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eac72-1e6d-434b-be13-6675c9ce57ba None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:22.083412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a0227-8145-4b3e-894f-d06727ad9a71 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:22.123592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bcc12-80bb-44dc-af7a-f8582f8ca459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:22.124228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bcc12-80bb-44dc-af7a-f8582f8ca459 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:22.124504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bcc12-80bb-44dc-af7a-f8582f8ca459 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:22.124811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bcc12-80bb-44dc-af7a-f8582f8ca459 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:22.125545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:22.125661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bcc12-80bb-44dc-af7a-f8582f8ca459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:22.125840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bcc12-80bb-44dc-af7a-f8582f8ca459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:22.127942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bcc12-80bb-44dc-af7a-f8582f8ca459 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:22.149018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 238/471] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:22.156017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903fd9c-43dd-4213-ba3d-42d9cfa4c8b4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:22.156017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903fd9c-43dd-4213-ba3d-42d9cfa4c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:22.156017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903fd9c-43dd-4213-ba3d-42d9cfa4c8b4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:22.156017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 239/472] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:22.159145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903fd9c-43dd-4213-ba3d-42d9cfa4c8b4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:22.252588 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a0227-8145-4b3e-894f-d06727ad9a71 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:22.309702 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a896c-38dd-447c-95f3-7d242ed1ee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:22.310351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903fd9c-43dd-4213-ba3d-42d9cfa4c8b4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:22.310435 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a896c-38dd-447c-95f3-7d242ed1ee47 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:22.310660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a896c-38dd-447c-95f3-7d242ed1ee47 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:22.310880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a896c-38dd-447c-95f3-7d242ed1ee47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:22.326518 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a896c-38dd-447c-95f3-7d242ed1ee47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:22.328474 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a896c-38dd-447c-95f3-7d242ed1ee47 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7d4a896c-38dd-447c-95f3-7d242ed1ee47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:22.346264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:22.347229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:22.348476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:22.348476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:22.348476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:22.348476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 234/473] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:22.349316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174baf4-b45f-4c5c-8ad0-da1b5ab9f193 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:22.349589 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174baf4-b45f-4c5c-8ad0-da1b5ab9f193 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:22.349859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174baf4-b45f-4c5c-8ad0-da1b5ab9f193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:22.363334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2d771-c955-4aed-b0e8-9d20e12a0e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:22.364824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2d771-c955-4aed-b0e8-9d20e12a0e83 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:22.365572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2d771-c955-4aed-b0e8-9d20e12a0e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:22.366905 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2d771-c955-4aed-b0e8-9d20e12a0e83 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:22.368530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2d771-c955-4aed-b0e8-9d20e12a0e83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:22.371387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2d771-c955-4aed-b0e8-9d20e12a0e83 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:22.371879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3174baf4-b45f-4c5c-8ad0-da1b5ab9f193 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:22.373089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3174baf4-b45f-4c5c-8ad0-da1b5ab9f193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:22.472131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 235/474] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:22.473009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174baf4-b45f-4c5c-8ad0-da1b5ab9f193 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:22.482952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 240/475] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:25:22 2022] POST /identity/v3/users => generated 249 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:25:22.502190 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:22.651275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174baf4-b45f-4c5c-8ad0-da1b5ab9f193 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:22.726462 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da30a0a-a24f-4eb2-bafb-dcfc03984c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:22.727134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da30a0a-a24f-4eb2-bafb-dcfc03984c69 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:22.727477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da30a0a-a24f-4eb2-bafb-dcfc03984c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:22.727848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da30a0a-a24f-4eb2-bafb-dcfc03984c69 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:22.729022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da30a0a-a24f-4eb2-bafb-dcfc03984c69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:22.729448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da30a0a-a24f-4eb2-bafb-dcfc03984c69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:22.730969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da30a0a-a24f-4eb2-bafb-dcfc03984c69 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:22.745154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 236/476] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:22.752268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2d771-c955-4aed-b0e8-9d20e12a0e83 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:22.777063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:22.865554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da30a0a-a24f-4eb2-bafb-dcfc03984c69 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:22.896866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2d771-c955-4aed-b0e8-9d20e12a0e83 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:22.947710 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78450212-9208-4a54-a8b8-52374bed305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:22.948358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78450212-9208-4a54-a8b8-52374bed305b None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:22.948636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78450212-9208-4a54-a8b8-52374bed305b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:22.948910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78450212-9208-4a54-a8b8-52374bed305b None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:22.949895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78450212-9208-4a54-a8b8-52374bed305b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:22.953149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78450212-9208-4a54-a8b8-52374bed305b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:22.969652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:23.018356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da30a0a-a24f-4eb2-bafb-dcfc03984c69 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:23.066346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885e6b0-55e9-41fe-97d3-3f744dca52d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:23.067523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885e6b0-55e9-41fe-97d3-3f744dca52d3 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:23.068079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885e6b0-55e9-41fe-97d3-3f744dca52d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:23.068691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885e6b0-55e9-41fe-97d3-3f744dca52d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:23.069951 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885e6b0-55e9-41fe-97d3-3f744dca52d3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:23.072953 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885e6b0-55e9-41fe-97d3-3f744dca52d3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:23.082275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 241/477] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:25:22 2022] POST /identity/v3/users => generated 248 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:25:23.147339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.sql.core [None req-f885e6b0-55e9-41fe-97d3-3f744dca52d3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 10:25:23.147339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 10:25:23.147339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [parameters: {'id': '9c534ba56da141c1a3ffe46d79700672', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 10:25:23.147339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81633) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f885e6b0-55e9-41fe-97d3-3f744dca52d3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result.read() Aug 24 10:25:23.181501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:25:23.182475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application yield resource Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise self.value Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application session.commit() Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 10:25:23.184645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.session.flush() Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application compat.raise_( Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 10:25:23.187088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:25:23.189612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result.read() Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:25:23.196126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [parameters: {'id': '9c534ba56da141c1a3ffe46d79700672', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:23.198219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 10:25:23.200226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:23.202424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 237/478] 10.222.0.91 () {60 vars in 1131 bytes} [Wed Aug 24 10:25:22 2022] POST /identity/v3/roles => generated 144 bytes in 318 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:23.202561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78450212-9208-4a54-a8b8-52374bed305b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:23.286667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:23.345009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78450212-9208-4a54-a8b8-52374bed305b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:23.387206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949399bd-1d0f-4e4b-b2a8-9f1057c5dc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:23.388042 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949399bd-1d0f-4e4b-b2a8-9f1057c5dc0f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:23.388334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949399bd-1d0f-4e4b-b2a8-9f1057c5dc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:23.388572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949399bd-1d0f-4e4b-b2a8-9f1057c5dc0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:23.414511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949399bd-1d0f-4e4b-b2a8-9f1057c5dc0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-949399bd-1d0f-4e4b-b2a8-9f1057c5dc0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:23.420176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:23.421127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:23.422516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 242/479] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:25:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:23.430109 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885e6b0-55e9-41fe-97d3-3f744dca52d3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:23.574412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885e6b0-55e9-41fe-97d3-3f744dca52d3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:23.613456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec99b72-8327-48df-9fe3-bfa144b3dfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:23.614141 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec99b72-8327-48df-9fe3-bfa144b3dfe1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:23.614420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec99b72-8327-48df-9fe3-bfa144b3dfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:23.614687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec99b72-8327-48df-9fe3-bfa144b3dfe1 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:23.615351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec99b72-8327-48df-9fe3-bfa144b3dfe1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:23.615853 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec99b72-8327-48df-9fe3-bfa144b3dfe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:23.618556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec99b72-8327-48df-9fe3-bfa144b3dfe1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:23.621082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:23.631741 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 238/480] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:24.003695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6ecc2-f2bb-470d-a6f6-08942c5a5ce4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:24.004434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6ecc2-f2bb-470d-a6f6-08942c5a5ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:24.004434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6ecc2-f2bb-470d-a6f6-08942c5a5ce4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:24.005790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 243/481] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:24.012215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27717ed-1613-416f-ae9e-3655a3a85eae None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:24.012506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27717ed-1613-416f-ae9e-3655a3a85eae None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:24.012780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27717ed-1613-416f-ae9e-3655a3a85eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:24.034592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b27717ed-1613-416f-ae9e-3655a3a85eae None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:24.035799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b27717ed-1613-416f-ae9e-3655a3a85eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:24.127348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 239/482] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:25:24.431966 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6ecc2-f2bb-470d-a6f6-08942c5a5ce4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:24.507061 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706120af-c5bd-4ea2-8450-27b63a3dabc7 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:24.507572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706120af-c5bd-4ea2-8450-27b63a3dabc7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:24.507645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706120af-c5bd-4ea2-8450-27b63a3dabc7 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:24.509404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 240/483] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:24.514965 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f8289-9a5b-454c-9b08-cee8f9da6807 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:24.515381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f8289-9a5b-454c-9b08-cee8f9da6807 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:24.515545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f8289-9a5b-454c-9b08-cee8f9da6807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:24.542987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-673f8289-9a5b-454c-9b08-cee8f9da6807 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:24.545742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-673f8289-9a5b-454c-9b08-cee8f9da6807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:24.611742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6ecc2-f2bb-470d-a6f6-08942c5a5ce4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:24.647606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:24.660072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 241/484] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:25:24.669527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc359f6-066f-4b71-bfb1-1307a3826a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:24.671232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc359f6-066f-4b71-bfb1-1307a3826a85 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:24.671232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc359f6-066f-4b71-bfb1-1307a3826a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:24.671232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc359f6-066f-4b71-bfb1-1307a3826a85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:24.683429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc359f6-066f-4b71-bfb1-1307a3826a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4dc359f6-066f-4b71-bfb1-1307a3826a85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:24.689234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:24.690279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:24.691270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:24.691270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:24.691270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:24.691270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:24.691270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:24.691270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:24.691270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:24.691270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:24.691270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:24.691270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:24.691270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:24.691270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:24.693636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 244/485] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:24.699880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f8289-9a5b-454c-9b08-cee8f9da6807 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:24.776604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:24.828440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f8289-9a5b-454c-9b08-cee8f9da6807 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:24.864964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885d486-3362-49f3-9405-90a235dee8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:24.865838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885d486-3362-49f3-9405-90a235dee8bc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:24.866252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885d486-3362-49f3-9405-90a235dee8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:24.866658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885d486-3362-49f3-9405-90a235dee8bc None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:24.867446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885d486-3362-49f3-9405-90a235dee8bc None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:24.867924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885d486-3362-49f3-9405-90a235dee8bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:24.869533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885d486-3362-49f3-9405-90a235dee8bc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:24.878638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 242/486] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:24.885122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc359f6-066f-4b71-bfb1-1307a3826a85 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:24.950364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885d486-3362-49f3-9405-90a235dee8bc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:25.000483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc359f6-066f-4b71-bfb1-1307a3826a85 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:25.040399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec043482-5195-497d-86e4-382f6b764c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:25.042314 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec043482-5195-497d-86e4-382f6b764c8d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:25.042729 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec043482-5195-497d-86e4-382f6b764c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:25.043286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec043482-5195-497d-86e4-382f6b764c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:25.056858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec043482-5195-497d-86e4-382f6b764c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:25.058552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec043482-5195-497d-86e4-382f6b764c8d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ec043482-5195-497d-86e4-382f6b764c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:25.075568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:25.076755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:25.077814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:25.077814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:25.077814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:25.084196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 245/487] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:25.085975 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec043482-5195-497d-86e4-382f6b764c8d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:25.126543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:25.204922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec043482-5195-497d-86e4-382f6b764c8d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:25.254449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f55ad-3212-4299-af0f-46a33d0700ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:25.255309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f55ad-3212-4299-af0f-46a33d0700ab None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:25.255828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f55ad-3212-4299-af0f-46a33d0700ab None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:25.256239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f55ad-3212-4299-af0f-46a33d0700ab None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:25.257048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f55ad-3212-4299-af0f-46a33d0700ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:25.257490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f55ad-3212-4299-af0f-46a33d0700ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:25.258998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f55ad-3212-4299-af0f-46a33d0700ab None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:25.273374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 246/488] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:25.273843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885d486-3362-49f3-9405-90a235dee8bc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:25.283061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f55ad-3212-4299-af0f-46a33d0700ab None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:25.304155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:25.315461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6d275-2a88-4b4b-ad42-3bdfad9a3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:25.318796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6d275-2a88-4b4b-ad42-3bdfad9a3ced None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:25.318796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6d275-2a88-4b4b-ad42-3bdfad9a3ced None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:25.318796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6d275-2a88-4b4b-ad42-3bdfad9a3ced None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:25.331109 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6d275-2a88-4b4b-ad42-3bdfad9a3ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4ee6d275-2a88-4b4b-ad42-3bdfad9a3ced None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:25.336415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:25.337283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:25.338641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:25.338641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:25.338641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:25.338641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:25.338641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:25.338641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:25.338641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:25.338641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:25.338641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:25.338641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:25.338641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:25.338641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:25.341149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 243/489] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:25.342471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8e7a5-8ec3-49dc-9e76-649417b5d906 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:25.342968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8e7a5-8ec3-49dc-9e76-649417b5d906 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:25.343383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8e7a5-8ec3-49dc-9e76-649417b5d906 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:25.345099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 244/490] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:25.349815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8e7a5-8ec3-49dc-9e76-649417b5d906 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:25.412682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:25.421161 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f55ad-3212-4299-af0f-46a33d0700ab None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:25.460313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f16cd6-3025-4846-92d2-a669b2f0fcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:25.461129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f16cd6-3025-4846-92d2-a669b2f0fcb1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:25.461506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f16cd6-3025-4846-92d2-a669b2f0fcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:25.461876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f16cd6-3025-4846-92d2-a669b2f0fcb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:25.470807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8e7a5-8ec3-49dc-9e76-649417b5d906 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:25.471218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f16cd6-3025-4846-92d2-a669b2f0fcb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:25.472921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f16cd6-3025-4846-92d2-a669b2f0fcb1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a4f16cd6-3025-4846-92d2-a669b2f0fcb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:25.487625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:25.488618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 247/491] 10.222.0.91 () {56 vars in 1093 bytes} [Wed Aug 24 10:25:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2cf46-366e-4140-b86b-f0038a525587 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:25.494226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2cf46-366e-4140-b86b-f0038a525587 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:25.494931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2cf46-366e-4140-b86b-f0038a525587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:25.513407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6fa2cf46-366e-4140-b86b-f0038a525587 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:25.514704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6fa2cf46-366e-4140-b86b-f0038a525587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:25.516880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a34724-dd3e-406c-b1e7-56223c671c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:25.518115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a34724-dd3e-406c-b1e7-56223c671c4a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:25.518568 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a34724-dd3e-406c-b1e7-56223c671c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:25.519012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a34724-dd3e-406c-b1e7-56223c671c4a None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:25.519890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a34724-dd3e-406c-b1e7-56223c671c4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:25.520394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a34724-dd3e-406c-b1e7-56223c671c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:25.522241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a34724-dd3e-406c-b1e7-56223c671c4a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:25.536223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 245/492] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:25.537021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a34724-dd3e-406c-b1e7-56223c671c4a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:25.590337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:25.601829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 248/493] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:25.604286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2cf46-366e-4140-b86b-f0038a525587 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:25.664566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a34724-dd3e-406c-b1e7-56223c671c4a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:25.703301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de2e96-3c85-4a7b-9057-c35675e0d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:25.704405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de2e96-3c85-4a7b-9057-c35675e0d357 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:25.704827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de2e96-3c85-4a7b-9057-c35675e0d357 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:25.705330 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de2e96-3c85-4a7b-9057-c35675e0d357 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:25.706260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de2e96-3c85-4a7b-9057-c35675e0d357 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:25.706786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de2e96-3c85-4a7b-9057-c35675e0d357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:25.708545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de2e96-3c85-4a7b-9057-c35675e0d357 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:25.720773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:25.741396 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2cf46-366e-4140-b86b-f0038a525587 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:25.753381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 246/494] 10.222.0.91 () {56 vars in 1133 bytes} [Wed Aug 24 10:25:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:25.759529 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de2e96-3c85-4a7b-9057-c35675e0d357 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:25.794297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a9b19-11b5-49a5-9dd5-604d00efa877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:25.795341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a9b19-11b5-49a5-9dd5-604d00efa877 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:25.795867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a9b19-11b5-49a5-9dd5-604d00efa877 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:25.796374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a9b19-11b5-49a5-9dd5-604d00efa877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:25.828665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a9b19-11b5-49a5-9dd5-604d00efa877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:25.830141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a9b19-11b5-49a5-9dd5-604d00efa877 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7f4a9b19-11b5-49a5-9dd5-604d00efa877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:25.859220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:25.860226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:25.861074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:25.861074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:25.861074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:25.868387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 249/495] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:25.882781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:25.884668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a9b19-11b5-49a5-9dd5-604d00efa877 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:25.887162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de2e96-3c85-4a7b-9057-c35675e0d357 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:25.939951 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00848921-4a9c-4f7d-8526-3629fee6ba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:25.940579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00848921-4a9c-4f7d-8526-3629fee6ba5f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:25.940861 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00848921-4a9c-4f7d-8526-3629fee6ba5f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:25.941137 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00848921-4a9c-4f7d-8526-3629fee6ba5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.050777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00848921-4a9c-4f7d-8526-3629fee6ba5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:26.053114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00848921-4a9c-4f7d-8526-3629fee6ba5f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:26.101828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a9b19-11b5-49a5-9dd5-604d00efa877 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:26.148534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a10015-62a6-43fa-84d7-82de9393c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:26.149154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a10015-62a6-43fa-84d7-82de9393c8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:26.149432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a10015-62a6-43fa-84d7-82de9393c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:26.149704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a10015-62a6-43fa-84d7-82de9393c8d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.150617 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a10015-62a6-43fa-84d7-82de9393c8d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:26.150918 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a10015-62a6-43fa-84d7-82de9393c8d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:26.152360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a10015-62a6-43fa-84d7-82de9393c8d9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:26.154847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:26.165626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 250/496] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:26.167053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a10015-62a6-43fa-84d7-82de9393c8d9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:26.169476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:26.179857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 247/497] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:26.182000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5770da8-2e73-4e6b-83b2-be599e6674f2 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:26.182389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5770da8-2e73-4e6b-83b2-be599e6674f2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:26.182797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5770da8-2e73-4e6b-83b2-be599e6674f2 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.184486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 248/498] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:26.189623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5770da8-2e73-4e6b-83b2-be599e6674f2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:26.282081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a10015-62a6-43fa-84d7-82de9393c8d9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:26.309054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5770da8-2e73-4e6b-83b2-be599e6674f2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:26.317475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00557eec-adf8-4c0d-a59d-bbb4ebe0c4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:26.318107 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00557eec-adf8-4c0d-a59d-bbb4ebe0c4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:26.318384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00557eec-adf8-4c0d-a59d-bbb4ebe0c4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:26.319019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00557eec-adf8-4c0d-a59d-bbb4ebe0c4b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.332234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00557eec-adf8-4c0d-a59d-bbb4ebe0c4b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-00557eec-adf8-4c0d-a59d-bbb4ebe0c4b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:26.336931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:26.338661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 251/499] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:26.339468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00557eec-adf8-4c0d-a59d-bbb4ebe0c4b5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:26.351586 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4c506-ccdd-4650-8dc3-2098a8f40829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:26.352593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4c506-ccdd-4650-8dc3-2098a8f40829 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:26.353733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4c506-ccdd-4650-8dc3-2098a8f40829 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:26.354090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4c506-ccdd-4650-8dc3-2098a8f40829 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.362746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4c506-ccdd-4650-8dc3-2098a8f40829 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:26.364226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4c506-ccdd-4650-8dc3-2098a8f40829 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-aeb4c506-ccdd-4650-8dc3-2098a8f40829 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:26.377572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:26.378704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:26.379609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:26.379609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:26.379609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:26.379609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:26.379609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:26.379609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:26.379609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:26.379609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:26.379609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:25:26.379609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:26.379609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 249/500] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:26.380234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52f63-221e-4f02-904e-8d043d2692f2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:26.380234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52f63-221e-4f02-904e-8d043d2692f2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:26.380418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52f63-221e-4f02-904e-8d043d2692f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.399612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f7f52f63-221e-4f02-904e-8d043d2692f2 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:26.401709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f7f52f63-221e-4f02-904e-8d043d2692f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:26.411984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:26.456503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:26.457745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00557eec-adf8-4c0d-a59d-bbb4ebe0c4b5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:26.470156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 250/501] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:26.471384 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27565-6fbb-44ce-93d1-2c0ca12b26af None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:26.471665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27565-6fbb-44ce-93d1-2c0ca12b26af None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:26.471965 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27565-6fbb-44ce-93d1-2c0ca12b26af None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.473212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 251/502] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:26.473898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27565-6fbb-44ce-93d1-2c0ca12b26af None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:26.512312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea5689-d701-4ab6-83f9-b919b52856ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:26.512948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea5689-d701-4ab6-83f9-b919b52856ac None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:26.513224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea5689-d701-4ab6-83f9-b919b52856ac None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:26.513493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea5689-d701-4ab6-83f9-b919b52856ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.525712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea5689-d701-4ab6-83f9-b919b52856ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:26.527374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea5689-d701-4ab6-83f9-b919b52856ac None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e0ea5689-d701-4ab6-83f9-b919b52856ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:26.543280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:26.544348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:26.545202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:26.545202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:26.545202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:26.545202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 252/503] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:26.545202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea5689-d701-4ab6-83f9-b919b52856ac None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:26.595895 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27565-6fbb-44ce-93d1-2c0ca12b26af None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:26.635921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7442281-34f7-4cb2-8415-bfd74fd87d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:26.636534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7442281-34f7-4cb2-8415-bfd74fd87d9b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:26.636811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7442281-34f7-4cb2-8415-bfd74fd87d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:26.637082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7442281-34f7-4cb2-8415-bfd74fd87d9b None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.637746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7442281-34f7-4cb2-8415-bfd74fd87d9b None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:26.638043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7442281-34f7-4cb2-8415-bfd74fd87d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:26.639447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7442281-34f7-4cb2-8415-bfd74fd87d9b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:26.648119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 252/504] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:26.649463 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62762b89-0a13-45ac-93bc-414510b09a8c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:26.649746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62762b89-0a13-45ac-93bc-414510b09a8c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:26.650262 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62762b89-0a13-45ac-93bc-414510b09a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.670564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-62762b89-0a13-45ac-93bc-414510b09a8c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:26.671786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-62762b89-0a13-45ac-93bc-414510b09a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:26.673014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea5689-d701-4ab6-83f9-b919b52856ac None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:26.685357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:26.714216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081056b-e5f3-46b2-89d5-b87387242b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:26.714836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081056b-e5f3-46b2-89d5-b87387242b26 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:26.715114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081056b-e5f3-46b2-89d5-b87387242b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:26.715382 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081056b-e5f3-46b2-89d5-b87387242b26 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.716172 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081056b-e5f3-46b2-89d5-b87387242b26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:26.716531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081056b-e5f3-46b2-89d5-b87387242b26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:26.718008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081056b-e5f3-46b2-89d5-b87387242b26 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:26.729179 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:26.751434 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 253/505] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:26.753029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62762b89-0a13-45ac-93bc-414510b09a8c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:26.759952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 253/506] 10.222.0.91 () {56 vars in 1137 bytes} [Wed Aug 24 10:25:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:26.760825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081056b-e5f3-46b2-89d5-b87387242b26 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:26.877370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62762b89-0a13-45ac-93bc-414510b09a8c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:26.881341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081056b-e5f3-46b2-89d5-b87387242b26 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:26.920375 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb3016-253d-4979-a0e1-3396a116713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:26.921002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb3016-253d-4979-a0e1-3396a116713f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:26.921353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb3016-253d-4979-a0e1-3396a116713f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:26.921545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb3016-253d-4979-a0e1-3396a116713f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.933060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb3016-253d-4979-a0e1-3396a116713f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:26.934682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb3016-253d-4979-a0e1-3396a116713f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:26.935602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6392d-555b-49d3-9ae4-003f07ac0551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:26.936638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6392d-555b-49d3-9ae4-003f07ac0551 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:26.937392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6392d-555b-49d3-9ae4-003f07ac0551 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:26.937814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6392d-555b-49d3-9ae4-003f07ac0551 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:26.938606 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6392d-555b-49d3-9ae4-003f07ac0551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:26.939051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6392d-555b-49d3-9ae4-003f07ac0551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:26.940631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6392d-555b-49d3-9ae4-003f07ac0551 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-cefb3016-253d-4979-a0e1-3396a116713f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:26.952742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:26.953867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:26.954733 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:26.954733 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:26.954733 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:26.954733 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 254/507] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:26.954733 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb3016-253d-4979-a0e1-3396a116713f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:26.957519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 254/508] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:26.958665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6392d-555b-49d3-9ae4-003f07ac0551 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:26.986339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.006835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.072536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6392d-555b-49d3-9ae4-003f07ac0551 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:27.076067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb3016-253d-4979-a0e1-3396a116713f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:27.108538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67a135-a72c-4127-be2b-2ead064819d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:27.109144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67a135-a72c-4127-be2b-2ead064819d0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:27.109425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67a135-a72c-4127-be2b-2ead064819d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:27.109706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67a135-a72c-4127-be2b-2ead064819d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:27.111130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819bf52-1ddd-4eed-a043-3d74414fc512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:27.111789 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819bf52-1ddd-4eed-a043-3d74414fc512 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:27.112075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819bf52-1ddd-4eed-a043-3d74414fc512 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:27.112354 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819bf52-1ddd-4eed-a043-3d74414fc512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:27.123337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819bf52-1ddd-4eed-a043-3d74414fc512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:27.124831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819bf52-1ddd-4eed-a043-3d74414fc512 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0819bf52-1ddd-4eed-a043-3d74414fc512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:27.141056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:27.142142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:27.143173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:27.143173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:27.143173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:27.143173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 255/509] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:27.143173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819bf52-1ddd-4eed-a043-3d74414fc512 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:27.184462 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67a135-a72c-4127-be2b-2ead064819d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:27.185919 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67a135-a72c-4127-be2b-2ead064819d0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:27.216997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.232982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.249222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819bf52-1ddd-4eed-a043-3d74414fc512 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:27.285250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe54fbe-601e-48b1-a24c-2dc65e9321a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:27.286239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe54fbe-601e-48b1-a24c-2dc65e9321a9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:27.286239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe54fbe-601e-48b1-a24c-2dc65e9321a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:27.286558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe54fbe-601e-48b1-a24c-2dc65e9321a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:27.287048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe54fbe-601e-48b1-a24c-2dc65e9321a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:27.287342 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe54fbe-601e-48b1-a24c-2dc65e9321a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:27.288905 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe54fbe-601e-48b1-a24c-2dc65e9321a9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:27.295191 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 255/510] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:27.296069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67a135-a72c-4127-be2b-2ead064819d0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:27.305411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 256/511] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:27.306861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe54fbe-601e-48b1-a24c-2dc65e9321a9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:27.406957 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67a135-a72c-4127-be2b-2ead064819d0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:27.413811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe54fbe-601e-48b1-a24c-2dc65e9321a9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:27.449468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8e379-25cb-4e29-b27b-5ac2ee3d98e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:27.450063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.450205 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8e379-25cb-4e29-b27b-5ac2ee3d98e0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:27.450731 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8e379-25cb-4e29-b27b-5ac2ee3d98e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:27.451021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8e379-25cb-4e29-b27b-5ac2ee3d98e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:27.456926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3484d4-f681-4ed0-8590-50607ea918c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:27.460114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3484d4-f681-4ed0-8590-50607ea918c3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:27.460114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3484d4-f681-4ed0-8590-50607ea918c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:27.460114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3484d4-f681-4ed0-8590-50607ea918c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:27.460351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8e379-25cb-4e29-b27b-5ac2ee3d98e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:27.460351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8e379-25cb-4e29-b27b-5ac2ee3d98e0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:27.464317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.469573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3484d4-f681-4ed0-8590-50607ea918c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d7e8e379-25cb-4e29-b27b-5ac2ee3d98e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:27.474236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:27.475247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:27.486848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:27.486848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:27.486848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:27.486848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:27.486848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:27.486848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:27.486848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:27.486848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8f3484d4-f681-4ed0-8590-50607ea918c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:27.487374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:27.488283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:27.489127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:27.489127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:27.489127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:27.489127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:27.489127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:27.489127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:27.489127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:27.489127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:27.489127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:27.489127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:27.489127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:27.489127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:27.489736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 256/512] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:27.489804 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 257/513] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:27.489869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8e379-25cb-4e29-b27b-5ac2ee3d98e0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:27.489935 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3484d4-f681-4ed0-8590-50607ea918c3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:27.591643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3484d4-f681-4ed0-8590-50607ea918c3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:27.592150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8e379-25cb-4e29-b27b-5ac2ee3d98e0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:27.627991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74c4f6-cb09-4449-8d1d-7f35cdeb5d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:27.628667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce415f-9139-4edf-87eb-4a6dd3d6b492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:27.628774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74c4f6-cb09-4449-8d1d-7f35cdeb5d8f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:27.628873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74c4f6-cb09-4449-8d1d-7f35cdeb5d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:27.628957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce415f-9139-4edf-87eb-4a6dd3d6b492 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:27.629147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74c4f6-cb09-4449-8d1d-7f35cdeb5d8f None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:27.629236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce415f-9139-4edf-87eb-4a6dd3d6b492 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:27.629420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce415f-9139-4edf-87eb-4a6dd3d6b492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:27.629827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74c4f6-cb09-4449-8d1d-7f35cdeb5d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:27.630130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74c4f6-cb09-4449-8d1d-7f35cdeb5d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:27.631531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74c4f6-cb09-4449-8d1d-7f35cdeb5d8f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:27.640395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce415f-9139-4edf-87eb-4a6dd3d6b492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:27.641877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce415f-9139-4edf-87eb-4a6dd3d6b492 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:27.645431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 257/514] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:27.645431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74c4f6-cb09-4449-8d1d-7f35cdeb5d8f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4bce415f-9139-4edf-87eb-4a6dd3d6b492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:27.661098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:27.662070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:27.662941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:27.662941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:27.662941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:27.662941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 258/515] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:27.662941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce415f-9139-4edf-87eb-4a6dd3d6b492 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:27.708374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.716885 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.758451 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74c4f6-cb09-4449-8d1d-7f35cdeb5d8f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:27.767571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce415f-9139-4edf-87eb-4a6dd3d6b492 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:27.796424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a8fcc-7afc-40c7-bf38-f077f5604424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:27.797057 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a8fcc-7afc-40c7-bf38-f077f5604424 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:27.797336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a8fcc-7afc-40c7-bf38-f077f5604424 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:27.797605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a8fcc-7afc-40c7-bf38-f077f5604424 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:27.801799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b163c62-c325-4c86-8c4f-e42ee1190c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:27.802410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b163c62-c325-4c86-8c4f-e42ee1190c14 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:27.802690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b163c62-c325-4c86-8c4f-e42ee1190c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:27.802962 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b163c62-c325-4c86-8c4f-e42ee1190c14 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:27.803646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b163c62-c325-4c86-8c4f-e42ee1190c14 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:27.803970 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b163c62-c325-4c86-8c4f-e42ee1190c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:27.805173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a8fcc-7afc-40c7-bf38-f077f5604424 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:27.805364 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b163c62-c325-4c86-8c4f-e42ee1190c14 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:27.807356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a8fcc-7afc-40c7-bf38-f077f5604424 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:27.814280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 259/516] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:27.815106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b163c62-c325-4c86-8c4f-e42ee1190c14 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d53a8fcc-7afc-40c7-bf38-f077f5604424 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:27.819614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:27.824249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:27.825154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:27.825154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:27.825154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:27.825154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:27.825154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:27.825154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:27.825154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:27.825154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:27.825154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:25:27.825154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:27.825154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 258/517] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:27.825154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a8fcc-7afc-40c7-bf38-f077f5604424 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:27.920963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b163c62-c325-4c86-8c4f-e42ee1190c14 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:27.922909 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.925593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a8fcc-7afc-40c7-bf38-f077f5604424 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:27.945535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:27.956422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6a9c4-9bff-43de-9714-8d4aa3a35f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:27.957112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6a9c4-9bff-43de-9714-8d4aa3a35f3c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:27.957393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6a9c4-9bff-43de-9714-8d4aa3a35f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:27.957666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6a9c4-9bff-43de-9714-8d4aa3a35f3c None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:27.958351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6a9c4-9bff-43de-9714-8d4aa3a35f3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:27.958652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6a9c4-9bff-43de-9714-8d4aa3a35f3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:27.959613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02932e6b-a505-4faa-9e8f-9c253e78fb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:27.960208 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6a9c4-9bff-43de-9714-8d4aa3a35f3c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:27.960310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02932e6b-a505-4faa-9e8f-9c253e78fb46 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:27.960573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02932e6b-a505-4faa-9e8f-9c253e78fb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:27.960840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02932e6b-a505-4faa-9e8f-9c253e78fb46 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:27.961467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02932e6b-a505-4faa-9e8f-9c253e78fb46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:27.963271 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02932e6b-a505-4faa-9e8f-9c253e78fb46 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:27.978880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 260/518] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:27.979745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6a9c4-9bff-43de-9714-8d4aa3a35f3c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:28.041707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 259/519] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:25:27 2022] POST /identity/v3/users => generated 247 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:25:28.042857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02932e6b-a505-4faa-9e8f-9c253e78fb46 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:28.098115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6a9c4-9bff-43de-9714-8d4aa3a35f3c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:28.143408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd1263-f760-4981-a4de-78a1dc4706c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:28.144096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd1263-f760-4981-a4de-78a1dc4706c2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:28.144424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd1263-f760-4981-a4de-78a1dc4706c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:28.144635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd1263-f760-4981-a4de-78a1dc4706c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:28.145300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd1263-f760-4981-a4de-78a1dc4706c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:28.145868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd1263-f760-4981-a4de-78a1dc4706c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:28.147299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd1263-f760-4981-a4de-78a1dc4706c2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:28.162891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 261/520] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:28.164180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd1263-f760-4981-a4de-78a1dc4706c2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:28.179826 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02932e6b-a505-4faa-9e8f-9c253e78fb46 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:28.196956 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:28.225604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2e71-fa5f-4e89-9490-8d6be4b2dddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:28.226545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2e71-fa5f-4e89-9490-8d6be4b2dddc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:28.227005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2e71-fa5f-4e89-9490-8d6be4b2dddc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:28.227443 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2e71-fa5f-4e89-9490-8d6be4b2dddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:28.243106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de2e71-fa5f-4e89-9490-8d6be4b2dddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:28.245546 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de2e71-fa5f-4e89-9490-8d6be4b2dddc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-65de2e71-fa5f-4e89-9490-8d6be4b2dddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:28.262210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:28.263197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:28.264084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:28.264084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:28.264084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:28.264371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 260/521] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:28.265225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2e71-fa5f-4e89-9490-8d6be4b2dddc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:28.297840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd1263-f760-4981-a4de-78a1dc4706c2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:28.301049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:28.335501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655e8e8-b39a-4ce4-abe8-bf43b4502a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:28.336268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655e8e8-b39a-4ce4-abe8-bf43b4502a2a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:28.336643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655e8e8-b39a-4ce4-abe8-bf43b4502a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:28.337035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655e8e8-b39a-4ce4-abe8-bf43b4502a2a None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:28.338360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655e8e8-b39a-4ce4-abe8-bf43b4502a2a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:28.338781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655e8e8-b39a-4ce4-abe8-bf43b4502a2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:28.340348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655e8e8-b39a-4ce4-abe8-bf43b4502a2a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:28.363988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 262/522] 10.222.0.91 () {56 vars in 1139 bytes} [Wed Aug 24 10:25:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:28.363988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655e8e8-b39a-4ce4-abe8-bf43b4502a2a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:28.385194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2e71-fa5f-4e89-9490-8d6be4b2dddc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:28.426896 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bad85-ec2b-45f2-974f-7dc8cc51a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:28.427925 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bad85-ec2b-45f2-974f-7dc8cc51a142 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:28.428393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bad85-ec2b-45f2-974f-7dc8cc51a142 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:28.428870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bad85-ec2b-45f2-974f-7dc8cc51a142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:28.429743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bad85-ec2b-45f2-974f-7dc8cc51a142 None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=4ae21e13a4414168bd1741dfd642274a) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:28.430321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bad85-ec2b-45f2-974f-7dc8cc51a142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:28.432008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bad85-ec2b-45f2-974f-7dc8cc51a142 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:28.438286 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 261/523] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:28 2022] GET /identity/v3/role_assignments?user.id=4ae21e13a4414168bd1741dfd642274a&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:28.439123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bad85-ec2b-45f2-974f-7dc8cc51a142 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:28.471450 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:28.498898 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655e8e8-b39a-4ce4-abe8-bf43b4502a2a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:28.553616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee41122-42a5-4074-bdd6-2e0e35dc744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:28.554289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee41122-42a5-4074-bdd6-2e0e35dc744e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:28.554577 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee41122-42a5-4074-bdd6-2e0e35dc744e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:28.554851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee41122-42a5-4074-bdd6-2e0e35dc744e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:28.563362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee41122-42a5-4074-bdd6-2e0e35dc744e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:28.564985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee41122-42a5-4074-bdd6-2e0e35dc744e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:28.567295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:28.577803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bad85-ec2b-45f2-974f-7dc8cc51a142 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0ee41122-42a5-4074-bdd6-2e0e35dc744e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:28.580214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:28.588047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:28.589113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:28.589113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:28.589113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:28.589113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:28.589113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:28.589113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:28.589113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:28.589113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:28.589113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 263/524] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:28.589113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee41122-42a5-4074-bdd6-2e0e35dc744e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:28.624409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0c356-7c3e-4559-910c-23b25ee9f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:28.625031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0c356-7c3e-4559-910c-23b25ee9f9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:28.625312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0c356-7c3e-4559-910c-23b25ee9f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:28.625608 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0c356-7c3e-4559-910c-23b25ee9f9f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:28.627086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0c356-7c3e-4559-910c-23b25ee9f9f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:28.628775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0c356-7c3e-4559-910c-23b25ee9f9f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:28.630200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0c356-7c3e-4559-910c-23b25ee9f9f2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:28.648464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 262/525] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:28.650449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0c356-7c3e-4559-910c-23b25ee9f9f2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:28.709535 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee41122-42a5-4074-bdd6-2e0e35dc744e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:28.751756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2170-69ec-41f9-af5f-2f80d24a054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:28.753151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2170-69ec-41f9-af5f-2f80d24a054a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:28.753548 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2170-69ec-41f9-af5f-2f80d24a054a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:28.753923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2170-69ec-41f9-af5f-2f80d24a054a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:28.772727 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:28.793766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0c356-7c3e-4559-910c-23b25ee9f9f2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:28.848687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e00be-bc80-4dfc-adcb-671970adb6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:28.849308 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e00be-bc80-4dfc-adcb-671970adb6ed None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:28.849732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e00be-bc80-4dfc-adcb-671970adb6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:28.850023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e00be-bc80-4dfc-adcb-671970adb6ed None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:28.850723 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e00be-bc80-4dfc-adcb-671970adb6ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:28.851032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e00be-bc80-4dfc-adcb-671970adb6ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:28.853890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e00be-bc80-4dfc-adcb-671970adb6ed None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:28.863670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2170-69ec-41f9-af5f-2f80d24a054a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:28.865525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2170-69ec-41f9-af5f-2f80d24a054a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:28.881603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 263/526] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:28.885064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e00be-bc80-4dfc-adcb-671970adb6ed None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:28.906070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:29.001938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 264/527] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:29.001938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2170-69ec-41f9-af5f-2f80d24a054a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:29.025508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e00be-bc80-4dfc-adcb-671970adb6ed None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:29.047834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:29.075380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a18916-8c9d-4305-bd76-3c7e81596238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:29.076438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a18916-8c9d-4305-bd76-3c7e81596238 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:29.076615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a18916-8c9d-4305-bd76-3c7e81596238 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:29.076837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a18916-8c9d-4305-bd76-3c7e81596238 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:29.088924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a18916-8c9d-4305-bd76-3c7e81596238 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:29.090946 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a18916-8c9d-4305-bd76-3c7e81596238 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-00a18916-8c9d-4305-bd76-3c7e81596238 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:29.106494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:29.107440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:29.108358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:29.108358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:29.108358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:29.108358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:29.108358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:29.108358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:29.108358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:29.108358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:29.108358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:25:29.108358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:29.108358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 264/528] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:29.108930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a18916-8c9d-4305-bd76-3c7e81596238 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:29.122367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2170-69ec-41f9-af5f-2f80d24a054a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:29.161249 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb02fac-dbf2-4d22-aa53-3fbaaa74a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:29.162635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb02fac-dbf2-4d22-aa53-3fbaaa74a030 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:29.163131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb02fac-dbf2-4d22-aa53-3fbaaa74a030 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:29.163666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb02fac-dbf2-4d22-aa53-3fbaaa74a030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:29.164604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb02fac-dbf2-4d22-aa53-3fbaaa74a030 None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=75138f08ea2b4813b095635d920599d2) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:29.165168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb02fac-dbf2-4d22-aa53-3fbaaa74a030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:29.167071 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb02fac-dbf2-4d22-aa53-3fbaaa74a030 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:29.174406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 265/529] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:28 2022] GET /identity/v3/role_assignments?user.id=75138f08ea2b4813b095635d920599d2&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:29.175506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb02fac-dbf2-4d22-aa53-3fbaaa74a030 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:29.202306 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:29.281073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a18916-8c9d-4305-bd76-3c7e81596238 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:29.358999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb02fac-dbf2-4d22-aa53-3fbaaa74a030 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:29.360683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b348c-9e90-4484-a5e6-6da407dd9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:29.360902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b348c-9e90-4484-a5e6-6da407dd9f17 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:29.361187 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b348c-9e90-4484-a5e6-6da407dd9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:29.361459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b348c-9e90-4484-a5e6-6da407dd9f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:29.369109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:29.376873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b348c-9e90-4484-a5e6-6da407dd9f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:29.382062 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b348c-9e90-4484-a5e6-6da407dd9f17 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-374b348c-9e90-4484-a5e6-6da407dd9f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:29.407775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:29.408753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:29.409654 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:29.409654 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:29.409654 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:29.409654 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 265/530] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:29.409886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb7423-b5df-491b-aaf3-4d00a6027102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:29.409886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb7423-b5df-491b-aaf3-4d00a6027102 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:29.409886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb7423-b5df-491b-aaf3-4d00a6027102 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:29.409886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb7423-b5df-491b-aaf3-4d00a6027102 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:29.410150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb7423-b5df-491b-aaf3-4d00a6027102 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:29.410150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb7423-b5df-491b-aaf3-4d00a6027102 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:29.411214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb7423-b5df-491b-aaf3-4d00a6027102 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:29.416860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b348c-9e90-4484-a5e6-6da407dd9f17 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:29.457800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 266/531] 10.222.0.91 () {56 vars in 1137 bytes} [Wed Aug 24 10:25:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:29.462967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb7423-b5df-491b-aaf3-4d00a6027102 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:29.626223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb7423-b5df-491b-aaf3-4d00a6027102 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:29.646710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b348c-9e90-4484-a5e6-6da407dd9f17 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:29.671069 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264ee59-f940-47f2-97db-8af51919579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:29.671677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264ee59-f940-47f2-97db-8af51919579c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:29.671974 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264ee59-f940-47f2-97db-8af51919579c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:29.672296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264ee59-f940-47f2-97db-8af51919579c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:29.692197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:29.704543 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45106bef-44b0-4148-893f-949523f74461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:29.710506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45106bef-44b0-4148-893f-949523f74461 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:29.710506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45106bef-44b0-4148-893f-949523f74461 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:29.710506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45106bef-44b0-4148-893f-949523f74461 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:29.710506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45106bef-44b0-4148-893f-949523f74461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:29.710506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45106bef-44b0-4148-893f-949523f74461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:29.710506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45106bef-44b0-4148-893f-949523f74461 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:29.725144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 266/532] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:29.731587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45106bef-44b0-4148-893f-949523f74461 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:29.732875 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:29.821676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264ee59-f940-47f2-97db-8af51919579c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:29.823414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264ee59-f940-47f2-97db-8af51919579c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:29.946291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45106bef-44b0-4148-893f-949523f74461 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:29.990934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3838c45-e5b4-4744-ba7c-f19ebefdb56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:29.991572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3838c45-e5b4-4744-ba7c-f19ebefdb56e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:29.991881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3838c45-e5b4-4744-ba7c-f19ebefdb56e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:29.992148 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3838c45-e5b4-4744-ba7c-f19ebefdb56e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:30.000442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3838c45-e5b4-4744-ba7c-f19ebefdb56e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:30.002190 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3838c45-e5b4-4744-ba7c-f19ebefdb56e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a3838c45-e5b4-4744-ba7c-f19ebefdb56e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:30.015356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:30.016304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:30.017147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:30.017147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:30.017147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:30.017147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:30.017147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:30.017147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:30.017147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:30.017147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:30.018119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 267/533] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:30.023755 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3838c45-e5b4-4744-ba7c-f19ebefdb56e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:30.077706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 267/534] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:25:30.081756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264ee59-f940-47f2-97db-8af51919579c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:30.153848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:30.161546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:30.199121 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264ee59-f940-47f2-97db-8af51919579c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:30.237944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b5292-655c-4af2-b2a8-5c68d2de5ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:30.238765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b5292-655c-4af2-b2a8-5c68d2de5ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:30.239041 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b5292-655c-4af2-b2a8-5c68d2de5ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:30.239308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b5292-655c-4af2-b2a8-5c68d2de5ab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:30.253013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b5292-655c-4af2-b2a8-5c68d2de5ab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:30.254894 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b5292-655c-4af2-b2a8-5c68d2de5ab9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b31b5292-655c-4af2-b2a8-5c68d2de5ab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:30.278358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:30.279345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:30.280771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:30.280771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:30.280771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:30.280771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 268/535] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:30.281882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45696d7c-afb1-436a-aa6e-7ad95125ea6a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:30.282393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45696d7c-afb1-436a-aa6e-7ad95125ea6a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:30.284241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45696d7c-afb1-436a-aa6e-7ad95125ea6a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:30.284241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 269/536] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:30.287227 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45696d7c-afb1-436a-aa6e-7ad95125ea6a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:30.288127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3838c45-e5b4-4744-ba7c-f19ebefdb56e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:30.331864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b3096-0db6-4e12-8ac7-f3c375aba21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:30.332473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3096-0db6-4e12-8ac7-f3c375aba21c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:30.332750 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3096-0db6-4e12-8ac7-f3c375aba21c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:30.333187 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3096-0db6-4e12-8ac7-f3c375aba21c None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:30.334721 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b3096-0db6-4e12-8ac7-f3c375aba21c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:30.335034 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b3096-0db6-4e12-8ac7-f3c375aba21c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:30.336535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b3096-0db6-4e12-8ac7-f3c375aba21c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:30.352513 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 268/537] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:30.353845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10cbe9-09d0-4112-9b31-9e2e3af9a386 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:30.354138 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10cbe9-09d0-4112-9b31-9e2e3af9a386 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:30.354383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10cbe9-09d0-4112-9b31-9e2e3af9a386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:30.377345 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4e10cbe9-09d0-4112-9b31-9e2e3af9a386 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:30.378932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4e10cbe9-09d0-4112-9b31-9e2e3af9a386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:30.428766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45696d7c-afb1-436a-aa6e-7ad95125ea6a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:30.455933 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:30.472152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 269/538] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:30.473419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10cbe9-09d0-4112-9b31-9e2e3af9a386 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:30.485824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3326d2b-4ab7-46d0-a01d-972bb802d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:30.487029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3326d2b-4ab7-46d0-a01d-972bb802d757 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:30.487851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3326d2b-4ab7-46d0-a01d-972bb802d757 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:30.489750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3326d2b-4ab7-46d0-a01d-972bb802d757 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:30.490567 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3326d2b-4ab7-46d0-a01d-972bb802d757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:30.491012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3326d2b-4ab7-46d0-a01d-972bb802d757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:30.492579 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3326d2b-4ab7-46d0-a01d-972bb802d757 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:30.523189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 270/539] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:30.528933 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3326d2b-4ab7-46d0-a01d-972bb802d757 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:30.552452 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:30.645863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10cbe9-09d0-4112-9b31-9e2e3af9a386 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:30.676788 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3326d2b-4ab7-46d0-a01d-972bb802d757 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:30.686509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6620b8-f0c0-4484-8587-e51f2f9ae2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:30.687282 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6620b8-f0c0-4484-8587-e51f2f9ae2eb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:30.687666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6620b8-f0c0-4484-8587-e51f2f9ae2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:30.688078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6620b8-f0c0-4484-8587-e51f2f9ae2eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:30.689496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6620b8-f0c0-4484-8587-e51f2f9ae2eb None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=8956453f963242a087d2f90d70ed8f8f) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:30.690169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6620b8-f0c0-4484-8587-e51f2f9ae2eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:30.691891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6620b8-f0c0-4484-8587-e51f2f9ae2eb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:30.699931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 270/540] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:30 2022] GET /identity/v3/role_assignments?user.id=8956453f963242a087d2f90d70ed8f8f&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:30.701352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa955f46-70d1-4156-8547-612a3edde7f9 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:30.701751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa955f46-70d1-4156-8547-612a3edde7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:30.702149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa955f46-70d1-4156-8547-612a3edde7f9 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:30.704588 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 271/541] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:30.736106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0cbe0-807f-4ef5-9ab0-39241a14c433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:30.736673 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0cbe0-807f-4ef5-9ab0-39241a14c433 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:30.736950 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0cbe0-807f-4ef5-9ab0-39241a14c433 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:30.737283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0cbe0-807f-4ef5-9ab0-39241a14c433 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:30.737689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa45f7-1cd3-4632-b686-b07d61584586 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:30.738069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa45f7-1cd3-4632-b686-b07d61584586 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:30.738445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa45f7-1cd3-4632-b686-b07d61584586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:30.745758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0cbe0-807f-4ef5-9ab0-39241a14c433 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:30.747515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0cbe0-807f-4ef5-9ab0-39241a14c433 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-10b0cbe0-807f-4ef5-9ab0-39241a14c433 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:30.765361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:30.766275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:30.771404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:30.771404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:30.771404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:30.771404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:30.771404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:30.771404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:30.771404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:30.771404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:30.771404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 271/542] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:30.771404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0cbe0-807f-4ef5-9ab0-39241a14c433 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:30.778323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-49aa45f7-1cd3-4632-b686-b07d61584586 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:30.779775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-49aa45f7-1cd3-4632-b686-b07d61584586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:30.823541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:30.861445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 272/543] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:30.862723 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa45f7-1cd3-4632-b686-b07d61584586 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:30.894666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:30.929685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0cbe0-807f-4ef5-9ab0-39241a14c433 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:31.002099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa45f7-1cd3-4632-b686-b07d61584586 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:31.017051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e184d-f797-4485-8245-7db234aa4d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:31.017704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e184d-f797-4485-8245-7db234aa4d50 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:31.017986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e184d-f797-4485-8245-7db234aa4d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:31.018259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e184d-f797-4485-8245-7db234aa4d50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:31.043461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87813179-87f1-4e07-b356-7d23bbc7f09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:31.044573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87813179-87f1-4e07-b356-7d23bbc7f09d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:31.045079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87813179-87f1-4e07-b356-7d23bbc7f09d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:31.045549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87813179-87f1-4e07-b356-7d23bbc7f09d None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:31.046440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87813179-87f1-4e07-b356-7d23bbc7f09d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:31.046938 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87813179-87f1-4e07-b356-7d23bbc7f09d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:31.048606 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87813179-87f1-4e07-b356-7d23bbc7f09d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:31.054789 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e184d-f797-4485-8245-7db234aa4d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-259e184d-f797-4485-8245-7db234aa4d50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:31.059661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:31.060578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:31.061371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 272/544] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:31.070127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 273/545] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:31.072079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e184d-f797-4485-8245-7db234aa4d50 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:31.079457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87813179-87f1-4e07-b356-7d23bbc7f09d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:31.189660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:31.205625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87813179-87f1-4e07-b356-7d23bbc7f09d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:31.243899 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df5f1-e179-4b56-be49-cf4908ff8625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:31.244991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df5f1-e179-4b56-be49-cf4908ff8625 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:31.245468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df5f1-e179-4b56-be49-cf4908ff8625 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:31.245935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df5f1-e179-4b56-be49-cf4908ff8625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:31.246864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32df5f1-e179-4b56-be49-cf4908ff8625 None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=dc05a509ea1c4aa582380541cfc37989) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:31.247367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32df5f1-e179-4b56-be49-cf4908ff8625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:31.249087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32df5f1-e179-4b56-be49-cf4908ff8625 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:31.255566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 274/546] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:31 2022] GET /identity/v3/role_assignments?user.id=dc05a509ea1c4aa582380541cfc37989&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:31.256649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df5f1-e179-4b56-be49-cf4908ff8625 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:31.277215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:31.283975 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e184d-f797-4485-8245-7db234aa4d50 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:31.350747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b76d5-e8f2-448d-a287-cd74280f0518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:31.351365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b76d5-e8f2-448d-a287-cd74280f0518 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:31.351810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b76d5-e8f2-448d-a287-cd74280f0518 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:31.351912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b76d5-e8f2-448d-a287-cd74280f0518 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:31.352638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b76d5-e8f2-448d-a287-cd74280f0518 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:31.353984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b76d5-e8f2-448d-a287-cd74280f0518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:31.355628 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b76d5-e8f2-448d-a287-cd74280f0518 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:31.372858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 273/547] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:31.379282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b76d5-e8f2-448d-a287-cd74280f0518 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:31.381775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df5f1-e179-4b56-be49-cf4908ff8625 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:31.422279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0b373-e96c-43b6-8812-79a1a0e8afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:31.423280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0b373-e96c-43b6-8812-79a1a0e8afad None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:31.423832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0b373-e96c-43b6-8812-79a1a0e8afad None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:31.424303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0b373-e96c-43b6-8812-79a1a0e8afad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:31.437138 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0b373-e96c-43b6-8812-79a1a0e8afad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-8fc0b373-e96c-43b6-8812-79a1a0e8afad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:31.442974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:31.444023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:31.444824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:31.444824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:31.444824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:31.444824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:31.444824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:31.444824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:31.444824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:31.444824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:31.444824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:31.444824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:31.444824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:31.444824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:31.448098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 275/548] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:31.453366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2976-364a-423a-aad7-aa17d903fe89 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:31.453366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2976-364a-423a-aad7-aa17d903fe89 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:31.454395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2976-364a-423a-aad7-aa17d903fe89 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:31.455989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 276/549] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:31.460779 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f2976-364a-423a-aad7-aa17d903fe89 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:31.479407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:31.537508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b76d5-e8f2-448d-a287-cd74280f0518 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:31.581658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fba6c-be3f-405c-8dcb-bbbcad78dc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:31.583168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fba6c-be3f-405c-8dcb-bbbcad78dc86 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:31.583638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fba6c-be3f-405c-8dcb-bbbcad78dc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:31.584424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fba6c-be3f-405c-8dcb-bbbcad78dc86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:31.598900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f2976-364a-423a-aad7-aa17d903fe89 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:31.599586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fba6c-be3f-405c-8dcb-bbbcad78dc86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:31.602429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fba6c-be3f-405c-8dcb-bbbcad78dc86 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a57fba6c-be3f-405c-8dcb-bbbcad78dc86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:31.621147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:31.622302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:31.623337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:31.623337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:31.623337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:31.630036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 274/550] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:31.630036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86f396-dfd8-4cb9-962a-cd7513a31d62 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:31.630036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86f396-dfd8-4cb9-962a-cd7513a31d62 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:31.630036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86f396-dfd8-4cb9-962a-cd7513a31d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:31.652228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cc870-49de-4100-ae20-7421fdd61cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:31.652900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cc870-49de-4100-ae20-7421fdd61cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:31.653181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cc870-49de-4100-ae20-7421fdd61cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:31.653455 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cc870-49de-4100-ae20-7421fdd61cd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:31.654181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cc870-49de-4100-ae20-7421fdd61cd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:31.654487 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cc870-49de-4100-ae20-7421fdd61cd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:31.656090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cc870-49de-4100-ae20-7421fdd61cd0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:31.656343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1e86f396-dfd8-4cb9-962a-cd7513a31d62 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:31.658072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1e86f396-dfd8-4cb9-962a-cd7513a31d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:31.661941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:31.667304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 277/551] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:31.669263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cc870-49de-4100-ae20-7421fdd61cd0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:31.750477 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 275/552] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:31.755874 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86f396-dfd8-4cb9-962a-cd7513a31d62 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:31.778382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:31.827866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cc870-49de-4100-ae20-7421fdd61cd0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:31.868584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86f396-dfd8-4cb9-962a-cd7513a31d62 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:31.896711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59985c-ffd8-41c6-83b7-c3778a204f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:31.897327 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59985c-ffd8-41c6-83b7-c3778a204f04 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:31.897565 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59985c-ffd8-41c6-83b7-c3778a204f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:31.897834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59985c-ffd8-41c6-83b7-c3778a204f04 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:31.898489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59985c-ffd8-41c6-83b7-c3778a204f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:31.898792 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59985c-ffd8-41c6-83b7-c3778a204f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:31.900913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59985c-ffd8-41c6-83b7-c3778a204f04 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:31.914219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9a67c-5653-470d-98fd-5a175b9b994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:31.915794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9a67c-5653-470d-98fd-5a175b9b994c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:31.916492 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9a67c-5653-470d-98fd-5a175b9b994c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:31.917179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9a67c-5653-470d-98fd-5a175b9b994c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:31.930228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:31.938119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 278/553] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:31.939515 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59985c-ffd8-41c6-83b7-c3778a204f04 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:31.940605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9a67c-5653-470d-98fd-5a175b9b994c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:31.943943 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9a67c-5653-470d-98fd-5a175b9b994c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-25d9a67c-5653-470d-98fd-5a175b9b994c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:31.964606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:31.965606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:31.966504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:31.966504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:31.966504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:31.968861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 276/554] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:31.974818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9a67c-5653-470d-98fd-5a175b9b994c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:32.065927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59985c-ffd8-41c6-83b7-c3778a204f04 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:32.113048 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3a70-27a0-4a44-9edc-164b15e720e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:32.113602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3a70-27a0-4a44-9edc-164b15e720e5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:32.113882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3a70-27a0-4a44-9edc-164b15e720e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:32.114186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3a70-27a0-4a44-9edc-164b15e720e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:32.116301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:32.122726 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff3a70-27a0-4a44-9edc-164b15e720e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:32.124304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff3a70-27a0-4a44-9edc-164b15e720e5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:32.126255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9a67c-5653-470d-98fd-5a175b9b994c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-79ff3a70-27a0-4a44-9edc-164b15e720e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:32.136980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:32.137956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:32.139285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:32.139285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:32.139285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:32.139285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:32.139285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:32.139285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:32.139285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:32.139285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:32.139285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:25:32.139285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:32.139285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 279/555] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:32.144267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3a70-27a0-4a44-9edc-164b15e720e5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:32.170444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b95d36-96d2-4c8d-84a8-4c460f325978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:32.171443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b95d36-96d2-4c8d-84a8-4c460f325978 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:32.171972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b95d36-96d2-4c8d-84a8-4c460f325978 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:32.172487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b95d36-96d2-4c8d-84a8-4c460f325978 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:32.173473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b95d36-96d2-4c8d-84a8-4c460f325978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:32.174180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b95d36-96d2-4c8d-84a8-4c460f325978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:32.175851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b95d36-96d2-4c8d-84a8-4c460f325978 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:32.190541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 277/556] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:32.196249 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b95d36-96d2-4c8d-84a8-4c460f325978 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:32.256370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:32.269639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3a70-27a0-4a44-9edc-164b15e720e5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:32.308486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4759c29-18df-48ce-b846-6f5072bf71ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:32.309427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4759c29-18df-48ce-b846-6f5072bf71ff None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:32.309921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4759c29-18df-48ce-b846-6f5072bf71ff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:32.310405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4759c29-18df-48ce-b846-6f5072bf71ff None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:32.311343 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4759c29-18df-48ce-b846-6f5072bf71ff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:32.311656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b95d36-96d2-4c8d-84a8-4c460f325978 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:32.312455 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4759c29-18df-48ce-b846-6f5072bf71ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:32.314352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4759c29-18df-48ce-b846-6f5072bf71ff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:32.339828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 280/557] 10.222.0.91 () {56 vars in 1135 bytes} [Wed Aug 24 10:25:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:32.341230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4759c29-18df-48ce-b846-6f5072bf71ff None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:32.350300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb7709-b4e3-4a54-ae23-4da2dbc01b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:32.350992 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7709-b4e3-4a54-ae23-4da2dbc01b52 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:32.351272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7709-b4e3-4a54-ae23-4da2dbc01b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:32.351627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7709-b4e3-4a54-ae23-4da2dbc01b52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:32.360685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb7709-b4e3-4a54-ae23-4da2dbc01b52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:32.362165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb7709-b4e3-4a54-ae23-4da2dbc01b52 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-dafb7709-b4e3-4a54-ae23-4da2dbc01b52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:32.375940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:32.377377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:32.378319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:32.378319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:32.378319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:32.378319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:32.378319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:32.378319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:32.378319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:32.378319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:32.378319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:25:32.378319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:32.378319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 278/558] 10.222.0.91 () {56 vars in 1093 bytes} [Wed Aug 24 10:25:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:32.382760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb7709-b4e3-4a54-ae23-4da2dbc01b52 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:32.407671 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:32.460699 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4759c29-18df-48ce-b846-6f5072bf71ff None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:32.501003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb7709-b4e3-4a54-ae23-4da2dbc01b52 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:32.501438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58170a1d-9c53-4e88-857e-3c1202225a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:32.502214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58170a1d-9c53-4e88-857e-3c1202225a6a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:32.502633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58170a1d-9c53-4e88-857e-3c1202225a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:32.503006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58170a1d-9c53-4e88-857e-3c1202225a6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:32.522257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:32.526704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58170a1d-9c53-4e88-857e-3c1202225a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-58170a1d-9c53-4e88-857e-3c1202225a6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:32.534155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:32.535383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:32.536560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:32.536560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:32.536560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:32.536560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:32.536560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:32.536560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:32.536560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:32.536560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:32.536560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:32.536560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:32.536560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:32.536560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:32.539799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 281/559] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:32.541916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58170a1d-9c53-4e88-857e-3c1202225a6a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:32.551443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76873dc-57fb-40d9-bea4-0130ad604663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:32.552265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76873dc-57fb-40d9-bea4-0130ad604663 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:32.552732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76873dc-57fb-40d9-bea4-0130ad604663 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:32.553112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76873dc-57fb-40d9-bea4-0130ad604663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:32.657868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76873dc-57fb-40d9-bea4-0130ad604663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:32.660581 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76873dc-57fb-40d9-bea4-0130ad604663 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:32.696680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58170a1d-9c53-4e88-857e-3c1202225a6a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:32.715844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:32.753836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ba166-d700-4220-8192-caacd09e8131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:32.754607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ba166-d700-4220-8192-caacd09e8131 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:32.754989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ba166-d700-4220-8192-caacd09e8131 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:32.755357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ba166-d700-4220-8192-caacd09e8131 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:32.756224 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ba166-d700-4220-8192-caacd09e8131 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:32.756627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ba166-d700-4220-8192-caacd09e8131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:32.758177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ba166-d700-4220-8192-caacd09e8131 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:32.783194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 282/560] 10.222.0.91 () {56 vars in 1133 bytes} [Wed Aug 24 10:25:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:32.784267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ba166-d700-4220-8192-caacd09e8131 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:32.814510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 279/561] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:32.815681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76873dc-57fb-40d9-bea4-0130ad604663 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:32.832586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:32.930723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76873dc-57fb-40d9-bea4-0130ad604663 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:32.961881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ba166-d700-4220-8192-caacd09e8131 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:32.968792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca096b-47e4-424d-8f53-21ca2b33cc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:32.969424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca096b-47e4-424d-8f53-21ca2b33cc53 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:32.969696 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca096b-47e4-424d-8f53-21ca2b33cc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:32.969958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca096b-47e4-424d-8f53-21ca2b33cc53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:32.984785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca096b-47e4-424d-8f53-21ca2b33cc53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:32.984785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca096b-47e4-424d-8f53-21ca2b33cc53 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f8ca096b-47e4-424d-8f53-21ca2b33cc53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:33.003767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:33.004972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:33.006048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:33.006048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:33.006048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:33.007462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 280/562] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:33.008462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca096b-47e4-424d-8f53-21ca2b33cc53 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:33.015317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ac631-3d3f-4ebc-9467-6a25fa4d0776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:33.016099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ac631-3d3f-4ebc-9467-6a25fa4d0776 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.016552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ac631-3d3f-4ebc-9467-6a25fa4d0776 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.016932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ac631-3d3f-4ebc-9467-6a25fa4d0776 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.017708 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ac631-3d3f-4ebc-9467-6a25fa4d0776 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:33.018124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ac631-3d3f-4ebc-9467-6a25fa4d0776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:33.019607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ac631-3d3f-4ebc-9467-6a25fa4d0776 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:33.032749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 283/563] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:33.034023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf3216-12e6-49ae-a5a4-83768a8e0d63 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.034309 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf3216-12e6-49ae-a5a4-83768a8e0d63 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.034590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf3216-12e6-49ae-a5a4-83768a8e0d63 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.036129 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 284/564] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:33.036845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf3216-12e6-49ae-a5a4-83768a8e0d63 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:33.074760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:33.086960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:33.129695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca096b-47e4-424d-8f53-21ca2b33cc53 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:33.158519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf3216-12e6-49ae-a5a4-83768a8e0d63 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:33.174834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd62492-484b-4c7e-8f0b-377a59b6b313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:33.175515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd62492-484b-4c7e-8f0b-377a59b6b313 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.175908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd62492-484b-4c7e-8f0b-377a59b6b313 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.176255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd62492-484b-4c7e-8f0b-377a59b6b313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.188346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd62492-484b-4c7e-8f0b-377a59b6b313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:33.189801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd62492-484b-4c7e-8f0b-377a59b6b313 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:33.198218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc004895-4a3d-4208-94d5-b0137fd40ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:33.199000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc004895-4a3d-4208-94d5-b0137fd40ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.199347 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc004895-4a3d-4208-94d5-b0137fd40ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.199737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc004895-4a3d-4208-94d5-b0137fd40ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.200450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc004895-4a3d-4208-94d5-b0137fd40ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:33.200815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc004895-4a3d-4208-94d5-b0137fd40ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:33.202272 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc004895-4a3d-4208-94d5-b0137fd40ec0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4bd62492-484b-4c7e-8f0b-377a59b6b313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:33.205377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:33.206497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:33.212831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:33.212831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:33.212831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:33.212831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 281/565] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:33.212831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd62492-484b-4c7e-8f0b-377a59b6b313 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:33.223926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 285/566] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:33.223926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487618c-9708-45b8-919b-9e1c13b24503 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.223926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487618c-9708-45b8-919b-9e1c13b24503 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.223926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487618c-9708-45b8-919b-9e1c13b24503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.243075 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0487618c-9708-45b8-919b-9e1c13b24503 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:33.244248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0487618c-9708-45b8-919b-9e1c13b24503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:33.333304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 286/567] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:33.334180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487618c-9708-45b8-919b-9e1c13b24503 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:33.361535 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd62492-484b-4c7e-8f0b-377a59b6b313 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:33.363618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:33.386456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:33.411511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be49da-d232-4216-b2d0-9f78f914dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:33.412460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be49da-d232-4216-b2d0-9f78f914dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.413057 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be49da-d232-4216-b2d0-9f78f914dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.413497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be49da-d232-4216-b2d0-9f78f914dcc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.428798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be49da-d232-4216-b2d0-9f78f914dcc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:33.430689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be49da-d232-4216-b2d0-9f78f914dcc1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-63be49da-d232-4216-b2d0-9f78f914dcc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:33.452624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:33.454786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:33.455961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:33.455961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:33.455961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:33.456175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487618c-9708-45b8-919b-9e1c13b24503 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:33.458975 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 282/568] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:33.460047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be49da-d232-4216-b2d0-9f78f914dcc1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:33.505779 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4a103-4755-46c2-9b6b-dd4e12389aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:33.506405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4a103-4755-46c2-9b6b-dd4e12389aff None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.507068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4a103-4755-46c2-9b6b-dd4e12389aff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.507349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4a103-4755-46c2-9b6b-dd4e12389aff None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.508356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4a103-4755-46c2-9b6b-dd4e12389aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:33.508672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4a103-4755-46c2-9b6b-dd4e12389aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:33.511228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4a103-4755-46c2-9b6b-dd4e12389aff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:33.531548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 287/569] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:33.531548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4a103-4755-46c2-9b6b-dd4e12389aff None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:33.572533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be49da-d232-4216-b2d0-9f78f914dcc1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:33.610030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24d7ae-0152-41f8-905e-f52bc2bc5153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:33.611119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24d7ae-0152-41f8-905e-f52bc2bc5153 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.611475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24d7ae-0152-41f8-905e-f52bc2bc5153 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.611779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24d7ae-0152-41f8-905e-f52bc2bc5153 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.621473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24d7ae-0152-41f8-905e-f52bc2bc5153 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:33.623012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24d7ae-0152-41f8-905e-f52bc2bc5153 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:33.630759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9e24d7ae-0152-41f8-905e-f52bc2bc5153 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:33.635899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:33.636862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:33.637761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:33.637761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:33.637761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:33.637761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:33.637761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:33.637761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:33.637761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:33.637761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:33.637761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 283/570] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:33.638766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c2193-a37a-42ea-917e-c375fdbf1d45 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.638766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c2193-a37a-42ea-917e-c375fdbf1d45 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.638947 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c2193-a37a-42ea-917e-c375fdbf1d45 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.640307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 284/571] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:33.644572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c2193-a37a-42ea-917e-c375fdbf1d45 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:33.651959 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4a103-4755-46c2-9b6b-dd4e12389aff None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:33.677035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:33.687659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a595e7-6952-449f-8fc9-c7decabe4672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:33.688367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a595e7-6952-449f-8fc9-c7decabe4672 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.688713 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a595e7-6952-449f-8fc9-c7decabe4672 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.688993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a595e7-6952-449f-8fc9-c7decabe4672 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.689669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a595e7-6952-449f-8fc9-c7decabe4672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:33.689976 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a595e7-6952-449f-8fc9-c7decabe4672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:33.691439 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a595e7-6952-449f-8fc9-c7decabe4672 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:33.704338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 288/572] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:33.705586 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a595e7-6952-449f-8fc9-c7decabe4672 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:33.759608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c2193-a37a-42ea-917e-c375fdbf1d45 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:33.795333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e76409-1b8c-4c78-96b1-21f0db9171d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:33.796000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e76409-1b8c-4c78-96b1-21f0db9171d7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.796280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e76409-1b8c-4c78-96b1-21f0db9171d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.796553 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e76409-1b8c-4c78-96b1-21f0db9171d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.803426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e76409-1b8c-4c78-96b1-21f0db9171d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:33.804937 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e76409-1b8c-4c78-96b1-21f0db9171d7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:33.810491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a595e7-6952-449f-8fc9-c7decabe4672 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-52e76409-1b8c-4c78-96b1-21f0db9171d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:33.816641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:33.817526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:33.818434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:33.818434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:33.818434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:33.818434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:33.818434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:33.818434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:33.818434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:33.818434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:33.819854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 285/573] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:33.820845 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e76409-1b8c-4c78-96b1-21f0db9171d7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:33.848299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f3cb6-e5ed-490a-b64b-a4356ac56045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:33.848938 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3cb6-e5ed-490a-b64b-a4356ac56045 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.849217 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3cb6-e5ed-490a-b64b-a4356ac56045 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.849488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3cb6-e5ed-490a-b64b-a4356ac56045 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.861182 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f3cb6-e5ed-490a-b64b-a4356ac56045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d11f3cb6-e5ed-490a-b64b-a4356ac56045 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:33.865971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:33.866997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:33.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 289/574] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:33.869974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a68b32-a8d0-493b-9440-b9cb9010e708 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.869974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a68b32-a8d0-493b-9440-b9cb9010e708 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.869974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a68b32-a8d0-493b-9440-b9cb9010e708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.876639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:33.887920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-28a68b32-a8d0-493b-9440-b9cb9010e708 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:33.889135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-28a68b32-a8d0-493b-9440-b9cb9010e708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:33.919339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:33.931699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e76409-1b8c-4c78-96b1-21f0db9171d7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:33.971817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 290/575] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:33.971817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a68b32-a8d0-493b-9440-b9cb9010e708 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:33.972086 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f9dd6-ec2e-425a-92b5-dc64a3794465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:33.972086 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f9dd6-ec2e-425a-92b5-dc64a3794465 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:33.972086 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f9dd6-ec2e-425a-92b5-dc64a3794465 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:33.972086 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f9dd6-ec2e-425a-92b5-dc64a3794465 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:33.972341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f9dd6-ec2e-425a-92b5-dc64a3794465 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:33.972416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f9dd6-ec2e-425a-92b5-dc64a3794465 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:33.973916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f9dd6-ec2e-425a-92b5-dc64a3794465 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:33.988151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 286/576] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:33.988151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f9dd6-ec2e-425a-92b5-dc64a3794465 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:34.099169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a68b32-a8d0-493b-9440-b9cb9010e708 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:34.105058 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f9dd6-ec2e-425a-92b5-dc64a3794465 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:34.134976 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:34.140853 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554934eb-7648-4cdd-a2aa-a825a40f4f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:34.141566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554934eb-7648-4cdd-a2aa-a825a40f4f15 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:34.141852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554934eb-7648-4cdd-a2aa-a825a40f4f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:34.142126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554934eb-7648-4cdd-a2aa-a825a40f4f15 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:34.144117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ae1f-096d-441f-9180-4938359fa722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:34.144590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ae1f-096d-441f-9180-4938359fa722 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:34.144872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ae1f-096d-441f-9180-4938359fa722 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:34.145135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ae1f-096d-441f-9180-4938359fa722 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:34.146092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7ae1f-096d-441f-9180-4938359fa722 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:34.146528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7ae1f-096d-441f-9180-4938359fa722 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:34.148028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7ae1f-096d-441f-9180-4938359fa722 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:34.152490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554934eb-7648-4cdd-a2aa-a825a40f4f15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:34.154078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554934eb-7648-4cdd-a2aa-a825a40f4f15 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:34.160596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 287/577] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:34.161560 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ae1f-096d-441f-9180-4938359fa722 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-554934eb-7648-4cdd-a2aa-a825a40f4f15 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:34.173787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:34.174977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:34.176170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:34.176170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:34.176170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:34.176170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:34.176170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:34.176170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:34.176170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:34.176170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:34.176170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:25:34.176170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:34.179852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 291/578] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:34.180643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554934eb-7648-4cdd-a2aa-a825a40f4f15 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:34.182688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:34.279690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ae1f-096d-441f-9180-4938359fa722 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:34.286136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554934eb-7648-4cdd-a2aa-a825a40f4f15 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:34.315476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175198ee-1455-499a-a949-08b690c29a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:34.316112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175198ee-1455-499a-a949-08b690c29a82 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:34.316390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175198ee-1455-499a-a949-08b690c29a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:34.316677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175198ee-1455-499a-a949-08b690c29a82 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:34.317341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175198ee-1455-499a-a949-08b690c29a82 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:34.317644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175198ee-1455-499a-a949-08b690c29a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:34.319029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175198ee-1455-499a-a949-08b690c29a82 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:34.321239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cab59-f42b-45c7-924b-118ffc5a1813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:34.322162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cab59-f42b-45c7-924b-118ffc5a1813 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:34.322505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cab59-f42b-45c7-924b-118ffc5a1813 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:34.322795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cab59-f42b-45c7-924b-118ffc5a1813 None admin] PATH_INFO: `/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/4ae21e13a4414168bd1741dfd642274a/roles/baff7a1fa3b34f2fb1062f71bbb73c7f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:34.328348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 288/579] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:34.329001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175198ee-1455-499a-a949-08b690c29a82 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:34.339877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cab59-f42b-45c7-924b-118ffc5a1813 None admin] RBAC: Authorizing `identity:create_grant(project_id=acd807f8a28d43cdac159fa3d606af60, user_id=4ae21e13a4414168bd1741dfd642274a, role_id=baff7a1fa3b34f2fb1062f71bbb73c7f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:34.341324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cab59-f42b-45c7-924b-118ffc5a1813 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:34.406692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:34.420810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 292/580] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:25:34 2022] PUT /identity/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/4ae21e13a4414168bd1741dfd642274a/roles/baff7a1fa3b34f2fb1062f71bbb73c7f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:25:34.421725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cab59-f42b-45c7-924b-118ffc5a1813 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:34.440614 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175198ee-1455-499a-a949-08b690c29a82 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:34.486519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:34.487331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2dc17-90bc-420a-a4a9-48199632147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:34.487994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2dc17-90bc-420a-a4a9-48199632147e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:34.488274 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2dc17-90bc-420a-a4a9-48199632147e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:34.488544 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2dc17-90bc-420a-a4a9-48199632147e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:34.489294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2dc17-90bc-420a-a4a9-48199632147e None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=4671efa1526643cdb32f56d44903db1d) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:34.489601 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2dc17-90bc-420a-a4a9-48199632147e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:34.491076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2dc17-90bc-420a-a4a9-48199632147e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:34.505959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 289/581] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:34 2022] GET /identity/v3/role_assignments?user.id=4671efa1526643cdb32f56d44903db1d&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:34.505959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2dc17-90bc-420a-a4a9-48199632147e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:34.590344 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cab59-f42b-45c7-924b-118ffc5a1813 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:34.646776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2dc17-90bc-420a-a4a9-48199632147e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:34.647691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69991a-2cc4-42ba-ac0c-717cd50ae5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:34.648347 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69991a-2cc4-42ba-ac0c-717cd50ae5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:34.648794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69991a-2cc4-42ba-ac0c-717cd50ae5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:34.649066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69991a-2cc4-42ba-ac0c-717cd50ae5a4 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:34.651866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69991a-2cc4-42ba-ac0c-717cd50ae5a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:34.651866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69991a-2cc4-42ba-ac0c-717cd50ae5a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:34.652629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69991a-2cc4-42ba-ac0c-717cd50ae5a4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:34.673080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 293/582] 10.222.0.91 () {56 vars in 1137 bytes} [Wed Aug 24 10:25:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:34.673661 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69991a-2cc4-42ba-ac0c-717cd50ae5a4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:34.694510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc755c-3fda-496f-951f-86b2244b75c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:34.695682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc755c-3fda-496f-951f-86b2244b75c3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:34.696203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc755c-3fda-496f-951f-86b2244b75c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:34.697031 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc755c-3fda-496f-951f-86b2244b75c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:34.699595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:34.718234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc755c-3fda-496f-951f-86b2244b75c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7cfc755c-3fda-496f-951f-86b2244b75c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:34.724395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:34.725558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 290/583] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:34.726833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc755c-3fda-496f-951f-86b2244b75c3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:34.812693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:34.816173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69991a-2cc4-42ba-ac0c-717cd50ae5a4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:34.860398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1acd1-87e7-4a69-a5ef-8c88a07ff621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:34.861608 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1acd1-87e7-4a69-a5ef-8c88a07ff621 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:34.862174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1acd1-87e7-4a69-a5ef-8c88a07ff621 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:34.862943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1acd1-87e7-4a69-a5ef-8c88a07ff621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:34.873828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc755c-3fda-496f-951f-86b2244b75c3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:34.877068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1acd1-87e7-4a69-a5ef-8c88a07ff621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:34.879367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1acd1-87e7-4a69-a5ef-8c88a07ff621 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c3e1acd1-87e7-4a69-a5ef-8c88a07ff621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:34.898339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:34.899564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:34.900490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:34.900490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:34.900490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:34.904598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 294/584] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:34.905734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1acd1-87e7-4a69-a5ef-8c88a07ff621 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:34.932579 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f5989-ce58-4908-a5a7-a3e31c6cc3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:34.934070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f5989-ce58-4908-a5a7-a3e31c6cc3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:34.935418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f5989-ce58-4908-a5a7-a3e31c6cc3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:34.936118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f5989-ce58-4908-a5a7-a3e31c6cc3b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:34.953592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f5989-ce58-4908-a5a7-a3e31c6cc3b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:34.955918 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f5989-ce58-4908-a5a7-a3e31c6cc3b1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-321f5989-ce58-4908-a5a7-a3e31c6cc3b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:34.976586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:34.978210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:34.979141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:34.979141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:34.979141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:34.981816 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 291/585] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:34.983604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f5989-ce58-4908-a5a7-a3e31c6cc3b1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:35.049989 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:35.051352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1acd1-87e7-4a69-a5ef-8c88a07ff621 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:35.099240 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee839b-368f-4a32-90b9-0ad9da85c0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:35.100053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee839b-368f-4a32-90b9-0ad9da85c0be None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:35.100440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee839b-368f-4a32-90b9-0ad9da85c0be None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:35.100812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee839b-368f-4a32-90b9-0ad9da85c0be None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:35.101867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee839b-368f-4a32-90b9-0ad9da85c0be None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:35.102269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee839b-368f-4a32-90b9-0ad9da85c0be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:35.105339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee839b-368f-4a32-90b9-0ad9da85c0be None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:35.114074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f5989-ce58-4908-a5a7-a3e31c6cc3b1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:35.118637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 295/586] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:35.119656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee839b-368f-4a32-90b9-0ad9da85c0be None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:35.141199 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:35.156655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd836-9822-4efd-8837-232cfa643807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:35.157572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd836-9822-4efd-8837-232cfa643807 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:35.158020 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd836-9822-4efd-8837-232cfa643807 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:35.158534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd836-9822-4efd-8837-232cfa643807 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:35.159610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dd836-9822-4efd-8837-232cfa643807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:35.160224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dd836-9822-4efd-8837-232cfa643807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:35.161929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dd836-9822-4efd-8837-232cfa643807 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:35.185466 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 292/587] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:35.187127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd836-9822-4efd-8837-232cfa643807 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:35.267618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee839b-368f-4a32-90b9-0ad9da85c0be None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:35.302949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd836-9822-4efd-8837-232cfa643807 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:35.312595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:35.315153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983a458-951a-4ca1-a987-c4036b3f342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:35.315786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983a458-951a-4ca1-a987-c4036b3f342f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:35.316652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983a458-951a-4ca1-a987-c4036b3f342f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:35.317007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983a458-951a-4ca1-a987-c4036b3f342f None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:35.317991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983a458-951a-4ca1-a987-c4036b3f342f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:35.318359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983a458-951a-4ca1-a987-c4036b3f342f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:35.320529 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983a458-951a-4ca1-a987-c4036b3f342f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:35.337736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 296/588] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:35.338614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983a458-951a-4ca1-a987-c4036b3f342f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:35.353405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ca28-0622-44c1-8c64-d235295ed864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:35.354655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ca28-0622-44c1-8c64-d235295ed864 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:35.355137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ca28-0622-44c1-8c64-d235295ed864 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:35.355628 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ca28-0622-44c1-8c64-d235295ed864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:35.372212 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8ca28-0622-44c1-8c64-d235295ed864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:35.374488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8ca28-0622-44c1-8c64-d235295ed864 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-43f8ca28-0622-44c1-8c64-d235295ed864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:35.402531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:35.403568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:35.404508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:35.404508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:35.404508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:35.408060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 293/589] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:35.408913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ca28-0622-44c1-8c64-d235295ed864 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:35.440081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:35.474039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983a458-951a-4ca1-a987-c4036b3f342f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:35.512431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b9081-d5dd-4917-a2ea-ae3d3543bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:35.513368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b9081-d5dd-4917-a2ea-ae3d3543bdad None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:35.513798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b9081-d5dd-4917-a2ea-ae3d3543bdad None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:35.514218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b9081-d5dd-4917-a2ea-ae3d3543bdad None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:35.524770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b9081-d5dd-4917-a2ea-ae3d3543bdad None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:35.527346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b9081-d5dd-4917-a2ea-ae3d3543bdad None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:35.535857 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ca28-0622-44c1-8c64-d235295ed864 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-803b9081-d5dd-4917-a2ea-ae3d3543bdad None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:35.543656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:35.545000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:35.546149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:35.546149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:35.546149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:35.546149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:35.546149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:35.546149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:35.546149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:35.546149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:35.546149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:25:35.546149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:35.548542 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 297/590] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:35.549611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b9081-d5dd-4917-a2ea-ae3d3543bdad None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:35.581868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad48772-6894-4f4f-801f-5e7f065d092c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:35.582784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad48772-6894-4f4f-801f-5e7f065d092c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:35.583252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad48772-6894-4f4f-801f-5e7f065d092c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:35.583737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad48772-6894-4f4f-801f-5e7f065d092c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:35.591309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad48772-6894-4f4f-801f-5e7f065d092c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:35.593013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad48772-6894-4f4f-801f-5e7f065d092c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4ad48772-6894-4f4f-801f-5e7f065d092c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:35.615583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:35.616608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:35.617658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:35.617658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:35.617658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:35.617658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:35.617658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:35.617658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:35.617658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:35.617658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:35.617658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 294/591] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:35.618370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad48772-6894-4f4f-801f-5e7f065d092c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:35.644959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:35.679166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b9081-d5dd-4917-a2ea-ae3d3543bdad None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:35.721789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab18c0c-14d3-4e3a-8af8-07092ffd64bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:35.722770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab18c0c-14d3-4e3a-8af8-07092ffd64bd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:35.723257 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab18c0c-14d3-4e3a-8af8-07092ffd64bd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:35.723827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab18c0c-14d3-4e3a-8af8-07092ffd64bd None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:35.724829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab18c0c-14d3-4e3a-8af8-07092ffd64bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:35.725336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab18c0c-14d3-4e3a-8af8-07092ffd64bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:35.726974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab18c0c-14d3-4e3a-8af8-07092ffd64bd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:35.747460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:35.747879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 298/592] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:35.749039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab18c0c-14d3-4e3a-8af8-07092ffd64bd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:35.751386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad48772-6894-4f4f-801f-5e7f065d092c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:35.795209 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a079dd-a9d0-4342-b8be-0c8cec07a5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:35.795760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a079dd-a9d0-4342-b8be-0c8cec07a5ef None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:35.796047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a079dd-a9d0-4342-b8be-0c8cec07a5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:35.796318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a079dd-a9d0-4342-b8be-0c8cec07a5ef None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:35.797218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a079dd-a9d0-4342-b8be-0c8cec07a5ef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:35.797529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a079dd-a9d0-4342-b8be-0c8cec07a5ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:35.799844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a079dd-a9d0-4342-b8be-0c8cec07a5ef None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:35.820518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 295/593] 10.222.0.91 () {56 vars in 1139 bytes} [Wed Aug 24 10:25:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:35.821488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a079dd-a9d0-4342-b8be-0c8cec07a5ef None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:35.874635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab18c0c-14d3-4e3a-8af8-07092ffd64bd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:35.906668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:35.914387 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13488a-3d8e-43b9-b092-b110aa31a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:35.915254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13488a-3d8e-43b9-b092-b110aa31a958 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:35.916172 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13488a-3d8e-43b9-b092-b110aa31a958 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:35.916549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13488a-3d8e-43b9-b092-b110aa31a958 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:35.917479 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13488a-3d8e-43b9-b092-b110aa31a958 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:35.917877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13488a-3d8e-43b9-b092-b110aa31a958 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:35.919478 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13488a-3d8e-43b9-b092-b110aa31a958 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:35.933774 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a079dd-a9d0-4342-b8be-0c8cec07a5ef None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:35.934000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 299/594] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:35.935106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13488a-3d8e-43b9-b092-b110aa31a958 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:35.973054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34255c0a-c66f-4832-958a-649c0a30be51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:35.974034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255c0a-c66f-4832-958a-649c0a30be51 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:35.974523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255c0a-c66f-4832-958a-649c0a30be51 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:35.975022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255c0a-c66f-4832-958a-649c0a30be51 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:35.983435 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34255c0a-c66f-4832-958a-649c0a30be51 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:35.985262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34255c0a-c66f-4832-958a-649c0a30be51 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:35.999002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-34255c0a-c66f-4832-958a-649c0a30be51 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:35.999802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:36.000730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:36.001670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:36.001670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:36.001670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:36.001670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:36.001670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:36.001670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:36.001670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:36.001670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:36.001670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:25:36.001670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:36.004346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 296/595] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:36.005369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34255c0a-c66f-4832-958a-649c0a30be51 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:36.055082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13488a-3d8e-43b9-b092-b110aa31a958 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:36.094696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b9728-a99e-4b93-bccb-c773220205e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:36.095645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b9728-a99e-4b93-bccb-c773220205e4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:36.095965 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b9728-a99e-4b93-bccb-c773220205e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:36.096244 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b9728-a99e-4b93-bccb-c773220205e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:36.111878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b9728-a99e-4b93-bccb-c773220205e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:36.113905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b9728-a99e-4b93-bccb-c773220205e4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:36.120338 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34255c0a-c66f-4832-958a-649c0a30be51 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-417b9728-a99e-4b93-bccb-c773220205e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:36.139495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:36.140550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:36.141432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:36.141432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:36.141432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:36.141432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 300/596] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:36.142081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b9728-a99e-4b93-bccb-c773220205e4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:36.183527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e58e6-3618-4e33-9f12-344ca4997915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:36.184368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e58e6-3618-4e33-9f12-344ca4997915 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:36.184650 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e58e6-3618-4e33-9f12-344ca4997915 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:36.184924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e58e6-3618-4e33-9f12-344ca4997915 None admin] PATH_INFO: `/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/75138f08ea2b4813b095635d920599d2/roles/baff7a1fa3b34f2fb1062f71bbb73c7f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:36.191149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:36.207836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e58e6-3618-4e33-9f12-344ca4997915 None admin] RBAC: Authorizing `identity:create_grant(project_id=acd807f8a28d43cdac159fa3d606af60, user_id=75138f08ea2b4813b095635d920599d2, role_id=baff7a1fa3b34f2fb1062f71bbb73c7f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:36.209692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e58e6-3618-4e33-9f12-344ca4997915 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:36.264563 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b9728-a99e-4b93-bccb-c773220205e4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:36.273084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:36.292549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 297/597] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:25:36 2022] PUT /identity/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/75138f08ea2b4813b095635d920599d2/roles/baff7a1fa3b34f2fb1062f71bbb73c7f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:25:36.294581 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e58e6-3618-4e33-9f12-344ca4997915 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:36.311887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a57e0-74bb-4fb2-bed5-de92ab8af55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:36.311887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a57e0-74bb-4fb2-bed5-de92ab8af55e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:36.311887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a57e0-74bb-4fb2-bed5-de92ab8af55e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:36.311887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a57e0-74bb-4fb2-bed5-de92ab8af55e None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:36.312303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a57e0-74bb-4fb2-bed5-de92ab8af55e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:36.312303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a57e0-74bb-4fb2-bed5-de92ab8af55e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:36.313530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a57e0-74bb-4fb2-bed5-de92ab8af55e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:36.356069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 301/598] 10.222.0.91 () {56 vars in 1137 bytes} [Wed Aug 24 10:25:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:36.361920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a57e0-74bb-4fb2-bed5-de92ab8af55e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:36.506900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a57e0-74bb-4fb2-bed5-de92ab8af55e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:36.538166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e58e6-3618-4e33-9f12-344ca4997915 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:36.557030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bb2b6-4a02-4e8d-9b8e-242fff9ee199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:36.558181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bb2b6-4a02-4e8d-9b8e-242fff9ee199 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:36.558682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bb2b6-4a02-4e8d-9b8e-242fff9ee199 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:36.559281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bb2b6-4a02-4e8d-9b8e-242fff9ee199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:36.571194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bb2b6-4a02-4e8d-9b8e-242fff9ee199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:36.573181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bb2b6-4a02-4e8d-9b8e-242fff9ee199 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:36.582724 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e1803-098d-4b47-a0ab-d5cfc1a2bc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:36.583402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e1803-098d-4b47-a0ab-d5cfc1a2bc8a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:36.583683 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e1803-098d-4b47-a0ab-d5cfc1a2bc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:36.583982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e1803-098d-4b47-a0ab-d5cfc1a2bc8a None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:36.584623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e1803-098d-4b47-a0ab-d5cfc1a2bc8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:36.584923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e1803-098d-4b47-a0ab-d5cfc1a2bc8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:36.586281 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e1803-098d-4b47-a0ab-d5cfc1a2bc8a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-666bb2b6-4a02-4e8d-9b8e-242fff9ee199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:36.592939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:36.593890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:36.594826 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:36.594826 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:36.594826 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:36.597033 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 302/599] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:36.598576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdf166-45e4-4611-99cb-39f2caa21efd None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:36.599056 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdf166-45e4-4611-99cb-39f2caa21efd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:36.599519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdf166-45e4-4611-99cb-39f2caa21efd None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:36.599623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 298/600] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:36.601337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 303/601] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:36.606133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e1803-098d-4b47-a0ab-d5cfc1a2bc8a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:36.607393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdf166-45e4-4611-99cb-39f2caa21efd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:36.629037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:36.657959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:36.713066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e1803-098d-4b47-a0ab-d5cfc1a2bc8a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:36.723476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdf166-45e4-4611-99cb-39f2caa21efd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:36.755768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f2fd3-8e9d-41ea-a562-0712d5a2cbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:36.755768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f2fd3-8e9d-41ea-a562-0712d5a2cbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:36.755768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f2fd3-8e9d-41ea-a562-0712d5a2cbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:36.756102 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f2fd3-8e9d-41ea-a562-0712d5a2cbe5 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:36.756687 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f2fd3-8e9d-41ea-a562-0712d5a2cbe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:36.757039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f2fd3-8e9d-41ea-a562-0712d5a2cbe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:36.758387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f2fd3-8e9d-41ea-a562-0712d5a2cbe5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:36.764276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e83ba-630f-49b1-be34-51da2bd5b5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:36.764918 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e83ba-630f-49b1-be34-51da2bd5b5bc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:36.765196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e83ba-630f-49b1-be34-51da2bd5b5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:36.765503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e83ba-630f-49b1-be34-51da2bd5b5bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:36.776615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 299/602] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:36.776615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0fa3f-4916-4284-8ac3-f0b118af9ecb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:36.776615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0fa3f-4916-4284-8ac3-f0b118af9ecb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:36.776615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0fa3f-4916-4284-8ac3-f0b118af9ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:36.778450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e83ba-630f-49b1-be34-51da2bd5b5bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:36.779930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e83ba-630f-49b1-be34-51da2bd5b5bc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f90e83ba-630f-49b1-be34-51da2bd5b5bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:36.793259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:36.800274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:36.801592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:36.801592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:36.801592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:36.801592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:36.801592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:36.801592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:36.801592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:36.801592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:36.802029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-07e0fa3f-4916-4284-8ac3-f0b118af9ecb None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:36.802105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 304/603] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:36.802173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-07e0fa3f-4916-4284-8ac3-f0b118af9ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:36.803842 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff4cfd-effa-40c0-a6d9-a2802baedefd None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:36.803842 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff4cfd-effa-40c0-a6d9-a2802baedefd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:36.803842 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff4cfd-effa-40c0-a6d9-a2802baedefd None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:36.803842 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 305/604] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:36.803842 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff4cfd-effa-40c0-a6d9-a2802baedefd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:36.882378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 300/605] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:36.883511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0fa3f-4916-4284-8ac3-f0b118af9ecb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:36.901820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:36.928861 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff4cfd-effa-40c0-a6d9-a2802baedefd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:36.933879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:36.970581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d336b9-8276-441b-9ad5-18c9c0d72825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:36.971321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d336b9-8276-441b-9ad5-18c9c0d72825 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:36.971669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d336b9-8276-441b-9ad5-18c9c0d72825 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:36.972050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d336b9-8276-441b-9ad5-18c9c0d72825 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:36.980212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d336b9-8276-441b-9ad5-18c9c0d72825 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:36.982247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d336b9-8276-441b-9ad5-18c9c0d72825 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d8d336b9-8276-441b-9ad5-18c9c0d72825 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:36.996054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:36.997026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:36.997932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:36.997932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:36.997932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:36.997932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:36.997932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:36.997932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:36.997932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:36.997932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:36.997932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 306/606] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:36.999558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff008a7d-2fe5-48f8-aa31-b6aaf489da1a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:36.999680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff008a7d-2fe5-48f8-aa31-b6aaf489da1a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:37.000100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff008a7d-2fe5-48f8-aa31-b6aaf489da1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:37.023832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0fa3f-4916-4284-8ac3-f0b118af9ecb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:37.025087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ff008a7d-2fe5-48f8-aa31-b6aaf489da1a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:37.026900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ff008a7d-2fe5-48f8-aa31-b6aaf489da1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:37.072100 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760a0b-25bc-49fe-b1b1-a3e7fd89c25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:37.073422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760a0b-25bc-49fe-b1b1-a3e7fd89c25a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:37.073892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760a0b-25bc-49fe-b1b1-a3e7fd89c25a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:37.074629 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760a0b-25bc-49fe-b1b1-a3e7fd89c25a None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:37.075633 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0760a0b-25bc-49fe-b1b1-a3e7fd89c25a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:37.076142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0760a0b-25bc-49fe-b1b1-a3e7fd89c25a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:37.078069 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0760a0b-25bc-49fe-b1b1-a3e7fd89c25a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:37.093309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 301/607] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:37.094432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760a0b-25bc-49fe-b1b1-a3e7fd89c25a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:37.131947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 307/608] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:37.133173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff008a7d-2fe5-48f8-aa31-b6aaf489da1a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:37.218614 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:37.225616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760a0b-25bc-49fe-b1b1-a3e7fd89c25a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:37.229534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:37.270319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff008a7d-2fe5-48f8-aa31-b6aaf489da1a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:37.271622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba1054-4e68-4a6a-99af-1225c2f9247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:37.272416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba1054-4e68-4a6a-99af-1225c2f9247c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:37.272951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba1054-4e68-4a6a-99af-1225c2f9247c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:37.273307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba1054-4e68-4a6a-99af-1225c2f9247c None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:37.275256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba1054-4e68-4a6a-99af-1225c2f9247c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:37.275777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba1054-4e68-4a6a-99af-1225c2f9247c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:37.277351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba1054-4e68-4a6a-99af-1225c2f9247c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:37.296735 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 302/609] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:37.296735 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba1054-4e68-4a6a-99af-1225c2f9247c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:37.320765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab225f8-c15a-4ff4-aad1-babeb8c6994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:37.322081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab225f8-c15a-4ff4-aad1-babeb8c6994a None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:37.322371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab225f8-c15a-4ff4-aad1-babeb8c6994a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:37.322630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab225f8-c15a-4ff4-aad1-babeb8c6994a None admin] PATH_INFO: `/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/8956453f963242a087d2f90d70ed8f8f/roles/baff7a1fa3b34f2fb1062f71bbb73c7f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:37.339774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab225f8-c15a-4ff4-aad1-babeb8c6994a None admin] RBAC: Authorizing `identity:create_grant(project_id=acd807f8a28d43cdac159fa3d606af60, user_id=8956453f963242a087d2f90d70ed8f8f, role_id=baff7a1fa3b34f2fb1062f71bbb73c7f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:37.346497 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab225f8-c15a-4ff4-aad1-babeb8c6994a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:37.408365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba1054-4e68-4a6a-99af-1225c2f9247c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:37.442956 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f12a-bf06-4fa1-b9a9-90984b2534cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:37.443573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f12a-bf06-4fa1-b9a9-90984b2534cc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:37.443895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f12a-bf06-4fa1-b9a9-90984b2534cc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:37.444164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f12a-bf06-4fa1-b9a9-90984b2534cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:37.450379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 308/610] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:25:37 2022] PUT /identity/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/8956453f963242a087d2f90d70ed8f8f/roles/baff7a1fa3b34f2fb1062f71bbb73c7f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:25:37.451382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab225f8-c15a-4ff4-aad1-babeb8c6994a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:37.466720 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212f12a-bf06-4fa1-b9a9-90984b2534cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8212f12a-bf06-4fa1-b9a9-90984b2534cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:37.473014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:37.474194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:37.475226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:37.475226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:37.475226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:37.475226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:37.475226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:37.475226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:37.475226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:37.475226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:37.475226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:37.475226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:37.475226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:37.475226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:37.482989 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 303/611] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:37.484209 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f12a-bf06-4fa1-b9a9-90984b2534cc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:37.506526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:37.601304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab225f8-c15a-4ff4-aad1-babeb8c6994a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:37.611003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f12a-bf06-4fa1-b9a9-90984b2534cc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:37.628530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:37.652685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c0585-9818-4093-8dc4-0058f3a4a39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:37.655168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862128cc-bfa3-416f-b42a-99202618fee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:37.655854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862128cc-bfa3-416f-b42a-99202618fee3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:37.655986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c0585-9818-4093-8dc4-0058f3a4a39c None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:37.656155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862128cc-bfa3-416f-b42a-99202618fee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:37.656447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862128cc-bfa3-416f-b42a-99202618fee3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:37.656930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c0585-9818-4093-8dc4-0058f3a4a39c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:37.657417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c0585-9818-4093-8dc4-0058f3a4a39c None admin] PATH_INFO: `/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/dc05a509ea1c4aa582380541cfc37989/roles/baff7a1fa3b34f2fb1062f71bbb73c7f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:37.670610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862128cc-bfa3-416f-b42a-99202618fee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-862128cc-bfa3-416f-b42a-99202618fee3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:37.677012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:37.680117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:37.682240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:37.682240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:37.682240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:37.682240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:37.682240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:37.682240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:37.682240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:37.682240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:37.682240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:37.682240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:37.682240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:37.682240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:37.684717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c0585-9818-4093-8dc4-0058f3a4a39c None admin] RBAC: Authorizing `identity:create_grant(project_id=acd807f8a28d43cdac159fa3d606af60, user_id=dc05a509ea1c4aa582380541cfc37989, role_id=baff7a1fa3b34f2fb1062f71bbb73c7f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:37.684943 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 304/612] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:37.685159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c0585-9818-4093-8dc4-0058f3a4a39c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:37.685358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862128cc-bfa3-416f-b42a-99202618fee3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:37.764166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 309/613] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:25:37 2022] PUT /identity/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/dc05a509ea1c4aa582380541cfc37989/roles/baff7a1fa3b34f2fb1062f71bbb73c7f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:25:37.765326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c0585-9818-4093-8dc4-0058f3a4a39c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:37.794285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:37.830181 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862128cc-bfa3-416f-b42a-99202618fee3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:37.873276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33321694-d56a-4574-9acd-a843c90a57d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:37.873815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33321694-d56a-4574-9acd-a843c90a57d8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:37.874095 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33321694-d56a-4574-9acd-a843c90a57d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:37.874365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33321694-d56a-4574-9acd-a843c90a57d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:37.875041 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33321694-d56a-4574-9acd-a843c90a57d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:37.875347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33321694-d56a-4574-9acd-a843c90a57d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:37.876775 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33321694-d56a-4574-9acd-a843c90a57d8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:37.886809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 305/614] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:37.893110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33321694-d56a-4574-9acd-a843c90a57d8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:37.982389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c0585-9818-4093-8dc4-0058f3a4a39c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:38.022813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296030bc-8a9c-4431-a498-c7a6d4e03403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:38.023501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296030bc-8a9c-4431-a498-c7a6d4e03403 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:38.023839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296030bc-8a9c-4431-a498-c7a6d4e03403 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:38.024201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296030bc-8a9c-4431-a498-c7a6d4e03403 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:38.025449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296030bc-8a9c-4431-a498-c7a6d4e03403 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:38.025795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296030bc-8a9c-4431-a498-c7a6d4e03403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:38.027202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296030bc-8a9c-4431-a498-c7a6d4e03403 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:38.028690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33321694-d56a-4574-9acd-a843c90a57d8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:38.036840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 310/615] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:38.043329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296030bc-8a9c-4431-a498-c7a6d4e03403 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:38.082670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b77c4-186d-461b-98cc-f52be87e397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:38.083530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b77c4-186d-461b-98cc-f52be87e397f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:38.083824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b77c4-186d-461b-98cc-f52be87e397f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:38.085484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b77c4-186d-461b-98cc-f52be87e397f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:38.087544 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:38.102608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:38.117361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b77c4-186d-461b-98cc-f52be87e397f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:38.119274 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b77c4-186d-461b-98cc-f52be87e397f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7e5b77c4-186d-461b-98cc-f52be87e397f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:38.144010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:38.144985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:38.146137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:38.146137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:38.146137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:38.156179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 306/616] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:38.169101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b77c4-186d-461b-98cc-f52be87e397f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:38.206143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296030bc-8a9c-4431-a498-c7a6d4e03403 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:38.269028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f61b5d-ac3b-42db-bbcf-2e02d83b6dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:38.269672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f61b5d-ac3b-42db-bbcf-2e02d83b6dda None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:38.269947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f61b5d-ac3b-42db-bbcf-2e02d83b6dda None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:38.270215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f61b5d-ac3b-42db-bbcf-2e02d83b6dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:38.296105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f61b5d-ac3b-42db-bbcf-2e02d83b6dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:38.297611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f61b5d-ac3b-42db-bbcf-2e02d83b6dda None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c5f61b5d-ac3b-42db-bbcf-2e02d83b6dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:38.335266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:38.336318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:38.337808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:38.337808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:38.337808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:38.337808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 311/617] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:38.359217 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f61b5d-ac3b-42db-bbcf-2e02d83b6dda None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:38.372992 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b77c4-186d-461b-98cc-f52be87e397f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:38.412095 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a78df-0bb7-4355-8970-bb08b79428db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:38.412615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a78df-0bb7-4355-8970-bb08b79428db None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:38.412889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a78df-0bb7-4355-8970-bb08b79428db None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:38.413153 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a78df-0bb7-4355-8970-bb08b79428db None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:38.413782 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a78df-0bb7-4355-8970-bb08b79428db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:38.414078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a78df-0bb7-4355-8970-bb08b79428db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:38.415708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a78df-0bb7-4355-8970-bb08b79428db None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:38.443652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 307/618] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:38.458051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22112c83-7edf-4a56-bd60-fa5d44e68c03 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:38.458662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22112c83-7edf-4a56-bd60-fa5d44e68c03 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:38.459135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22112c83-7edf-4a56-bd60-fa5d44e68c03 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:38.460934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 308/619] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:25:38.466169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22112c83-7edf-4a56-bd60-fa5d44e68c03 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:38.498103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:38.523348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f61b5d-ac3b-42db-bbcf-2e02d83b6dda None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:38.531845 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:38.563059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa02532-de9a-4751-a345-c9cd9c54e2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:38.563669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa02532-de9a-4751-a345-c9cd9c54e2ce None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:38.563979 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa02532-de9a-4751-a345-c9cd9c54e2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:38.564852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa02532-de9a-4751-a345-c9cd9c54e2ce None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:38.565902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa02532-de9a-4751-a345-c9cd9c54e2ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:38.566208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa02532-de9a-4751-a345-c9cd9c54e2ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:38.567745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa02532-de9a-4751-a345-c9cd9c54e2ce None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:38.582177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 312/620] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:38.583291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d2b28-db2c-4fcd-9452-727f3a75229e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:38.583574 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d2b28-db2c-4fcd-9452-727f3a75229e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:38.583902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d2b28-db2c-4fcd-9452-727f3a75229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:38.598811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22112c83-7edf-4a56-bd60-fa5d44e68c03 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:38.604172 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-679d2b28-db2c-4fcd-9452-727f3a75229e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:38.605418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-679d2b28-db2c-4fcd-9452-727f3a75229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:38.648671 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a484fd-9684-436b-ac79-27e4c4494800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:38.649351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a484fd-9684-436b-ac79-27e4c4494800 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:38.650141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a484fd-9684-436b-ac79-27e4c4494800 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:38.650415 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a484fd-9684-436b-ac79-27e4c4494800 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:38.659988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a484fd-9684-436b-ac79-27e4c4494800 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:38.661498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a484fd-9684-436b-ac79-27e4c4494800 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a9a484fd-9684-436b-ac79-27e4c4494800 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:38.674270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:38.676060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:38.677038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:38.677038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:38.677038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:38.677038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:38.677038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:38.677038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:38.677038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:38.677038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:38.677038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:25:38.677038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:38.680073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 309/621] 10.222.0.91 () {56 vars in 1093 bytes} [Wed Aug 24 10:25:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:38.681175 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a484fd-9684-436b-ac79-27e4c4494800 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:38.689524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 313/622] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:38.690530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d2b28-db2c-4fcd-9452-727f3a75229e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:38.785193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:38.796785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a484fd-9684-436b-ac79-27e4c4494800 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:38.810354 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:38.825887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d2b28-db2c-4fcd-9452-727f3a75229e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:38.838860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd046b9-c93d-45af-8f08-47d1a631ce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:38.839887 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd046b9-c93d-45af-8f08-47d1a631ce54 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:38.840434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd046b9-c93d-45af-8f08-47d1a631ce54 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:38.840934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd046b9-c93d-45af-8f08-47d1a631ce54 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:38.850914 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd046b9-c93d-45af-8f08-47d1a631ce54 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:38.853250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd046b9-c93d-45af-8f08-47d1a631ce54 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7cd046b9-c93d-45af-8f08-47d1a631ce54 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:38.866719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:38.868015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:38.869826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:38.869826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:38.869826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:38.869826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:38.869826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:38.869826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:38.869826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:38.869826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:38.869826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:25:38.869826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:38.870503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6c9e0-1fae-4b30-a2ec-e2a87a59a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:38.871225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6c9e0-1fae-4b30-a2ec-e2a87a59a00f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:38.871596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6c9e0-1fae-4b30-a2ec-e2a87a59a00f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:38.871982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6c9e0-1fae-4b30-a2ec-e2a87a59a00f None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:38.872708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 310/623] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:38.872906 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6c9e0-1fae-4b30-a2ec-e2a87a59a00f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:38.873301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6c9e0-1fae-4b30-a2ec-e2a87a59a00f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:38.874838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6c9e0-1fae-4b30-a2ec-e2a87a59a00f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:38.880744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd046b9-c93d-45af-8f08-47d1a631ce54 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:38.905833 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 314/624] 10.222.0.91 () {56 vars in 1133 bytes} [Wed Aug 24 10:25:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:38.916908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6c9e0-1fae-4b30-a2ec-e2a87a59a00f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:39.027277 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6c9e0-1fae-4b30-a2ec-e2a87a59a00f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:39.048964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd046b9-c93d-45af-8f08-47d1a631ce54 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:39.080541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:39.089851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a9cea-cb3c-453a-b707-8d8cdc09a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:39.090465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a9cea-cb3c-453a-b707-8d8cdc09a803 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:39.090741 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a9cea-cb3c-453a-b707-8d8cdc09a803 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:39.091008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a9cea-cb3c-453a-b707-8d8cdc09a803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:39.094360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8142876-d6a5-4777-8851-b13af237287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:39.097679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142876-d6a5-4777-8851-b13af237287c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:39.097679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142876-d6a5-4777-8851-b13af237287c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:39.097679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142876-d6a5-4777-8851-b13af237287c None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:39.097679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8142876-d6a5-4777-8851-b13af237287c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:39.097679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8142876-d6a5-4777-8851-b13af237287c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:39.098244 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8142876-d6a5-4777-8851-b13af237287c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:39.134399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 311/625] 10.222.0.91 () {56 vars in 1135 bytes} [Wed Aug 24 10:25:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:39.142776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8142876-d6a5-4777-8851-b13af237287c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:39.174911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a9cea-cb3c-453a-b707-8d8cdc09a803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:39.176399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a9cea-cb3c-453a-b707-8d8cdc09a803 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:39.220921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:39.291820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 315/626] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:39.292885 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a9cea-cb3c-453a-b707-8d8cdc09a803 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:39.307977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8142876-d6a5-4777-8851-b13af237287c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:39.323023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:39.350140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76640149-6642-4ef3-9d27-e536691b7aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:39.350784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76640149-6642-4ef3-9d27-e536691b7aec None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:39.351063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76640149-6642-4ef3-9d27-e536691b7aec None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:39.351336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76640149-6642-4ef3-9d27-e536691b7aec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:39.364176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76640149-6642-4ef3-9d27-e536691b7aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:39.365772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76640149-6642-4ef3-9d27-e536691b7aec None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-76640149-6642-4ef3-9d27-e536691b7aec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:39.393833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:39.394862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:39.396072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:39.396072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:39.396072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:39.396072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 312/627] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:39.401261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76640149-6642-4ef3-9d27-e536691b7aec None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:39.410601 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a9cea-cb3c-453a-b707-8d8cdc09a803 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:39.459797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b882c37-5045-4d1f-90e8-abb47707c990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:39.460472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b882c37-5045-4d1f-90e8-abb47707c990 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:39.460753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b882c37-5045-4d1f-90e8-abb47707c990 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:39.461027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b882c37-5045-4d1f-90e8-abb47707c990 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:39.477165 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b882c37-5045-4d1f-90e8-abb47707c990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-3b882c37-5045-4d1f-90e8-abb47707c990 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:39.483593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:39.484603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:39.485533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:39.485533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:39.485533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:39.485533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:39.485533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:39.485533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:39.485533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:39.485533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:39.485533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:39.485533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:39.485533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:39.485533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:39.490078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 316/628] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:39.491133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b882c37-5045-4d1f-90e8-abb47707c990 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:39.516589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:39.553368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76640149-6642-4ef3-9d27-e536691b7aec None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:39.605507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:39.620589 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b882c37-5045-4d1f-90e8-abb47707c990 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:39.622236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc926f-03b9-4ecf-953c-547979a6627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:39.623608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc926f-03b9-4ecf-953c-547979a6627e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:39.624399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc926f-03b9-4ecf-953c-547979a6627e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:39.625159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc926f-03b9-4ecf-953c-547979a6627e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:39.655891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc926f-03b9-4ecf-953c-547979a6627e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:39.661876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc926f-03b9-4ecf-953c-547979a6627e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:39.662829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cdd69-512a-410f-a2b8-627fb0c27a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:39.663605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cdd69-512a-410f-a2b8-627fb0c27a19 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:39.664007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cdd69-512a-410f-a2b8-627fb0c27a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:39.664380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cdd69-512a-410f-a2b8-627fb0c27a19 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:39.665369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8cdd69-512a-410f-a2b8-627fb0c27a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:39.665904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8cdd69-512a-410f-a2b8-627fb0c27a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:39.667981 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8cdd69-512a-410f-a2b8-627fb0c27a19 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:39.687757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 317/629] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:39.687757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cdd69-512a-410f-a2b8-627fb0c27a19 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-79cc926f-03b9-4ecf-953c-547979a6627e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:39.708398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:39.710523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:39.712461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:39.712461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:39.712461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:39.715927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 313/630] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:39.717679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc926f-03b9-4ecf-953c-547979a6627e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:39.811376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cdd69-512a-410f-a2b8-627fb0c27a19 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:39.855355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f570d-97c6-481b-a53d-2abf1aa938c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:39.856146 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f570d-97c6-481b-a53d-2abf1aa938c7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:39.856480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f570d-97c6-481b-a53d-2abf1aa938c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:39.856823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f570d-97c6-481b-a53d-2abf1aa938c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:39.857560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f570d-97c6-481b-a53d-2abf1aa938c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:39.857926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f570d-97c6-481b-a53d-2abf1aa938c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:39.859434 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f570d-97c6-481b-a53d-2abf1aa938c7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:39.880143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 318/631] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:39.881188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f570d-97c6-481b-a53d-2abf1aa938c7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:39.900851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:39.908653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc926f-03b9-4ecf-953c-547979a6627e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:39.945197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:39.951177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5873-5f19-4079-bed7-fb974a9597bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:39.951846 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5873-5f19-4079-bed7-fb974a9597bf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:39.952126 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5873-5f19-4079-bed7-fb974a9597bf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:39.952394 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5873-5f19-4079-bed7-fb974a9597bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:39.960187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a5873-5f19-4079-bed7-fb974a9597bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:39.961603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a5873-5f19-4079-bed7-fb974a9597bf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c35a5873-5f19-4079-bed7-fb974a9597bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:39.975679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:39.976721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:39.983770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:39.983770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:39.983770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:39.983770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:39.983770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:39.983770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:39.983770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:39.983770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:39.983770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 314/632] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:39.983770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5873-5f19-4079-bed7-fb974a9597bf None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:40.009065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f570d-97c6-481b-a53d-2abf1aa938c7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:40.045179 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc41b50-1f04-46ab-a386-99a2d2b07506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:40.045833 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41b50-1f04-46ab-a386-99a2d2b07506 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.046112 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41b50-1f04-46ab-a386-99a2d2b07506 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.046380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41b50-1f04-46ab-a386-99a2d2b07506 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.047011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc41b50-1f04-46ab-a386-99a2d2b07506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:40.047309 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc41b50-1f04-46ab-a386-99a2d2b07506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:40.048893 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc41b50-1f04-46ab-a386-99a2d2b07506 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:40.062485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 319/633] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:40.063656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669f732-f3cc-4bf6-8fe6-36e6f88c43b5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.063970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669f732-f3cc-4bf6-8fe6-36e6f88c43b5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.064245 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669f732-f3cc-4bf6-8fe6-36e6f88c43b5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.065601 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 320/634] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:40.066163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669f732-f3cc-4bf6-8fe6-36e6f88c43b5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:40.098297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5873-5f19-4079-bed7-fb974a9597bf None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:40.142949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd35b9-6a08-4c2f-812c-af2fd8284e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:40.143868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd35b9-6a08-4c2f-812c-af2fd8284e83 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.144148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd35b9-6a08-4c2f-812c-af2fd8284e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.144424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd35b9-6a08-4c2f-812c-af2fd8284e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.146317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:40.156172 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd35b9-6a08-4c2f-812c-af2fd8284e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:40.157661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd35b9-6a08-4c2f-812c-af2fd8284e83 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-17cd35b9-6a08-4c2f-812c-af2fd8284e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:40.173371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:40.174398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:40.175294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:40.175294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:40.175294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:40.175294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 315/635] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:40.175674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df4d7-931e-4d3a-a217-c732631bab05 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.175944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df4d7-931e-4d3a-a217-c732631bab05 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.176209 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df4d7-931e-4d3a-a217-c732631bab05 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.177425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 316/636] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:40.178110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1df4d7-931e-4d3a-a217-c732631bab05 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:40.185257 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669f732-f3cc-4bf6-8fe6-36e6f88c43b5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:40.220386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26184d2f-fd2a-47c9-8328-c2bad6935d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:40.220992 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26184d2f-fd2a-47c9-8328-c2bad6935d3a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.221270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26184d2f-fd2a-47c9-8328-c2bad6935d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.221542 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26184d2f-fd2a-47c9-8328-c2bad6935d3a None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.222231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26184d2f-fd2a-47c9-8328-c2bad6935d3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:40.222531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26184d2f-fd2a-47c9-8328-c2bad6935d3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:40.224054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26184d2f-fd2a-47c9-8328-c2bad6935d3a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:40.229544 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:40.236487 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 321/637] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:40.237793 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368692-2bfd-4f46-9792-01b1cfa4d15c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.238081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368692-2bfd-4f46-9792-01b1cfa4d15c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.238358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368692-2bfd-4f46-9792-01b1cfa4d15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.257368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-45368692-2bfd-4f46-9792-01b1cfa4d15c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:40.258575 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-45368692-2bfd-4f46-9792-01b1cfa4d15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:40.292210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1df4d7-931e-4d3a-a217-c732631bab05 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:40.326539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 322/638] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:40.326718 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ef12e-afdf-4686-94d0-3c166b83f2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:40.327296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45368692-2bfd-4f46-9792-01b1cfa4d15c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:40.327435 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ef12e-afdf-4686-94d0-3c166b83f2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.327633 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ef12e-afdf-4686-94d0-3c166b83f2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.327919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ef12e-afdf-4686-94d0-3c166b83f2d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.335195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ef12e-afdf-4686-94d0-3c166b83f2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:40.336677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ef12e-afdf-4686-94d0-3c166b83f2d7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b20ef12e-afdf-4686-94d0-3c166b83f2d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:40.350665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:40.352074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:40.353621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:40.353621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:40.353621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:40.353621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:40.353621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:40.353621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:40.353621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:40.353621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:40.353621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 317/639] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:40.354284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2fa67-c6b7-4106-8d7d-fe958d22ae46 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.354367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2fa67-c6b7-4106-8d7d-fe958d22ae46 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.355435 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2fa67-c6b7-4106-8d7d-fe958d22ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.373489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-35f2fa67-c6b7-4106-8d7d-fe958d22ae46 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:40.375699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-35f2fa67-c6b7-4106-8d7d-fe958d22ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:40.405788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:40.449137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 318/640] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:40.450195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2fa67-c6b7-4106-8d7d-fe958d22ae46 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:40.464193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45368692-2bfd-4f46-9792-01b1cfa4d15c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:40.488465 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:40.512771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d708744-69c7-4f17-aedf-bd56a6a34a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:40.513613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d708744-69c7-4f17-aedf-bd56a6a34a6b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.514237 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d708744-69c7-4f17-aedf-bd56a6a34a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.514593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d708744-69c7-4f17-aedf-bd56a6a34a6b None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.515339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d708744-69c7-4f17-aedf-bd56a6a34a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:40.515893 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d708744-69c7-4f17-aedf-bd56a6a34a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:40.518116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d708744-69c7-4f17-aedf-bd56a6a34a6b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:40.536142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 323/641] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:40.537100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d708744-69c7-4f17-aedf-bd56a6a34a6b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:40.570272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2fa67-c6b7-4106-8d7d-fe958d22ae46 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:40.621029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43947149-c268-4039-90c5-487f3b7f5ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:40.621618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43947149-c268-4039-90c5-487f3b7f5ff8 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.621900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43947149-c268-4039-90c5-487f3b7f5ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.622174 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43947149-c268-4039-90c5-487f3b7f5ff8 None admin] PATH_INFO: `/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/4671efa1526643cdb32f56d44903db1d/roles/baff7a1fa3b34f2fb1062f71bbb73c7f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.641127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43947149-c268-4039-90c5-487f3b7f5ff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=acd807f8a28d43cdac159fa3d606af60, user_id=4671efa1526643cdb32f56d44903db1d, role_id=baff7a1fa3b34f2fb1062f71bbb73c7f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:40.642569 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43947149-c268-4039-90c5-487f3b7f5ff8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:40.652454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d708744-69c7-4f17-aedf-bd56a6a34a6b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:40.674903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:40.689597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5a7ff-28b6-410f-9b4d-ff7bea85cabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:40.690233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5a7ff-28b6-410f-9b4d-ff7bea85cabe None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.690514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5a7ff-28b6-410f-9b4d-ff7bea85cabe None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.690785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5a7ff-28b6-410f-9b4d-ff7bea85cabe None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.691479 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5a7ff-28b6-410f-9b4d-ff7bea85cabe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:40.691808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5a7ff-28b6-410f-9b4d-ff7bea85cabe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:40.693248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5a7ff-28b6-410f-9b4d-ff7bea85cabe None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:40.705994 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 324/642] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:40.706827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5a7ff-28b6-410f-9b4d-ff7bea85cabe None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:40.721565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 319/643] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:25:40 2022] PUT /identity/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/4671efa1526643cdb32f56d44903db1d/roles/baff7a1fa3b34f2fb1062f71bbb73c7f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:25:40.723487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43947149-c268-4039-90c5-487f3b7f5ff8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:40.828144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:40.834515 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5a7ff-28b6-410f-9b4d-ff7bea85cabe None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:40.852690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43947149-c268-4039-90c5-487f3b7f5ff8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:40.884160 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71057068-21dd-4d81-aab5-c322e1c291af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:40.885288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71057068-21dd-4d81-aab5-c322e1c291af None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.885758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71057068-21dd-4d81-aab5-c322e1c291af None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.886038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71057068-21dd-4d81-aab5-c322e1c291af None admin] PATH_INFO: `/v3/users/glance` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.894690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71057068-21dd-4d81-aab5-c322e1c291af None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:40.896047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71057068-21dd-4d81-aab5-c322e1c291af None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:40.902437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f082e4-35b4-4e91-826f-1539172ea3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:40.903694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f082e4-35b4-4e91-826f-1539172ea3ab None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:40.903694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f082e4-35b4-4e91-826f-1539172ea3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:40.903694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f082e4-35b4-4e91-826f-1539172ea3ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-71057068-21dd-4d81-aab5-c322e1c291af None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:40.909251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:40.910403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:40.911397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:40.911397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:40.911397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:40.911397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:40.911397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:40.911397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:40.911397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:40.911397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:40.911397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:25:40.911397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:40.911397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 325/644] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:40.915937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71057068-21dd-4d81-aab5-c322e1c291af None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:40.923303 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f082e4-35b4-4e91-826f-1539172ea3ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-08f082e4-35b4-4e91-826f-1539172ea3ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:40.928771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:40.929984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:40.931231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:40.931231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:40.931231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:40.931231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:40.931231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:40.931231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:40.931231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:40.931231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:40.931231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:40.931231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:40.931231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:40.931231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:40.932684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 320/645] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:40.933355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f082e4-35b4-4e91-826f-1539172ea3ab None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:40.975001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:41.054908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71057068-21dd-4d81-aab5-c322e1c291af None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:41.074078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f082e4-35b4-4e91-826f-1539172ea3ab None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:41.102129 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74c7da-3564-4511-96f6-fd4451848031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:41.102764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c7da-3564-4511-96f6-fd4451848031 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:41.103135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c7da-3564-4511-96f6-fd4451848031 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:41.103418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c7da-3564-4511-96f6-fd4451848031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:41.104882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74c7da-3564-4511-96f6-fd4451848031 None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=4ae21e13a4414168bd1741dfd642274a) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:41.105348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74c7da-3564-4511-96f6-fd4451848031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:41.107196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74c7da-3564-4511-96f6-fd4451848031 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:41.115947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 326/646] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:40 2022] GET /identity/v3/role_assignments?user.id=4ae21e13a4414168bd1741dfd642274a&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:41.117432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74c7da-3564-4511-96f6-fd4451848031 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:41.118797 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01387a5a-3d5a-4620-8633-4a9fc2829a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:41.120015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01387a5a-3d5a-4620-8633-4a9fc2829a95 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:41.120401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01387a5a-3d5a-4620-8633-4a9fc2829a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:41.120777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01387a5a-3d5a-4620-8633-4a9fc2829a95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:41.139639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01387a5a-3d5a-4620-8633-4a9fc2829a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-01387a5a-3d5a-4620-8633-4a9fc2829a95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:41.145802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:41.146892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:41.147873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 321/647] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:41.149127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01387a5a-3d5a-4620-8633-4a9fc2829a95 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:41.154449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:41.265470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74c7da-3564-4511-96f6-fd4451848031 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:41.268845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:41.309959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01387a5a-3d5a-4620-8633-4a9fc2829a95 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:41.319449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487116-27f0-40f9-ba0b-131a73ffc55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:41.319820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487116-27f0-40f9-ba0b-131a73ffc55b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:41.319980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487116-27f0-40f9-ba0b-131a73ffc55b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:41.320258 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487116-27f0-40f9-ba0b-131a73ffc55b None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:41.320893 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487116-27f0-40f9-ba0b-131a73ffc55b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:41.321802 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487116-27f0-40f9-ba0b-131a73ffc55b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:41.323400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487116-27f0-40f9-ba0b-131a73ffc55b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:41.349620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 327/648] 10.222.0.91 () {56 vars in 1137 bytes} [Wed Aug 24 10:25:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:41.350617 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487116-27f0-40f9-ba0b-131a73ffc55b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:41.357867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea85be-2da0-4925-a5c1-e6d5cf041a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:41.358627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea85be-2da0-4925-a5c1-e6d5cf041a3c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:41.358904 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea85be-2da0-4925-a5c1-e6d5cf041a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:41.359172 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea85be-2da0-4925-a5c1-e6d5cf041a3c None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:41.359882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea85be-2da0-4925-a5c1-e6d5cf041a3c None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:41.360182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea85be-2da0-4925-a5c1-e6d5cf041a3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:41.361570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea85be-2da0-4925-a5c1-e6d5cf041a3c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:41.374743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 322/649] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:41.376136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea85be-2da0-4925-a5c1-e6d5cf041a3c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:41.471501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:41.479592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487116-27f0-40f9-ba0b-131a73ffc55b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:41.521390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea85be-2da0-4925-a5c1-e6d5cf041a3c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:41.521777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46261026-cb4d-4d1c-9e16-ab5bcc61a7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:41.522618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46261026-cb4d-4d1c-9e16-ab5bcc61a7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:41.523122 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46261026-cb4d-4d1c-9e16-ab5bcc61a7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:41.523606 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46261026-cb4d-4d1c-9e16-ab5bcc61a7c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:41.525366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46261026-cb4d-4d1c-9e16-ab5bcc61a7c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:41.526029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46261026-cb4d-4d1c-9e16-ab5bcc61a7c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:41.528891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46261026-cb4d-4d1c-9e16-ab5bcc61a7c9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:41.543915 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 328/650] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:41.545170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46261026-cb4d-4d1c-9e16-ab5bcc61a7c9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:41.578384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384411a-2f5f-4216-9a6f-ea61044f83d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:41.579116 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384411a-2f5f-4216-9a6f-ea61044f83d2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:41.579401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384411a-2f5f-4216-9a6f-ea61044f83d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:41.579678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384411a-2f5f-4216-9a6f-ea61044f83d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:41.581926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:41.675953 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46261026-cb4d-4d1c-9e16-ab5bcc61a7c9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:41.679967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384411a-2f5f-4216-9a6f-ea61044f83d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:41.681490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384411a-2f5f-4216-9a6f-ea61044f83d2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:41.722990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf82706-0be8-4242-90e8-f08e311cd5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:41.723567 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf82706-0be8-4242-90e8-f08e311cd5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:41.723897 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf82706-0be8-4242-90e8-f08e311cd5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:41.724172 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf82706-0be8-4242-90e8-f08e311cd5d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:41.737390 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf82706-0be8-4242-90e8-f08e311cd5d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:41.738864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf82706-0be8-4242-90e8-f08e311cd5d4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ddf82706-0be8-4242-90e8-f08e311cd5d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:41.757932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:41.759580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:41.760553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:41.760553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:41.760553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:41.764576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 329/651] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:41.765499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf82706-0be8-4242-90e8-f08e311cd5d4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:41.774193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:41.827954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 323/652] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:41.829152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384411a-2f5f-4216-9a6f-ea61044f83d2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:41.868294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:41.897958 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf82706-0be8-4242-90e8-f08e311cd5d4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:41.945302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e776d4-9651-46b3-bc2a-ef2270d8d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:41.946648 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e776d4-9651-46b3-bc2a-ef2270d8d43c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:41.947155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e776d4-9651-46b3-bc2a-ef2270d8d43c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:41.947672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e776d4-9651-46b3-bc2a-ef2270d8d43c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:41.961610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384411a-2f5f-4216-9a6f-ea61044f83d2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:41.964234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e776d4-9651-46b3-bc2a-ef2270d8d43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:41.966839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e776d4-9651-46b3-bc2a-ef2270d8d43c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e8e776d4-9651-46b3-bc2a-ef2270d8d43c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:41.986267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:41.987235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:41.988181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:41.988181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:41.988181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:41.994222 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 330/653] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:41.994222 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e776d4-9651-46b3-bc2a-ef2270d8d43c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:42.011196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03c83e-fecc-497e-801f-f09b79c656ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:42.012248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c83e-fecc-497e-801f-f09b79c656ff None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:42.012733 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c83e-fecc-497e-801f-f09b79c656ff None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:42.013268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c83e-fecc-497e-801f-f09b79c656ff None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:42.014203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03c83e-fecc-497e-801f-f09b79c656ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:42.014821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03c83e-fecc-497e-801f-f09b79c656ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:42.016475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03c83e-fecc-497e-801f-f09b79c656ff None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:42.031489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 324/654] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:42.032745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03c83e-fecc-497e-801f-f09b79c656ff None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:42.066629 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:42.111798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e776d4-9651-46b3-bc2a-ef2270d8d43c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:42.139589 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:42.148024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32437718-73a0-41fa-b674-06a22938418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:42.148660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32437718-73a0-41fa-b674-06a22938418f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:42.148948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32437718-73a0-41fa-b674-06a22938418f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:42.149244 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32437718-73a0-41fa-b674-06a22938418f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:42.155531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03c83e-fecc-497e-801f-f09b79c656ff None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:42.161517 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32437718-73a0-41fa-b674-06a22938418f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:42.163139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32437718-73a0-41fa-b674-06a22938418f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-32437718-73a0-41fa-b674-06a22938418f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:42.181302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:42.182357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:42.183258 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:42.183258 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:42.183258 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:42.186865 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 331/655] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:42.188093 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32437718-73a0-41fa-b674-06a22938418f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:42.200666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a90ea9-53e0-427b-bbea-e33027f5cfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:42.201794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a90ea9-53e0-427b-bbea-e33027f5cfb7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:42.202529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a90ea9-53e0-427b-bbea-e33027f5cfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:42.203171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a90ea9-53e0-427b-bbea-e33027f5cfb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:42.204467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a90ea9-53e0-427b-bbea-e33027f5cfb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:42.205159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a90ea9-53e0-427b-bbea-e33027f5cfb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:42.207613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a90ea9-53e0-427b-bbea-e33027f5cfb7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:42.222738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 325/656] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:42.229425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a90ea9-53e0-427b-bbea-e33027f5cfb7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:42.298451 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32437718-73a0-41fa-b674-06a22938418f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:42.328753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:42.335184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948392a-cb0b-4b4d-a320-6043031671b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:42.335796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948392a-cb0b-4b4d-a320-6043031671b5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:42.336064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948392a-cb0b-4b4d-a320-6043031671b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:42.336336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948392a-cb0b-4b4d-a320-6043031671b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:42.345252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948392a-cb0b-4b4d-a320-6043031671b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:42.346928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948392a-cb0b-4b4d-a320-6043031671b5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:42.350979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a90ea9-53e0-427b-bbea-e33027f5cfb7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d948392a-cb0b-4b4d-a320-6043031671b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:42.360522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:42.361552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:42.362505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:42.362505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:42.362505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:42.362505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:42.362505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:42.362505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:42.362505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:42.362505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:42.362505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:25:42.362505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:42.366156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 332/657] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:42.367138 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948392a-cb0b-4b4d-a320-6043031671b5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:42.406765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85ead8-4c0c-4973-bce9-a5ce860d5d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:42.407392 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85ead8-4c0c-4973-bce9-a5ce860d5d41 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:42.407667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85ead8-4c0c-4973-bce9-a5ce860d5d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:42.407960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85ead8-4c0c-4973-bce9-a5ce860d5d41 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:42.408891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85ead8-4c0c-4973-bce9-a5ce860d5d41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:42.409193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85ead8-4c0c-4973-bce9-a5ce860d5d41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:42.410734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85ead8-4c0c-4973-bce9-a5ce860d5d41 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:42.427798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 326/658] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:42.429064 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85ead8-4c0c-4973-bce9-a5ce860d5d41 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:42.434547 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:42.514706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948392a-cb0b-4b4d-a320-6043031671b5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:42.556346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5944c1d-000d-4d02-86a4-de3b530b016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:42.557581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5944c1d-000d-4d02-86a4-de3b530b016a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:42.558069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5944c1d-000d-4d02-86a4-de3b530b016a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:42.558210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85ead8-4c0c-4973-bce9-a5ce860d5d41 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:42.558723 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5944c1d-000d-4d02-86a4-de3b530b016a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:42.567749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5944c1d-000d-4d02-86a4-de3b530b016a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:42.569747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5944c1d-000d-4d02-86a4-de3b530b016a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f5944c1d-000d-4d02-86a4-de3b530b016a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:42.582639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:42.583683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:42.584830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:42.584830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:42.584830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:42.584830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:42.584830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:42.584830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:42.584830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:42.584830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:42.584830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:25:42.584830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:42.592172 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 333/659] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:42.593647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5944c1d-000d-4d02-86a4-de3b530b016a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:42.595573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b14e6b-5b64-4e30-b092-2aa545b52d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:42.596248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b14e6b-5b64-4e30-b092-2aa545b52d59 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:42.596530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b14e6b-5b64-4e30-b092-2aa545b52d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:42.596805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b14e6b-5b64-4e30-b092-2aa545b52d59 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:42.597682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b14e6b-5b64-4e30-b092-2aa545b52d59 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:42.598088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b14e6b-5b64-4e30-b092-2aa545b52d59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:42.600243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b14e6b-5b64-4e30-b092-2aa545b52d59 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:42.624627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 327/660] 10.222.0.91 () {56 vars in 1137 bytes} [Wed Aug 24 10:25:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:42.624627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b14e6b-5b64-4e30-b092-2aa545b52d59 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:42.628721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:42.711241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:42.715414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5944c1d-000d-4d02-86a4-de3b530b016a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:42.737484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b14e6b-5b64-4e30-b092-2aa545b52d59 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:42.754278 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916db11a-4a4a-46d0-ab11-52cfbd1a04f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:42.755202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916db11a-4a4a-46d0-ab11-52cfbd1a04f0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:42.755503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916db11a-4a4a-46d0-ab11-52cfbd1a04f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:42.755904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916db11a-4a4a-46d0-ab11-52cfbd1a04f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:42.763807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916db11a-4a4a-46d0-ab11-52cfbd1a04f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:42.765250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916db11a-4a4a-46d0-ab11-52cfbd1a04f0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:42.776332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a57d06-64b0-4509-8d78-5671c4ddd650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:42.777052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a57d06-64b0-4509-8d78-5671c4ddd650 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-916db11a-4a4a-46d0-ab11-52cfbd1a04f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:42.777238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:42.778098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:42.779058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:42.779058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:42.779058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:42.779058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:42.779058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:42.779058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:42.779058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:42.779058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:42.779489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a57d06-64b0-4509-8d78-5671c4ddd650 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:42.779489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a57d06-64b0-4509-8d78-5671c4ddd650 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:42.779489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a57d06-64b0-4509-8d78-5671c4ddd650 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:42.779489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a57d06-64b0-4509-8d78-5671c4ddd650 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:42.780293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a57d06-64b0-4509-8d78-5671c4ddd650 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:42.783783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 334/661] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:42.783935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916db11a-4a4a-46d0-ab11-52cfbd1a04f0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:42.806476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 328/662] 10.222.0.91 () {56 vars in 1139 bytes} [Wed Aug 24 10:25:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:42.806476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbcb34-5e2b-4184-8e39-93ecdd7343b8 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:42.806476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbcb34-5e2b-4184-8e39-93ecdd7343b8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:42.806476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbcb34-5e2b-4184-8e39-93ecdd7343b8 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:42.807200 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 329/663] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:42.807921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbcb34-5e2b-4184-8e39-93ecdd7343b8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:42.882014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:42.910693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916db11a-4a4a-46d0-ab11-52cfbd1a04f0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:42.933824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbcb34-5e2b-4184-8e39-93ecdd7343b8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:42.954423 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7832-a5a2-4c9e-ac67-10c62089a0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:42.955336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7832-a5a2-4c9e-ac67-10c62089a0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:42.955843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7832-a5a2-4c9e-ac67-10c62089a0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:42.956169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7832-a5a2-4c9e-ac67-10c62089a0b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:42.970605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff038-4296-408b-be8d-6b4b327ff3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:42.971205 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff038-4296-408b-be8d-6b4b327ff3cc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:42.971483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff038-4296-408b-be8d-6b4b327ff3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:42.971770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff038-4296-408b-be8d-6b4b327ff3cc None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:42.972457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cff038-4296-408b-be8d-6b4b327ff3cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:42.972757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cff038-4296-408b-be8d-6b4b327ff3cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:42.974330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cff038-4296-408b-be8d-6b4b327ff3cc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:42.991983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 330/664] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:42.991983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff038-4296-408b-be8d-6b4b327ff3cc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:42.994685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:43.045729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c7832-a5a2-4c9e-ac67-10c62089a0b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:43.047241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c7832-a5a2-4c9e-ac67-10c62089a0b2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:43.111777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff038-4296-408b-be8d-6b4b327ff3cc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:43.138639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:43.153440 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673ab31-bf6e-4e6b-842d-ee2a9beb6874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:43.154047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673ab31-bf6e-4e6b-842d-ee2a9beb6874 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:43.154320 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673ab31-bf6e-4e6b-842d-ee2a9beb6874 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:43.154601 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673ab31-bf6e-4e6b-842d-ee2a9beb6874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:43.169476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 335/665] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:43.171456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb7adb-b6f9-4ea8-8b79-e05281cf88c3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:43.171828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb7adb-b6f9-4ea8-8b79-e05281cf88c3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:43.172178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb7adb-b6f9-4ea8-8b79-e05281cf88c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:43.192651 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-40bb7adb-b6f9-4ea8-8b79-e05281cf88c3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:43.193947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-40bb7adb-b6f9-4ea8-8b79-e05281cf88c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:43.233874 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673ab31-bf6e-4e6b-842d-ee2a9beb6874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:43.235323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673ab31-bf6e-4e6b-842d-ee2a9beb6874 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:43.256232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:43.267735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 336/666] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:43.268594 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb7adb-b6f9-4ea8-8b79-e05281cf88c3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:43.350420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 331/667] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:43.351181 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673ab31-bf6e-4e6b-842d-ee2a9beb6874 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:43.377417 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:43.394617 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb7adb-b6f9-4ea8-8b79-e05281cf88c3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:43.434278 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e811cd0-7c87-4640-a388-975b64203f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:43.434986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e811cd0-7c87-4640-a388-975b64203f98 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:43.435319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e811cd0-7c87-4640-a388-975b64203f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:43.436636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e811cd0-7c87-4640-a388-975b64203f98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:43.436636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e811cd0-7c87-4640-a388-975b64203f98 None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=75138f08ea2b4813b095635d920599d2) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:43.436832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e811cd0-7c87-4640-a388-975b64203f98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:43.438358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e811cd0-7c87-4640-a388-975b64203f98 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:43.455511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 337/668] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:43 2022] GET /identity/v3/role_assignments?user.id=75138f08ea2b4813b095635d920599d2&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:43.455511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699c12-738b-4801-b860-55a013bc2eb3 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:43.455511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699c12-738b-4801-b860-55a013bc2eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:43.455511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699c12-738b-4801-b860-55a013bc2eb3 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:43.455511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 338/669] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:43.455511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1699c12-738b-4801-b860-55a013bc2eb3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:43.481800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673ab31-bf6e-4e6b-842d-ee2a9beb6874 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:43.530660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c50d08-c28e-4fbb-9489-967c810fa23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:43.531589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c50d08-c28e-4fbb-9489-967c810fa23f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:43.532098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c50d08-c28e-4fbb-9489-967c810fa23f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:43.532575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c50d08-c28e-4fbb-9489-967c810fa23f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:43.544442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:43.550073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c50d08-c28e-4fbb-9489-967c810fa23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:43.551820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c50d08-c28e-4fbb-9489-967c810fa23f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f1c50d08-c28e-4fbb-9489-967c810fa23f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:43.568196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:43.569462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:43.575834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:43.575834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:43.575834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:43.575834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 332/670] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:43.575834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f91dd-2d03-4e95-88f6-de1c39cabf0f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:43.575834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f91dd-2d03-4e95-88f6-de1c39cabf0f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:43.575834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f91dd-2d03-4e95-88f6-de1c39cabf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:43.594479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fa9f91dd-2d03-4e95-88f6-de1c39cabf0f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:43.595761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fa9f91dd-2d03-4e95-88f6-de1c39cabf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:43.619110 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1699c12-738b-4801-b860-55a013bc2eb3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:43.663349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f57753-368d-4f3f-8b40-233bac7d01b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:43.663815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f57753-368d-4f3f-8b40-233bac7d01b5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:43.664100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f57753-368d-4f3f-8b40-233bac7d01b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:43.664365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f57753-368d-4f3f-8b40-233bac7d01b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:43.677570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f57753-368d-4f3f-8b40-233bac7d01b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:43.679040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f57753-368d-4f3f-8b40-233bac7d01b5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:43.690517 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 333/671] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:43.691379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f91dd-2d03-4e95-88f6-de1c39cabf0f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:43.694979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-75f57753-368d-4f3f-8b40-233bac7d01b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:43.695776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:43.696785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:43.697717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:43.697717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:43.697717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:43.697717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 339/672] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:43.697957 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f57753-368d-4f3f-8b40-233bac7d01b5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:43.818468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f91dd-2d03-4e95-88f6-de1c39cabf0f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:43.836070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f57753-368d-4f3f-8b40-233bac7d01b5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:43.844348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:43.859224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842b725-2f43-4a28-b396-582338da6ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:43.859914 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842b725-2f43-4a28-b396-582338da6ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:43.860194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842b725-2f43-4a28-b396-582338da6ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:43.860465 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842b725-2f43-4a28-b396-582338da6ad9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:43.873384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842b725-2f43-4a28-b396-582338da6ad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:43.873722 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cb40a-3e90-4c1e-8ec1-a227d025010f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:43.874268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cb40a-3e90-4c1e-8ec1-a227d025010f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:43.874551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cb40a-3e90-4c1e-8ec1-a227d025010f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:43.874826 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cb40a-3e90-4c1e-8ec1-a227d025010f None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:43.875472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cb40a-3e90-4c1e-8ec1-a227d025010f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:43.875803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cb40a-3e90-4c1e-8ec1-a227d025010f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:43.877209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cb40a-3e90-4c1e-8ec1-a227d025010f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c842b725-2f43-4a28-b396-582338da6ad9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:43.878399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:43.879328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:43.880305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:43.880305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:43.880305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:43.880305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:43.880305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:43.880305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:43.880305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:43.880305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:43.880305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:43.880305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:43.880305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:43.880305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:43.884706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 334/673] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:43.886651 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842b725-2f43-4a28-b396-582338da6ad9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:43.891165 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 340/674] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:43.899106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cb40a-3e90-4c1e-8ec1-a227d025010f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:43.964109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:44.003908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842b725-2f43-4a28-b396-582338da6ad9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:44.014533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cb40a-3e90-4c1e-8ec1-a227d025010f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:44.048843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800cbc4-f96a-47cf-aab8-26c382565bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:44.049476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800cbc4-f96a-47cf-aab8-26c382565bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:44.049752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800cbc4-f96a-47cf-aab8-26c382565bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:44.050083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800cbc4-f96a-47cf-aab8-26c382565bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:44.050829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800cbc4-f96a-47cf-aab8-26c382565bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:44.051046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800cbc4-f96a-47cf-aab8-26c382565bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:44.052489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800cbc4-f96a-47cf-aab8-26c382565bf8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:44.065880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de5a6a-4b62-4c1d-a421-2fc5200c8d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:44.066088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 335/675] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:44.067009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800cbc4-f96a-47cf-aab8-26c382565bf8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:44.067235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5a6a-4b62-4c1d-a421-2fc5200c8d8e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:44.067710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5a6a-4b62-4c1d-a421-2fc5200c8d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:44.068097 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5a6a-4b62-4c1d-a421-2fc5200c8d8e None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:44.068779 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5a6a-4b62-4c1d-a421-2fc5200c8d8e None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:44.069090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5a6a-4b62-4c1d-a421-2fc5200c8d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:44.071813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5a6a-4b62-4c1d-a421-2fc5200c8d8e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:44.080583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 341/676] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:44.080583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de5a6a-4b62-4c1d-a421-2fc5200c8d8e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:44.115099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:44.194366 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800cbc4-f96a-47cf-aab8-26c382565bf8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:44.209968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de5a6a-4b62-4c1d-a421-2fc5200c8d8e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:44.223843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:44.237007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861132b5-f70d-44aa-ba9a-6f777e2234e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:44.237650 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861132b5-f70d-44aa-ba9a-6f777e2234e0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:44.238506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861132b5-f70d-44aa-ba9a-6f777e2234e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:44.238787 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861132b5-f70d-44aa-ba9a-6f777e2234e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:44.246982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861132b5-f70d-44aa-ba9a-6f777e2234e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:44.248473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861132b5-f70d-44aa-ba9a-6f777e2234e0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:44.257091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc25749-23c9-4911-b432-a15724744363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:44.257785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc25749-23c9-4911-b432-a15724744363 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:44.258072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc25749-23c9-4911-b432-a15724744363 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:44.258341 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc25749-23c9-4911-b432-a15724744363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-861132b5-f70d-44aa-ba9a-6f777e2234e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:44.265142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:44.266067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:44.266954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:44.266954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:44.266954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:44.266954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:44.266954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:44.266954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:44.266954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:44.266954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:44.275493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 336/677] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:44.275493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861132b5-f70d-44aa-ba9a-6f777e2234e0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:44.283427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc25749-23c9-4911-b432-a15724744363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7dc25749-23c9-4911-b432-a15724744363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:44.289117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:44.290710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:44.291564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 342/678] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:44.293080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc25749-23c9-4911-b432-a15724744363 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:44.396587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861132b5-f70d-44aa-ba9a-6f777e2234e0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:44.397011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:44.411361 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc25749-23c9-4911-b432-a15724744363 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:44.440420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f3d68-4337-4549-a060-f6bf17c5e0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:44.441048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f3d68-4337-4549-a060-f6bf17c5e0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:44.441321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f3d68-4337-4549-a060-f6bf17c5e0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:44.441695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f3d68-4337-4549-a060-f6bf17c5e0b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:44.449217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f3d68-4337-4549-a060-f6bf17c5e0b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:44.449764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc40bf-3bc7-40f1-81fc-d30c1ec1078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:44.450403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc40bf-3bc7-40f1-81fc-d30c1ec1078f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:44.450681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc40bf-3bc7-40f1-81fc-d30c1ec1078f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:44.450793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f3d68-4337-4549-a060-f6bf17c5e0b1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:44.450968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc40bf-3bc7-40f1-81fc-d30c1ec1078f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ce0f3d68-4337-4549-a060-f6bf17c5e0b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:44.462761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:44.463864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:44.464760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:44.464760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:44.464760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:44.464760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:44.464760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:44.464760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:44.464760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:44.464760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:44.465207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc40bf-3bc7-40f1-81fc-d30c1ec1078f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:44.465207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc40bf-3bc7-40f1-81fc-d30c1ec1078f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:44.468771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 337/679] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:44.469683 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f3d68-4337-4549-a060-f6bf17c5e0b1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-49cc40bf-3bc7-40f1-81fc-d30c1ec1078f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:44.481484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:44.482780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:44.483666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:44.483666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:44.483666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:44.483666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 343/680] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:44.483666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc40bf-3bc7-40f1-81fc-d30c1ec1078f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:44.525953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:44.593329 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f3d68-4337-4549-a060-f6bf17c5e0b1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:44.603544 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc40bf-3bc7-40f1-81fc-d30c1ec1078f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:44.639334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb994920-5d0e-4240-a1a9-b83a7b2faf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:44.639978 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb994920-5d0e-4240-a1a9-b83a7b2faf15 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:44.640260 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb994920-5d0e-4240-a1a9-b83a7b2faf15 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:44.640538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb994920-5d0e-4240-a1a9-b83a7b2faf15 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:44.641229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb994920-5d0e-4240-a1a9-b83a7b2faf15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:44.641472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c86c4b-6340-41fb-bbc4-10578128ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:44.641590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb994920-5d0e-4240-a1a9-b83a7b2faf15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:44.642084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c86c4b-6340-41fb-bbc4-10578128ca0e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:44.642362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c86c4b-6340-41fb-bbc4-10578128ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:44.643399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c86c4b-6340-41fb-bbc4-10578128ca0e None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:44.643535 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb994920-5d0e-4240-a1a9-b83a7b2faf15 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:44.643616 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c86c4b-6340-41fb-bbc4-10578128ca0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:44.643616 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c86c4b-6340-41fb-bbc4-10578128ca0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:44.645003 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c86c4b-6340-41fb-bbc4-10578128ca0e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:44.657483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 338/681] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:44.657706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 344/682] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:44.662431 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb994920-5d0e-4240-a1a9-b83a7b2faf15 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:44.662604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c86c4b-6340-41fb-bbc4-10578128ca0e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:44.664037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:44.781368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c86c4b-6340-41fb-bbc4-10578128ca0e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:44.798361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb994920-5d0e-4240-a1a9-b83a7b2faf15 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:44.801929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:44.824479 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b76a94-8faf-4c8a-a8c4-722340a70e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:44.825093 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b76a94-8faf-4c8a-a8c4-722340a70e78 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:44.825524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b76a94-8faf-4c8a-a8c4-722340a70e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:44.825698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b76a94-8faf-4c8a-a8c4-722340a70e78 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:44.826274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b76a94-8faf-4c8a-a8c4-722340a70e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:44.826570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b76a94-8faf-4c8a-a8c4-722340a70e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:44.828038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b76a94-8faf-4c8a-a8c4-722340a70e78 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:44.844833 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 345/683] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:44.844833 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b76a94-8faf-4c8a-a8c4-722340a70e78 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:44.846929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d35fc7-8dc0-4a91-b4ce-6fcab21dd2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:44.847662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d35fc7-8dc0-4a91-b4ce-6fcab21dd2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:44.847890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d35fc7-8dc0-4a91-b4ce-6fcab21dd2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:44.848159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d35fc7-8dc0-4a91-b4ce-6fcab21dd2f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:44.849234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d35fc7-8dc0-4a91-b4ce-6fcab21dd2f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:44.849234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d35fc7-8dc0-4a91-b4ce-6fcab21dd2f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:44.850554 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d35fc7-8dc0-4a91-b4ce-6fcab21dd2f2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:44.870949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 339/684] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:44.870949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d35fc7-8dc0-4a91-b4ce-6fcab21dd2f2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:44.931789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:44.976742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b76a94-8faf-4c8a-a8c4-722340a70e78 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:44.981678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d35fc7-8dc0-4a91-b4ce-6fcab21dd2f2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:45.020084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1088f0-aa92-44bf-b245-5490f9748b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:45.020975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1088f0-aa92-44bf-b245-5490f9748b1b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:45.021282 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1088f0-aa92-44bf-b245-5490f9748b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:45.021540 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1088f0-aa92-44bf-b245-5490f9748b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:45.026212 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc7e74-df6b-44dd-a871-e13120920bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:45.027037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc7e74-df6b-44dd-a871-e13120920bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:45.027476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc7e74-df6b-44dd-a871-e13120920bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:45.027921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc7e74-df6b-44dd-a871-e13120920bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:45.028785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc7e74-df6b-44dd-a871-e13120920bb9 None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=dc05a509ea1c4aa582380541cfc37989) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:45.029219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc7e74-df6b-44dd-a871-e13120920bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:45.030794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc7e74-df6b-44dd-a871-e13120920bb9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:45.034030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1088f0-aa92-44bf-b245-5490f9748b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:45.035964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1088f0-aa92-44bf-b245-5490f9748b1b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:45.048147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 340/685] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:44 2022] GET /identity/v3/role_assignments?user.id=dc05a509ea1c4aa582380541cfc37989&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:45.048147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc7e74-df6b-44dd-a871-e13120920bb9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-1b1088f0-aa92-44bf-b245-5490f9748b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:45.069273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:45.070524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:45.071774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:45.071774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:45.071774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:45.073699 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 346/686] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:45.074851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1088f0-aa92-44bf-b245-5490f9748b1b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:45.091013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:45.204732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc7e74-df6b-44dd-a871-e13120920bb9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:45.234794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1088f0-aa92-44bf-b245-5490f9748b1b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:45.255269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:45.256098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c0078-d191-4bed-b0c3-b43089212f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:45.256748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c0078-d191-4bed-b0c3-b43089212f72 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:45.257028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c0078-d191-4bed-b0c3-b43089212f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:45.257297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c0078-d191-4bed-b0c3-b43089212f72 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:45.269340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c0078-d191-4bed-b0c3-b43089212f72 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:45.272384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c0078-d191-4bed-b0c3-b43089212f72 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-da3c0078-d191-4bed-b0c3-b43089212f72 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:45.289398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:45.290938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:45.292699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:45.292699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:45.292699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:45.292699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:45.292699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:45.292699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:45.292699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:45.292699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:45.292699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:25:45.292699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:45.293254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e767f96-2232-411d-81a6-44bd1a78554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:45.293345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 341/687] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:45.293345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c0078-d191-4bed-b0c3-b43089212f72 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:45.295799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e767f96-2232-411d-81a6-44bd1a78554c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:45.296168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e767f96-2232-411d-81a6-44bd1a78554c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:45.296696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e767f96-2232-411d-81a6-44bd1a78554c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:45.297692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e767f96-2232-411d-81a6-44bd1a78554c None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=8956453f963242a087d2f90d70ed8f8f) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:45.298279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e767f96-2232-411d-81a6-44bd1a78554c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:45.300006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e767f96-2232-411d-81a6-44bd1a78554c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:45.311938 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 347/688] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:45 2022] GET /identity/v3/role_assignments?user.id=8956453f963242a087d2f90d70ed8f8f&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:45.313509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e767f96-2232-411d-81a6-44bd1a78554c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:45.460257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:45.483520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e767f96-2232-411d-81a6-44bd1a78554c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:45.489920 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c0078-d191-4bed-b0c3-b43089212f72 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:45.525903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb096f54-e0de-4113-9a8c-5da1ca2999bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:45.526527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb096f54-e0de-4113-9a8c-5da1ca2999bf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:45.526802 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb096f54-e0de-4113-9a8c-5da1ca2999bf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:45.527075 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb096f54-e0de-4113-9a8c-5da1ca2999bf None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:45.527852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb096f54-e0de-4113-9a8c-5da1ca2999bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:45.528157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb096f54-e0de-4113-9a8c-5da1ca2999bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:45.529684 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb096f54-e0de-4113-9a8c-5da1ca2999bf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:45.530287 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d3daf-6fa8-4b55-afbe-4cd26465b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:45.530900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d3daf-6fa8-4b55-afbe-4cd26465b223 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:45.531178 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d3daf-6fa8-4b55-afbe-4cd26465b223 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:45.531563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d3daf-6fa8-4b55-afbe-4cd26465b223 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:45.532247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d3daf-6fa8-4b55-afbe-4cd26465b223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:45.532647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d3daf-6fa8-4b55-afbe-4cd26465b223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:45.534089 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d3daf-6fa8-4b55-afbe-4cd26465b223 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:45.549130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 342/689] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:45.551470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 348/690] 10.222.0.91 () {56 vars in 1135 bytes} [Wed Aug 24 10:25:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:45.554747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d3daf-6fa8-4b55-afbe-4cd26465b223 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:45.558201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb096f54-e0de-4113-9a8c-5da1ca2999bf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:45.602266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:45.681972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d3daf-6fa8-4b55-afbe-4cd26465b223 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:45.693030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb096f54-e0de-4113-9a8c-5da1ca2999bf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:45.723743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bc94b-80b4-444e-a6a4-9961b2314b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:45.724721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bc94b-80b4-444e-a6a4-9961b2314b16 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:45.725444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bc94b-80b4-444e-a6a4-9961b2314b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:45.725720 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bc94b-80b4-444e-a6a4-9961b2314b16 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:45.730655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ff3b6-489c-416c-84f7-1491749c75ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:45.731266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ff3b6-489c-416c-84f7-1491749c75ad None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:45.731536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ff3b6-489c-416c-84f7-1491749c75ad None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:45.731830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ff3b6-489c-416c-84f7-1491749c75ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:45.734150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bc94b-80b4-444e-a6a4-9961b2314b16 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:45.736998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bc94b-80b4-444e-a6a4-9961b2314b16 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-394bc94b-80b4-444e-a6a4-9961b2314b16 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:45.754767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:45.755877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:45.756910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:45.756910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:45.756910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:45.756910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:45.756910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:45.756910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:45.756910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:45.756910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:45.756910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:25:45.756910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:45.756910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 343/691] 10.222.0.91 () {56 vars in 1093 bytes} [Wed Aug 24 10:25:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:45.763642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e347c0-43c9-4bfd-a45c-d270f47b8f31 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:45.763642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e347c0-43c9-4bfd-a45c-d270f47b8f31 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:45.763642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e347c0-43c9-4bfd-a45c-d270f47b8f31 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:45.763642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 344/692] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:45.768103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e347c0-43c9-4bfd-a45c-d270f47b8f31 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:45.782595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:45.831277 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ff3b6-489c-416c-84f7-1491749c75ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:45.832898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ff3b6-489c-416c-84f7-1491749c75ad None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:45.878677 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:45.905819 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e347c0-43c9-4bfd-a45c-d270f47b8f31 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:45.952403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b23db2-6068-443e-a1e4-ea71e6b68e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:45.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b23db2-6068-443e-a1e4-ea71e6b68e7a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:45.954179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b23db2-6068-443e-a1e4-ea71e6b68e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:45.954607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b23db2-6068-443e-a1e4-ea71e6b68e7a None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:45.955485 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b23db2-6068-443e-a1e4-ea71e6b68e7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:45.956006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b23db2-6068-443e-a1e4-ea71e6b68e7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:45.957917 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b23db2-6068-443e-a1e4-ea71e6b68e7a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:45.978655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 349/693] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:25:45.980264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f1ec8-77a1-4d86-8a2f-c8f0e9f76c65 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:45.980685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f1ec8-77a1-4d86-8a2f-c8f0e9f76c65 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:45.980968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 345/694] 10.222.0.91 () {56 vars in 1133 bytes} [Wed Aug 24 10:25:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:45.984649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b23db2-6068-443e-a1e4-ea71e6b68e7a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:45.985098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f1ec8-77a1-4d86-8a2f-c8f0e9f76c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:46.009155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4f3f1ec8-77a1-4d86-8a2f-c8f0e9f76c65 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:46.011047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4f3f1ec8-77a1-4d86-8a2f-c8f0e9f76c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:46.072751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:46.091354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 350/695] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:46.092637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f1ec8-77a1-4d86-8a2f-c8f0e9f76c65 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:46.132162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b23db2-6068-443e-a1e4-ea71e6b68e7a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:46.181462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18df68-baf4-4834-a6f8-d495c1393201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:46.183595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18df68-baf4-4834-a6f8-d495c1393201 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:46.184872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18df68-baf4-4834-a6f8-d495c1393201 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:46.185216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18df68-baf4-4834-a6f8-d495c1393201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:46.193994 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:46.211012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18df68-baf4-4834-a6f8-d495c1393201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:46.218357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18df68-baf4-4834-a6f8-d495c1393201 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-fc18df68-baf4-4834-a6f8-d495c1393201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:46.249051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:46.250739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:46.252083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:46.252083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:46.252083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:46.255245 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 346/696] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:46.255517 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f1ec8-77a1-4d86-8a2f-c8f0e9f76c65 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:46.260069 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18df68-baf4-4834-a6f8-d495c1393201 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:46.302887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e13f-95b5-489e-8fc9-6e851b795117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:46.303511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e13f-95b5-489e-8fc9-6e851b795117 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:46.303862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e13f-95b5-489e-8fc9-6e851b795117 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:46.304076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e13f-95b5-489e-8fc9-6e851b795117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:46.433120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18df68-baf4-4834-a6f8-d495c1393201 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:46.460040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:46.475012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37e13f-95b5-489e-8fc9-6e851b795117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:46.477161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37e13f-95b5-489e-8fc9-6e851b795117 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:46.480373 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99635122-c1f5-44c9-9272-b08ec618a14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:46.481755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99635122-c1f5-44c9-9272-b08ec618a14f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:46.481755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99635122-c1f5-44c9-9272-b08ec618a14f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:46.481755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99635122-c1f5-44c9-9272-b08ec618a14f None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:46.483014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99635122-c1f5-44c9-9272-b08ec618a14f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:46.483665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99635122-c1f5-44c9-9272-b08ec618a14f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:46.485438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99635122-c1f5-44c9-9272-b08ec618a14f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:46.507997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 347/697] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:46.509457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99635122-c1f5-44c9-9272-b08ec618a14f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:46.566186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:46.623136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 351/698] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:46.625247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e13f-95b5-489e-8fc9-6e851b795117 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:46.657884 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99635122-c1f5-44c9-9272-b08ec618a14f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:46.705225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738cddd-ccff-420e-b8aa-8480ab920bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:46.706088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738cddd-ccff-420e-b8aa-8480ab920bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:46.706374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738cddd-ccff-420e-b8aa-8480ab920bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:46.706700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738cddd-ccff-420e-b8aa-8480ab920bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:46.721868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738cddd-ccff-420e-b8aa-8480ab920bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:46.723222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738cddd-ccff-420e-b8aa-8480ab920bc7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8738cddd-ccff-420e-b8aa-8480ab920bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:46.742916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:46.744197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:46.745336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:46.745336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:46.745336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:46.745336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 348/699] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:46.745975 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738cddd-ccff-420e-b8aa-8480ab920bc7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:46.761392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e13f-95b5-489e-8fc9-6e851b795117 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:46.787760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:46.811680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e30c-36e1-4083-aa4e-6e73ff4af31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:46.812655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e30c-36e1-4083-aa4e-6e73ff4af31c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:46.813160 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e30c-36e1-4083-aa4e-6e73ff4af31c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:46.814892 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e30c-36e1-4083-aa4e-6e73ff4af31c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:46.825491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3e30c-36e1-4083-aa4e-6e73ff4af31c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:46.828958 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3e30c-36e1-4083-aa4e-6e73ff4af31c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-66e3e30c-36e1-4083-aa4e-6e73ff4af31c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:46.844116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:46.845079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:46.845982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:46.845982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:46.845982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:46.845982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:46.845982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:46.845982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:46.845982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:46.845982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:46.845982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 352/700] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:46.846703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e30c-36e1-4083-aa4e-6e73ff4af31c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:46.883193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:46.889652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738cddd-ccff-420e-b8aa-8480ab920bc7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:46.941803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc49c9-ad2b-4d1d-b448-e51abe0d468e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:46.942467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc49c9-ad2b-4d1d-b448-e51abe0d468e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:46.942708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc49c9-ad2b-4d1d-b448-e51abe0d468e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:46.942980 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc49c9-ad2b-4d1d-b448-e51abe0d468e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:46.958376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc49c9-ad2b-4d1d-b448-e51abe0d468e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:46.958376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc49c9-ad2b-4d1d-b448-e51abe0d468e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4cbc49c9-ad2b-4d1d-b448-e51abe0d468e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:46.978632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:46.980108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:46.981065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:46.981065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:46.981065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:46.981065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 349/701] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:46.981065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc49c9-ad2b-4d1d-b448-e51abe0d468e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:46.982564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e30c-36e1-4083-aa4e-6e73ff4af31c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:47.033550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84117d-e25c-4b03-84db-080430fc3b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:47.034157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84117d-e25c-4b03-84db-080430fc3b69 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:47.034642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84117d-e25c-4b03-84db-080430fc3b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:47.034946 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84117d-e25c-4b03-84db-080430fc3b69 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:47.035709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84117d-e25c-4b03-84db-080430fc3b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:47.036045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84117d-e25c-4b03-84db-080430fc3b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:47.037711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84117d-e25c-4b03-84db-080430fc3b69 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:47.059593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 353/702] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:47.059593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84117d-e25c-4b03-84db-080430fc3b69 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:47.094726 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:47.120448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc49c9-ad2b-4d1d-b448-e51abe0d468e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:47.167682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbbc20-5078-475b-9021-7f1888d84c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:47.168690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbbc20-5078-475b-9021-7f1888d84c4e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:47.169170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbbc20-5078-475b-9021-7f1888d84c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:47.169637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbbc20-5078-475b-9021-7f1888d84c4e None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:47.170543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbbc20-5078-475b-9021-7f1888d84c4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:47.171048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbbc20-5078-475b-9021-7f1888d84c4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:47.172850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbbc20-5078-475b-9021-7f1888d84c4e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:47.173791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:47.192249 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 350/703] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:47.192776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84117d-e25c-4b03-84db-080430fc3b69 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:47.193806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbbc20-5078-475b-9021-7f1888d84c4e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:47.243184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090313d-ec62-4b98-9dae-5055174e7f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:47.244230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090313d-ec62-4b98-9dae-5055174e7f23 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:47.244809 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090313d-ec62-4b98-9dae-5055174e7f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:47.245286 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090313d-ec62-4b98-9dae-5055174e7f23 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:47.246183 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090313d-ec62-4b98-9dae-5055174e7f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:47.246715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090313d-ec62-4b98-9dae-5055174e7f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:47.248354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090313d-ec62-4b98-9dae-5055174e7f23 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:47.264598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 354/704] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:47.266299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090313d-ec62-4b98-9dae-5055174e7f23 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:47.354596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbbc20-5078-475b-9021-7f1888d84c4e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:47.387233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090313d-ec62-4b98-9dae-5055174e7f23 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:47.397691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd9e1c-7683-4654-b8f7-6eb11f0d9327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:47.398293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9e1c-7683-4654-b8f7-6eb11f0d9327 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:47.398573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9e1c-7683-4654-b8f7-6eb11f0d9327 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:47.398843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9e1c-7683-4654-b8f7-6eb11f0d9327 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:47.400380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd9e1c-7683-4654-b8f7-6eb11f0d9327 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:47.401679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd9e1c-7683-4654-b8f7-6eb11f0d9327 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:47.437534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0400a10-3051-4146-bb0d-a5a799f19dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:47.437534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0400a10-3051-4146-bb0d-a5a799f19dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:47.437534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0400a10-3051-4146-bb0d-a5a799f19dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:47.437534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0400a10-3051-4146-bb0d-a5a799f19dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:47.437934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0400a10-3051-4146-bb0d-a5a799f19dd5 None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=4671efa1526643cdb32f56d44903db1d) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:47.437934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0400a10-3051-4146-bb0d-a5a799f19dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:47.437934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0400a10-3051-4146-bb0d-a5a799f19dd5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:47.437934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 355/705] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:47 2022] GET /identity/v3/role_assignments?user.id=4671efa1526643cdb32f56d44903db1d&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:47.438629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9fb2f-d5a7-4ea3-9598-873b9473d9c8 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:47.438700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9fb2f-d5a7-4ea3-9598-873b9473d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:47.438974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9fb2f-d5a7-4ea3-9598-873b9473d9c8 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:47.440541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 356/706] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:47.445652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9fb2f-d5a7-4ea3-9598-873b9473d9c8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:47.463902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:47.495976 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:47.512853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 351/707] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:25:47 2022] POST /identity/v3/users => generated 254 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:25:47.514746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cc1ef-ad4b-4245-8bb9-bb6fa12f4d28 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:47.515311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cc1ef-ad4b-4245-8bb9-bb6fa12f4d28 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:47.516472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cc1ef-ad4b-4245-8bb9-bb6fa12f4d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:47.544383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-685cc1ef-ad4b-4245-8bb9-bb6fa12f4d28 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:47.546657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-685cc1ef-ad4b-4245-8bb9-bb6fa12f4d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:47.623116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9fb2f-d5a7-4ea3-9598-873b9473d9c8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:47.643903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 352/708] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:47.658682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487d938-40e4-405b-825d-67c1b3369fa7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:47.658994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487d938-40e4-405b-825d-67c1b3369fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:47.659297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487d938-40e4-405b-825d-67c1b3369fa7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:47.661162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 353/709] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:47.667588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbff0b-25fe-4bd3-8800-c24da4e516a8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:47.667960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbff0b-25fe-4bd3-8800-c24da4e516a8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:47.668196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbff0b-25fe-4bd3-8800-c24da4e516a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:47.682075 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b81b2-477c-43ff-8dad-71b87c2e347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:47.683580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b81b2-477c-43ff-8dad-71b87c2e347f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:47.684473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b81b2-477c-43ff-8dad-71b87c2e347f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:47.684998 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b81b2-477c-43ff-8dad-71b87c2e347f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:47.691673 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d9dbff0b-25fe-4bd3-8800-c24da4e516a8 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:47.692927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d9dbff0b-25fe-4bd3-8800-c24da4e516a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:47.695444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b81b2-477c-43ff-8dad-71b87c2e347f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:47.698966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b81b2-477c-43ff-8dad-71b87c2e347f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-301b81b2-477c-43ff-8dad-71b87c2e347f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:47.713837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:47.714806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:47.715760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:47.715760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:47.715760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:47.715760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:47.715760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:47.715760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:47.715760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:47.715760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:47.718404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 357/710] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:47.723785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b81b2-477c-43ff-8dad-71b87c2e347f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:47.804492 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 354/711] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:25:47.832188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:47.866235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b81b2-477c-43ff-8dad-71b87c2e347f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:47.955570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1253556-dc93-443c-b1bf-f70e338de65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:47.956176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1253556-dc93-443c-b1bf-f70e338de65e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:47.956453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1253556-dc93-443c-b1bf-f70e338de65e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:47.956723 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1253556-dc93-443c-b1bf-f70e338de65e None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:47.957417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1253556-dc93-443c-b1bf-f70e338de65e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:47.957721 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1253556-dc93-443c-b1bf-f70e338de65e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:47.959170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbff0b-25fe-4bd3-8800-c24da4e516a8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:47.959605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1253556-dc93-443c-b1bf-f70e338de65e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:47.977736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 358/712] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:47.984292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1253556-dc93-443c-b1bf-f70e338de65e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:48.077803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:48.102232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1253556-dc93-443c-b1bf-f70e338de65e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:48.143100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:48.147517 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b96631-22d7-4bb5-89ff-55ec4cb4670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:48.150102 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b96631-22d7-4bb5-89ff-55ec4cb4670a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:48.150427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b96631-22d7-4bb5-89ff-55ec4cb4670a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:48.150822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b96631-22d7-4bb5-89ff-55ec4cb4670a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:48.152005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b96631-22d7-4bb5-89ff-55ec4cb4670a None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=4ae21e13a4414168bd1741dfd642274a) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:48.159196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b96631-22d7-4bb5-89ff-55ec4cb4670a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:48.159196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b96631-22d7-4bb5-89ff-55ec4cb4670a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:48.159394 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbff0b-25fe-4bd3-8800-c24da4e516a8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:48.162998 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 359/713] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:47 2022] GET /identity/v3/role_assignments?user.id=4ae21e13a4414168bd1741dfd642274a&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=60abeefc9ac84e31a0162ac559220669 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:48.168638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b96631-22d7-4bb5-89ff-55ec4cb4670a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:48.225390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457f39e-8edb-480d-b9cd-450792b60cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:48.225968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457f39e-8edb-480d-b9cd-450792b60cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:48.226241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457f39e-8edb-480d-b9cd-450792b60cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:48.226510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457f39e-8edb-480d-b9cd-450792b60cc7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:48.227622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457f39e-8edb-480d-b9cd-450792b60cc7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:48.229109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457f39e-8edb-480d-b9cd-450792b60cc7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c457f39e-8edb-480d-b9cd-450792b60cc7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:48.252868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:48.254291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:48.256390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 355/714] 10.222.0.91 () {56 vars in 1129 bytes} [Wed Aug 24 10:25:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:48.262527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457f39e-8edb-480d-b9cd-450792b60cc7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:48.362449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b96631-22d7-4bb5-89ff-55ec4cb4670a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:48.434764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16399ab-14c0-417f-ba2a-2788c8bb6e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:48.435427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16399ab-14c0-417f-ba2a-2788c8bb6e5f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:48.435704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16399ab-14c0-417f-ba2a-2788c8bb6e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:48.436002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16399ab-14c0-417f-ba2a-2788c8bb6e5f None admin] PATH_INFO: `/v3/services/network` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:48.436597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16399ab-14c0-417f-ba2a-2788c8bb6e5f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:48.438402 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16399ab-14c0-417f-ba2a-2788c8bb6e5f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:48.464095 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457f39e-8edb-480d-b9cd-450792b60cc7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e16399ab-14c0-417f-ba2a-2788c8bb6e5f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:48.466188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:48.467170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:25:48.468089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:48.469024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 360/715] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:48 2022] GET /identity/v3/services/network => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:48.476521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16399ab-14c0-417f-ba2a-2788c8bb6e5f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:48.508164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:48.516700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa27573-ff9a-4ae0-8975-29c5c57169fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:48.517568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa27573-ff9a-4ae0-8975-29c5c57169fe None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:48.517887 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa27573-ff9a-4ae0-8975-29c5c57169fe None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:48.518161 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa27573-ff9a-4ae0-8975-29c5c57169fe None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:48.518806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa27573-ff9a-4ae0-8975-29c5c57169fe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:48.519111 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa27573-ff9a-4ae0-8975-29c5c57169fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:48.520819 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa27573-ff9a-4ae0-8975-29c5c57169fe None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:48.526983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 356/716] 10.222.0.91 () {56 vars in 1124 bytes} [Wed Aug 24 10:25:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:48.536092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa27573-ff9a-4ae0-8975-29c5c57169fe None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:48.566304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:48.619741 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16399ab-14c0-417f-ba2a-2788c8bb6e5f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:48.699627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bc942-f962-4627-a750-443cfc956022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:48.700469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc942-f962-4627-a750-443cfc956022 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:48.700754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc942-f962-4627-a750-443cfc956022 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:48.701027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc942-f962-4627-a750-443cfc956022 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:48.701665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bc942-f962-4627-a750-443cfc956022 None admin] RBAC: Adding query filter params (name=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:48.701964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bc942-f962-4627-a750-443cfc956022 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:48.705415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bc942-f962-4627-a750-443cfc956022 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:48.714668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 361/717] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:25:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:48.722372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bc942-f962-4627-a750-443cfc956022 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:48.778555 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa27573-ff9a-4ae0-8975-29c5c57169fe None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:48.856069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bc942-f962-4627-a750-443cfc956022 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:48.863121 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55c4b9-f4df-4af0-8e4a-0905d331e4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:48.864137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55c4b9-f4df-4af0-8e4a-0905d331e4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:48.864576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55c4b9-f4df-4af0-8e4a-0905d331e4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:48.865021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55c4b9-f4df-4af0-8e4a-0905d331e4c3 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:48.865858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55c4b9-f4df-4af0-8e4a-0905d331e4c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:48.866318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55c4b9-f4df-4af0-8e4a-0905d331e4c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:48.868050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55c4b9-f4df-4af0-8e4a-0905d331e4c3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:48.875333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 357/718] 10.222.0.91 () {56 vars in 1124 bytes} [Wed Aug 24 10:25:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:48.971662 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:48.989024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062db23-a45e-45a3-ac33-42e2d41d65a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:48.989659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062db23-a45e-45a3-ac33-42e2d41d65a1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:48.990094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062db23-a45e-45a3-ac33-42e2d41d65a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:48.990231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062db23-a45e-45a3-ac33-42e2d41d65a1 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:48.990902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062db23-a45e-45a3-ac33-42e2d41d65a1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:48.991206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062db23-a45e-45a3-ac33-42e2d41d65a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:48.993013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062db23-a45e-45a3-ac33-42e2d41d65a1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:49.005469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 362/719] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:25:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:50.059189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab302c-8d94-41f8-bd1c-d1d5586e8bad None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:50.060237 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab302c-8d94-41f8-bd1c-d1d5586e8bad None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:50.060719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab302c-8d94-41f8-bd1c-d1d5586e8bad None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:50.062691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 358/720] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:50.068236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de952897-844b-4d52-b86d-dc70430e6e26 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:50.069132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de952897-844b-4d52-b86d-dc70430e6e26 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:50.069604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de952897-844b-4d52-b86d-dc70430e6e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:50.101001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-de952897-844b-4d52-b86d-dc70430e6e26 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:50.102809 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-de952897-844b-4d52-b86d-dc70430e6e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:50.192766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55238487-87da-46bb-b994-a77c7af71a22 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:50.193096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55238487-87da-46bb-b994-a77c7af71a22 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:50.193322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55238487-87da-46bb-b994-a77c7af71a22 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:50.194900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 359/721] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:50.200588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41749fdc-0278-4754-81ec-9a0a8a0c110d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:50.200952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41749fdc-0278-4754-81ec-9a0a8a0c110d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:50.201137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41749fdc-0278-4754-81ec-9a0a8a0c110d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:50.218287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 363/722] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:50.221183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-41749fdc-0278-4754-81ec-9a0a8a0c110d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:50.222396 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-41749fdc-0278-4754-81ec-9a0a8a0c110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:50.278743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:50.301074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 360/723] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:50.592764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de952897-844b-4d52-b86d-dc70430e6e26 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:50.647526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41749fdc-0278-4754-81ec-9a0a8a0c110d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:50.747099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de952897-844b-4d52-b86d-dc70430e6e26 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:50.782311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41749fdc-0278-4754-81ec-9a0a8a0c110d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:50.785181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b789c-bd49-44b0-aa1c-732291744779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:50.786252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b789c-bd49-44b0-aa1c-732291744779 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:50.786252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b789c-bd49-44b0-aa1c-732291744779 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:50.786448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b789c-bd49-44b0-aa1c-732291744779 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:50.798690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b789c-bd49-44b0-aa1c-732291744779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-713b789c-bd49-44b0-aa1c-732291744779 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:50.804047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:50.805019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:50.806123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:50.808092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 364/724] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:50.809954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7691f2-62b2-4422-9385-0521a393f330 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:50.810240 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7691f2-62b2-4422-9385-0521a393f330 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:50.810689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7691f2-62b2-4422-9385-0521a393f330 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:50.812298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 365/725] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:50.813022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7691f2-62b2-4422-9385-0521a393f330 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:50.831490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc66f05-105b-4bf7-8149-531611bbae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:50.832510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc66f05-105b-4bf7-8149-531611bbae52 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:50.832978 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc66f05-105b-4bf7-8149-531611bbae52 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:50.833351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc66f05-105b-4bf7-8149-531611bbae52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:50.845590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc66f05-105b-4bf7-8149-531611bbae52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1cc66f05-105b-4bf7-8149-531611bbae52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:50.850879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:50.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 361/726] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:50.856959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db095d-c067-4b83-a804-c11fa86655f2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:50.857724 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db095d-c067-4b83-a804-c11fa86655f2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:50.857724 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db095d-c067-4b83-a804-c11fa86655f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:50.883521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b2db095d-c067-4b83-a804-c11fa86655f2 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:50.885545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b2db095d-c067-4b83-a804-c11fa86655f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:50.932246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:50.940870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7691f2-62b2-4422-9385-0521a393f330 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:50.972369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 362/727] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:50.972369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db095d-c067-4b83-a804-c11fa86655f2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:50.997454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead324b-ae93-46f8-ba45-aaa7424f2394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:50.998543 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead324b-ae93-46f8-ba45-aaa7424f2394 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:50.999116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead324b-ae93-46f8-ba45-aaa7424f2394 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:50.999611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead324b-ae93-46f8-ba45-aaa7424f2394 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.000532 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead324b-ae93-46f8-ba45-aaa7424f2394 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:51.001073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead324b-ae93-46f8-ba45-aaa7424f2394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:51.002892 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead324b-ae93-46f8-ba45-aaa7424f2394 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:51.024530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 366/728] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:51.030110 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead324b-ae93-46f8-ba45-aaa7424f2394 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:51.090247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db095d-c067-4b83-a804-c11fa86655f2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:51.104785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:51.140908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797e51f-c453-4341-9d52-c300ab92efeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:51.141521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e51f-c453-4341-9d52-c300ab92efeb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:51.141799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e51f-c453-4341-9d52-c300ab92efeb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:51.142066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e51f-c453-4341-9d52-c300ab92efeb None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.142724 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797e51f-c453-4341-9d52-c300ab92efeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:51.143088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797e51f-c453-4341-9d52-c300ab92efeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:51.147738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797e51f-c453-4341-9d52-c300ab92efeb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:51.154616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 363/729] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:51.160104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797e51f-c453-4341-9d52-c300ab92efeb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:51.193805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:51.250601 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead324b-ae93-46f8-ba45-aaa7424f2394 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:51.286705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797e51f-c453-4341-9d52-c300ab92efeb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:51.287367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd6491-71c5-48d5-9075-c47fadc50516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:51.288162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd6491-71c5-48d5-9075-c47fadc50516 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:51.288449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd6491-71c5-48d5-9075-c47fadc50516 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:51.288722 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd6491-71c5-48d5-9075-c47fadc50516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.300974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd6491-71c5-48d5-9075-c47fadc50516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:51.302676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd6491-71c5-48d5-9075-c47fadc50516 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-9efd6491-71c5-48d5-9075-c47fadc50516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:51.319209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:51.320294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:51.321406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:51.321406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:51.321406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:51.321406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 367/730] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:51.327924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd6491-71c5-48d5-9075-c47fadc50516 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:51.336546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b751dad-f36a-47fc-a0f4-ca29e644bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:51.337433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b751dad-f36a-47fc-a0f4-ca29e644bf80 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:51.337813 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b751dad-f36a-47fc-a0f4-ca29e644bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:51.338091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b751dad-f36a-47fc-a0f4-ca29e644bf80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.351417 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b751dad-f36a-47fc-a0f4-ca29e644bf80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:51.353704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b751dad-f36a-47fc-a0f4-ca29e644bf80 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8b751dad-f36a-47fc-a0f4-ca29e644bf80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:51.371206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:51.372230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:51.373127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:51.373127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:51.373127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:51.373127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 364/731] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:51.378150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b751dad-f36a-47fc-a0f4-ca29e644bf80 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:51.474683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:51.481660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:51.485810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd6491-71c5-48d5-9075-c47fadc50516 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:51.497860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b751dad-f36a-47fc-a0f4-ca29e644bf80 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:51.519826 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcc1d1-3e85-44b0-8986-57d98b3541f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:51.520682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcc1d1-3e85-44b0-8986-57d98b3541f6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:51.520956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcc1d1-3e85-44b0-8986-57d98b3541f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:51.521252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcc1d1-3e85-44b0-8986-57d98b3541f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.521860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcc1d1-3e85-44b0-8986-57d98b3541f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:51.522549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcc1d1-3e85-44b0-8986-57d98b3541f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:51.524929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcc1d1-3e85-44b0-8986-57d98b3541f6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:51.534872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2cc08-6a58-44c2-814e-45c9963f5b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:51.535512 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2cc08-6a58-44c2-814e-45c9963f5b9c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:51.536345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2cc08-6a58-44c2-814e-45c9963f5b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:51.536345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2cc08-6a58-44c2-814e-45c9963f5b9c None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.536828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2cc08-6a58-44c2-814e-45c9963f5b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:51.537140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2cc08-6a58-44c2-814e-45c9963f5b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:51.537736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 368/732] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:51.538470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcc1d1-3e85-44b0-8986-57d98b3541f6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:51.543529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2cc08-6a58-44c2-814e-45c9963f5b9c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:51.560905 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 365/733] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:51.562060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9601ab1-3397-40a8-a43f-958d4d20b88f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:51.562350 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9601ab1-3397-40a8-a43f-958d4d20b88f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:51.562630 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9601ab1-3397-40a8-a43f-958d4d20b88f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.563936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 366/734] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:51.568785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9601ab1-3397-40a8-a43f-958d4d20b88f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:51.642765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcc1d1-3e85-44b0-8986-57d98b3541f6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:51.672664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9601ab1-3397-40a8-a43f-958d4d20b88f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:51.676769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc19f5-0ff4-42e4-b048-54613f9ae894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:51.677393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc19f5-0ff4-42e4-b048-54613f9ae894 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:51.677671 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc19f5-0ff4-42e4-b048-54613f9ae894 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:51.677946 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc19f5-0ff4-42e4-b048-54613f9ae894 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.690785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc19f5-0ff4-42e4-b048-54613f9ae894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4efc19f5-0ff4-42e4-b048-54613f9ae894 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:51.695505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:51.696707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:51.697569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 369/735] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:51.698317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc19f5-0ff4-42e4-b048-54613f9ae894 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:51.708511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e8c5b-859e-42af-ab2a-4cf2cbc4c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:51.709127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e8c5b-859e-42af-ab2a-4cf2cbc4c9da None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:51.709410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e8c5b-859e-42af-ab2a-4cf2cbc4c9da None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:51.709681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e8c5b-859e-42af-ab2a-4cf2cbc4c9da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.711051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:51.719511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e8c5b-859e-42af-ab2a-4cf2cbc4c9da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:51.720986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e8c5b-859e-42af-ab2a-4cf2cbc4c9da None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9a4e8c5b-859e-42af-ab2a-4cf2cbc4c9da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:51.733040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:51.734017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:51.735014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:51.735014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:51.735014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:51.735014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:51.735014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:51.735014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:51.735014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:51.735014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:51.735014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:25:51.735014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:51.735014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 367/736] 10.222.0.91 () {56 vars in 1117 bytes} [Wed Aug 24 10:25:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:51.735621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257db07c-18d4-4d7f-b566-1e1f00e6285c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:51.735621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257db07c-18d4-4d7f-b566-1e1f00e6285c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:51.735772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257db07c-18d4-4d7f-b566-1e1f00e6285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.742807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:51.753503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-257db07c-18d4-4d7f-b566-1e1f00e6285c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:51.754692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-257db07c-18d4-4d7f-b566-1e1f00e6285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:51.805396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc19f5-0ff4-42e4-b048-54613f9ae894 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:51.823101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 368/737] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:51.824730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd33188-5b00-4a0f-8e4c-789039153baf None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:51.825015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd33188-5b00-4a0f-8e4c-789039153baf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:51.825292 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd33188-5b00-4a0f-8e4c-789039153baf None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.827191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 369/738] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:51.827684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd33188-5b00-4a0f-8e4c-789039153baf None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:51.850933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f48740-5015-4b21-8545-cec6f7c0bf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:51.851739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48740-5015-4b21-8545-cec6f7c0bf0f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:51.852663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48740-5015-4b21-8545-cec6f7c0bf0f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:51.853015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48740-5015-4b21-8545-cec6f7c0bf0f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.860700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f48740-5015-4b21-8545-cec6f7c0bf0f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:51.862035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f48740-5015-4b21-8545-cec6f7c0bf0f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e8f48740-5015-4b21-8545-cec6f7c0bf0f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:51.873862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:51.874889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:51.876185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:51.876185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:51.876185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:51.876185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:51.876185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:51.876185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:51.876185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:51.876185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:51.876185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:25:51.876185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:51.876185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 370/739] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:51.876185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f48740-5015-4b21-8545-cec6f7c0bf0f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:51.949457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd33188-5b00-4a0f-8e4c-789039153baf None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:51.953918 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:51.986738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6da783-56b5-4424-b35e-04401cdd3073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:51.986940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f48740-5015-4b21-8545-cec6f7c0bf0f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:51.987267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6da783-56b5-4424-b35e-04401cdd3073 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:51.987546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6da783-56b5-4424-b35e-04401cdd3073 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:51.987859 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6da783-56b5-4424-b35e-04401cdd3073 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:51.988521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6da783-56b5-4424-b35e-04401cdd3073 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:51.988823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6da783-56b5-4424-b35e-04401cdd3073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:51.990207 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6da783-56b5-4424-b35e-04401cdd3073 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:51.991777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:52.004138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 370/740] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:52.004138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a1c4b-5a2f-4197-9550-448841a2cd12 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:52.004138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a1c4b-5a2f-4197-9550-448841a2cd12 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:52.004138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a1c4b-5a2f-4197-9550-448841a2cd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:52.019960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-596a1c4b-5a2f-4197-9550-448841a2cd12 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:52.022313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-596a1c4b-5a2f-4197-9550-448841a2cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:52.030028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b125-e60a-44ba-a8cc-80ceaaa6b535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:52.030716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b125-e60a-44ba-a8cc-80ceaaa6b535 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:52.031001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b125-e60a-44ba-a8cc-80ceaaa6b535 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:52.031275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b125-e60a-44ba-a8cc-80ceaaa6b535 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:52.032038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92b125-e60a-44ba-a8cc-80ceaaa6b535 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:52.032344 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92b125-e60a-44ba-a8cc-80ceaaa6b535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:52.033824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92b125-e60a-44ba-a8cc-80ceaaa6b535 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:52.055758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 371/741] 10.222.0.91 () {56 vars in 1149 bytes} [Wed Aug 24 10:25:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:52.055758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b125-e60a-44ba-a8cc-80ceaaa6b535 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:52.107746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 371/742] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:52.107746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a1c4b-5a2f-4197-9550-448841a2cd12 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:52.167440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b125-e60a-44ba-a8cc-80ceaaa6b535 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:52.197632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:52.205841 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e818d5c-950e-4142-882a-ab34bb724c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:52.206551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e818d5c-950e-4142-882a-ab34bb724c17 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:52.206894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e818d5c-950e-4142-882a-ab34bb724c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:52.208294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e818d5c-950e-4142-882a-ab34bb724c17 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:52.208294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e818d5c-950e-4142-882a-ab34bb724c17 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:52.208294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e818d5c-950e-4142-882a-ab34bb724c17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:52.209898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e818d5c-950e-4142-882a-ab34bb724c17 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:52.217930 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a1c4b-5a2f-4197-9550-448841a2cd12 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:52.232046 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 372/743] 10.222.0.91 () {56 vars in 1135 bytes} [Wed Aug 24 10:25:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:52.233429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e818d5c-950e-4142-882a-ab34bb724c17 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:52.248258 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:52.256913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046b4f7-9675-4b25-ae0d-1a92e1c16279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:52.257538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046b4f7-9675-4b25-ae0d-1a92e1c16279 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:52.259880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046b4f7-9675-4b25-ae0d-1a92e1c16279 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:52.259880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046b4f7-9675-4b25-ae0d-1a92e1c16279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:52.270598 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046b4f7-9675-4b25-ae0d-1a92e1c16279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:52.272212 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046b4f7-9675-4b25-ae0d-1a92e1c16279 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3046b4f7-9675-4b25-ae0d-1a92e1c16279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:52.287757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:52.288916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:52.290732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:52.290732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:52.290732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:52.290732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 372/744] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:52.290732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046b4f7-9675-4b25-ae0d-1a92e1c16279 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:52.358832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e818d5c-950e-4142-882a-ab34bb724c17 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:52.396643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17db6d3-f240-408e-9018-f1d3013e2fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:52.397248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17db6d3-f240-408e-9018-f1d3013e2fec None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:52.397407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046b4f7-9675-4b25-ae0d-1a92e1c16279 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:52.397527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17db6d3-f240-408e-9018-f1d3013e2fec None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:52.397798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17db6d3-f240-408e-9018-f1d3013e2fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:52.431659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7be71-bf1a-4cd3-8294-c15f13e8a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:52.432298 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7be71-bf1a-4cd3-8294-c15f13e8a699 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:52.432575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7be71-bf1a-4cd3-8294-c15f13e8a699 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:52.432852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7be71-bf1a-4cd3-8294-c15f13e8a699 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:52.433488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7be71-bf1a-4cd3-8294-c15f13e8a699 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:52.434859 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7be71-bf1a-4cd3-8294-c15f13e8a699 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:52.452197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:52.465338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17db6d3-f240-408e-9018-f1d3013e2fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:52.466887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17db6d3-f240-408e-9018-f1d3013e2fec None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:52.530327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 373/745] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:25:52 2022] POST /identity/v3/services => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:25:52.531538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7be71-bf1a-4cd3-8294-c15f13e8a699 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:52.573901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 373/746] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:52.574788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17db6d3-f240-408e-9018-f1d3013e2fec None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:52.585854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:52.671833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7be71-bf1a-4cd3-8294-c15f13e8a699 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:52.679246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:52.705769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17db6d3-f240-408e-9018-f1d3013e2fec None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:52.720965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909e0cc-9a5c-450b-bd2d-037c7ff2b491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:52.721786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909e0cc-9a5c-450b-bd2d-037c7ff2b491 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:52.722072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909e0cc-9a5c-450b-bd2d-037c7ff2b491 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:52.722390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909e0cc-9a5c-450b-bd2d-037c7ff2b491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:52.748503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9114d-a4b6-44b3-9249-bbae18e739d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:52.749615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9114d-a4b6-44b3-9249-bbae18e739d6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:52.749895 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9114d-a4b6-44b3-9249-bbae18e739d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:52.750443 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9114d-a4b6-44b3-9249-bbae18e739d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:52.751594 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9114d-a4b6-44b3-9249-bbae18e739d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:52.752157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9114d-a4b6-44b3-9249-bbae18e739d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:52.754599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9114d-a4b6-44b3-9249-bbae18e739d6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:52.773287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 374/747] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:52.773287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9114d-a4b6-44b3-9249-bbae18e739d6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:52.804514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909e0cc-9a5c-450b-bd2d-037c7ff2b491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:52.805929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909e0cc-9a5c-450b-bd2d-037c7ff2b491 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:52.844449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:52.895988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9114d-a4b6-44b3-9249-bbae18e739d6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:52.921175 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 374/748] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:25:52 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:52.922035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909e0cc-9a5c-450b-bd2d-037c7ff2b491 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:52.939058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056fdb6-f8f5-4a48-b540-a3392ff59d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:52.939800 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056fdb6-f8f5-4a48-b540-a3392ff59d9e None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:52.940080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056fdb6-f8f5-4a48-b540-a3392ff59d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:52.940349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056fdb6-f8f5-4a48-b540-a3392ff59d9e None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:52.941190 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056fdb6-f8f5-4a48-b540-a3392ff59d9e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:52.942715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056fdb6-f8f5-4a48-b540-a3392ff59d9e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:53.028264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 375/749] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:25:52 2022] POST /identity/v3/services => generated 240 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:25:53.028264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056fdb6-f8f5-4a48-b540-a3392ff59d9e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:53.033341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909e0cc-9a5c-450b-bd2d-037c7ff2b491 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:53.045377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:53.086096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:53.092418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a22d7a-39aa-4695-9511-e49ecb27471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:53.093355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a22d7a-39aa-4695-9511-e49ecb27471b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:53.093792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a22d7a-39aa-4695-9511-e49ecb27471b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:53.094212 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a22d7a-39aa-4695-9511-e49ecb27471b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:53.107984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a22d7a-39aa-4695-9511-e49ecb27471b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:53.110421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a22d7a-39aa-4695-9511-e49ecb27471b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e4a22d7a-39aa-4695-9511-e49ecb27471b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:53.128143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:53.132982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:53.134901 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:53.134901 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:53.134901 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:53.136147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 375/750] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:53.139744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a22d7a-39aa-4695-9511-e49ecb27471b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:53.198300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056fdb6-f8f5-4a48-b540-a3392ff59d9e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:53.246867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db577b-2325-4a1b-85f3-bc677b33a640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:53.248116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db577b-2325-4a1b-85f3-bc677b33a640 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:53.249397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db577b-2325-4a1b-85f3-bc677b33a640 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:53.249898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db577b-2325-4a1b-85f3-bc677b33a640 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:53.261162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db577b-2325-4a1b-85f3-bc677b33a640 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:53.265524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db577b-2325-4a1b-85f3-bc677b33a640 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b6db577b-2325-4a1b-85f3-bc677b33a640 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:53.279219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:53.280514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:53.281700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:53.281700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:53.281700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:53.281700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:53.281700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:53.281700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:53.281700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:53.281700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:53.281700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:25:53.281700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:53.283435 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 376/751] 10.222.0.91 () {56 vars in 1093 bytes} [Wed Aug 24 10:25:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:53.284335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db577b-2325-4a1b-85f3-bc677b33a640 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:53.289642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a22d7a-39aa-4695-9511-e49ecb27471b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:53.334790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3fb4b-bd05-490f-a130-04dc3fd7feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:53.336087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3fb4b-bd05-490f-a130-04dc3fd7feef None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:53.336577 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3fb4b-bd05-490f-a130-04dc3fd7feef None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:53.336873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3fb4b-bd05-490f-a130-04dc3fd7feef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:53.352955 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3fb4b-bd05-490f-a130-04dc3fd7feef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:53.354523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3fb4b-bd05-490f-a130-04dc3fd7feef None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ada3fb4b-bd05-490f-a130-04dc3fd7feef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:53.370327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:53.371995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:53.373653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:53.373653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:53.373653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:53.374786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:53.376122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 376/752] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:53.377387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3fb4b-bd05-490f-a130-04dc3fd7feef None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:53.424778 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:53.428075 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db577b-2325-4a1b-85f3-bc677b33a640 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:53.472232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9fb15-6557-4255-8d0e-c6933ed59ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:53.473352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9fb15-6557-4255-8d0e-c6933ed59ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:53.474104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9fb15-6557-4255-8d0e-c6933ed59ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:53.474618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9fb15-6557-4255-8d0e-c6933ed59ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:53.475503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9fb15-6557-4255-8d0e-c6933ed59ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:53.476341 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9fb15-6557-4255-8d0e-c6933ed59ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:53.480023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9fb15-6557-4255-8d0e-c6933ed59ec0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:53.496296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 377/753] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:53.497508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9fb15-6557-4255-8d0e-c6933ed59ec0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:53.528921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3fb4b-bd05-490f-a130-04dc3fd7feef None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:53.572191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7239042-1e64-477d-a939-7d0daec622dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:53.572985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7239042-1e64-477d-a939-7d0daec622dd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:53.573268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7239042-1e64-477d-a939-7d0daec622dd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:53.573541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7239042-1e64-477d-a939-7d0daec622dd None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:53.574340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7239042-1e64-477d-a939-7d0daec622dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:53.574648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7239042-1e64-477d-a939-7d0daec622dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:53.576343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7239042-1e64-477d-a939-7d0daec622dd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:53.599250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 377/754] 10.222.0.91 () {56 vars in 1133 bytes} [Wed Aug 24 10:25:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:53.600202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7239042-1e64-477d-a939-7d0daec622dd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:53.634628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9fb15-6557-4255-8d0e-c6933ed59ec0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:53.670399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:53.681344 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea71355-ebae-4ed4-8178-385ad94bdff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:53.686215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea71355-ebae-4ed4-8178-385ad94bdff2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:53.686215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea71355-ebae-4ed4-8178-385ad94bdff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:53.686215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea71355-ebae-4ed4-8178-385ad94bdff2 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:53.686215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea71355-ebae-4ed4-8178-385ad94bdff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:53.686215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea71355-ebae-4ed4-8178-385ad94bdff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:53.686215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea71355-ebae-4ed4-8178-385ad94bdff2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:53.705539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 378/755] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:53.705539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea71355-ebae-4ed4-8178-385ad94bdff2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:53.730466 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:53.746558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7239042-1e64-477d-a939-7d0daec622dd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:53.792501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515a1cd-2d4c-423a-9bca-f1748fa32126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:53.793152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515a1cd-2d4c-423a-9bca-f1748fa32126 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:53.793430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515a1cd-2d4c-423a-9bca-f1748fa32126 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:53.793699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515a1cd-2d4c-423a-9bca-f1748fa32126 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:53.802766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515a1cd-2d4c-423a-9bca-f1748fa32126 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:53.804698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515a1cd-2d4c-423a-9bca-f1748fa32126 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:53.821000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea71355-ebae-4ed4-8178-385ad94bdff2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0515a1cd-2d4c-423a-9bca-f1748fa32126 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:53.826796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:53.830694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:53.831737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:53.831737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:53.831737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:53.831737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:53.831737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:53.831737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:53.831737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:53.831737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:53.831737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 378/756] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:53.831737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515a1cd-2d4c-423a-9bca-f1748fa32126 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:53.871848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba303b-d84a-4e37-bb50-68aaaec19be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:53.872881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba303b-d84a-4e37-bb50-68aaaec19be2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:53.873425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba303b-d84a-4e37-bb50-68aaaec19be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:53.874327 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba303b-d84a-4e37-bb50-68aaaec19be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:53.892793 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba303b-d84a-4e37-bb50-68aaaec19be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:53.896172 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba303b-d84a-4e37-bb50-68aaaec19be2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-abba303b-d84a-4e37-bb50-68aaaec19be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:53.921408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:53.922519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:53.924185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:53.924185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:53.924185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:53.924185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 379/757] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:53.924185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba303b-d84a-4e37-bb50-68aaaec19be2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:53.973445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:54.049738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba303b-d84a-4e37-bb50-68aaaec19be2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:54.076847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515a1cd-2d4c-423a-9bca-f1748fa32126 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:54.095351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc0b67-e75f-4698-b562-3e7900099c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:54.095996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc0b67-e75f-4698-b562-3e7900099c87 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:54.096275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc0b67-e75f-4698-b562-3e7900099c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:54.096549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc0b67-e75f-4698-b562-3e7900099c87 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:54.097242 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc0b67-e75f-4698-b562-3e7900099c87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:54.097546 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc0b67-e75f-4698-b562-3e7900099c87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:54.099658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc0b67-e75f-4698-b562-3e7900099c87 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:54.119165 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 380/758] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:54.121115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc0b67-e75f-4698-b562-3e7900099c87 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:54.137100 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3d564-2e53-4cde-afb0-64860a753dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:54.138420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3d564-2e53-4cde-afb0-64860a753dca None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:54.138905 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3d564-2e53-4cde-afb0-64860a753dca None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:54.139377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3d564-2e53-4cde-afb0-64860a753dca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:54.147548 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3d564-2e53-4cde-afb0-64860a753dca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:54.150333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3d564-2e53-4cde-afb0-64860a753dca None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-cdc3d564-2e53-4cde-afb0-64860a753dca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:54.162968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:54.163988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:54.165460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:54.165460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:54.165460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:54.165460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:54.165460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:54.165460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:54.165460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:54.165460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:54.172515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 379/759] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:54.173744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3d564-2e53-4cde-afb0-64860a753dca None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:54.191384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:54.264364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:54.270737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc0b67-e75f-4698-b562-3e7900099c87 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:54.292282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3d564-2e53-4cde-afb0-64860a753dca None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:54.317040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829f36a-029b-4b00-bd7b-1a6d0f82be9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:54.318043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829f36a-029b-4b00-bd7b-1a6d0f82be9f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:54.318530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829f36a-029b-4b00-bd7b-1a6d0f82be9f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:54.319009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829f36a-029b-4b00-bd7b-1a6d0f82be9f None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:54.319904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829f36a-029b-4b00-bd7b-1a6d0f82be9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:54.320411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829f36a-029b-4b00-bd7b-1a6d0f82be9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:54.322192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829f36a-029b-4b00-bd7b-1a6d0f82be9f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:54.335414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 381/760] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:54.336792 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829f36a-029b-4b00-bd7b-1a6d0f82be9f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:54.337451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae167f5-d4e5-45c1-a7a4-8cc68a029627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:54.338143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae167f5-d4e5-45c1-a7a4-8cc68a029627 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:54.338476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae167f5-d4e5-45c1-a7a4-8cc68a029627 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:54.338749 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae167f5-d4e5-45c1-a7a4-8cc68a029627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:54.339757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae167f5-d4e5-45c1-a7a4-8cc68a029627 None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=1ed2c124184645adad2be9cd89c9e88b) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:54.340079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae167f5-d4e5-45c1-a7a4-8cc68a029627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:54.343820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae167f5-d4e5-45c1-a7a4-8cc68a029627 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:54.355808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 380/761] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:54 2022] GET /identity/v3/role_assignments?user.id=1ed2c124184645adad2be9cd89c9e88b&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:54.356999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae167f5-d4e5-45c1-a7a4-8cc68a029627 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:54.494764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829f36a-029b-4b00-bd7b-1a6d0f82be9f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:54.540707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3adafa-b1e9-460d-8230-b5b91aa2604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:54.541520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3adafa-b1e9-460d-8230-b5b91aa2604a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:54.541797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3adafa-b1e9-460d-8230-b5b91aa2604a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:54.542067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3adafa-b1e9-460d-8230-b5b91aa2604a None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:54.542767 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3adafa-b1e9-460d-8230-b5b91aa2604a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:54.543069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3adafa-b1e9-460d-8230-b5b91aa2604a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:54.544557 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3adafa-b1e9-460d-8230-b5b91aa2604a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:54.553714 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:54.567589 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 382/762] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:54.567589 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f18126-0e44-427c-a7e9-75c0ce8276b1 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:54.567589 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f18126-0e44-427c-a7e9-75c0ce8276b1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:54.567589 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f18126-0e44-427c-a7e9-75c0ce8276b1 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:54.567589 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 383/763] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:54.576254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f18126-0e44-427c-a7e9-75c0ce8276b1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:54.589516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae167f5-d4e5-45c1-a7a4-8cc68a029627 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:54.601395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:54.681513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab269f-18ca-447d-a9b4-2f7cb1a20e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:54.683378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab269f-18ca-447d-a9b4-2f7cb1a20e9f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:54.683890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab269f-18ca-447d-a9b4-2f7cb1a20e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:54.684353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab269f-18ca-447d-a9b4-2f7cb1a20e9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:54.702977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab269f-18ca-447d-a9b4-2f7cb1a20e9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:54.708042 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab269f-18ca-447d-a9b4-2f7cb1a20e9f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:54.719282 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f18126-0e44-427c-a7e9-75c0ce8276b1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c5ab269f-18ca-447d-a9b4-2f7cb1a20e9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:54.736076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:54.737084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:54.737990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:54.737990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:54.737990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:54.737990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:54.737990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:54.737990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:54.737990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:54.737990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:54.738426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 381/764] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:54.739913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ed8cc-20ae-45f3-a7ec-25b2e69f136d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:54.740246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ed8cc-20ae-45f3-a7ec-25b2e69f136d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:54.740513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ed8cc-20ae-45f3-a7ec-25b2e69f136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:54.766617 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-014ed8cc-20ae-45f3-a7ec-25b2e69f136d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:54.766879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed999cd-5f7d-49c3-a1c9-935d0d53ed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:54.767595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed999cd-5f7d-49c3-a1c9-935d0d53ed60 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:54.767743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-014ed8cc-20ae-45f3-a7ec-25b2e69f136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:54.768080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed999cd-5f7d-49c3-a1c9-935d0d53ed60 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:54.768452 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed999cd-5f7d-49c3-a1c9-935d0d53ed60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:54.769296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed999cd-5f7d-49c3-a1c9-935d0d53ed60 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=4671efa1526643cdb32f56d44903db1d) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:54.769727 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed999cd-5f7d-49c3-a1c9-935d0d53ed60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:54.771538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed999cd-5f7d-49c3-a1c9-935d0d53ed60 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:54.782930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 384/765] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:25:54 2022] GET /identity/v3/role_assignments?user.id=4671efa1526643cdb32f56d44903db1d&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=60abeefc9ac84e31a0162ac559220669 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:54.784100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed999cd-5f7d-49c3-a1c9-935d0d53ed60 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:54.926582 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 382/766] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:25:54.962680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:54.991806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed999cd-5f7d-49c3-a1c9-935d0d53ed60 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:55.031124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716696ce-8610-4095-85f9-8b150f1f0395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:55.031656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716696ce-8610-4095-85f9-8b150f1f0395 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:55.031961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716696ce-8610-4095-85f9-8b150f1f0395 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:55.032280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716696ce-8610-4095-85f9-8b150f1f0395 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:55.032970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716696ce-8610-4095-85f9-8b150f1f0395 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:55.033269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716696ce-8610-4095-85f9-8b150f1f0395 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:55.034709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716696ce-8610-4095-85f9-8b150f1f0395 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:55.049101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 385/767] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:55.054765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ed8cc-20ae-45f3-a7ec-25b2e69f136d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:55.154803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:55.175751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8487-5e65-4073-a15d-0f2a583be8b6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:55.175751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8487-5e65-4073-a15d-0f2a583be8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:55.175751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8487-5e65-4073-a15d-0f2a583be8b6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:55.176261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 386/768] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:55.183670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dbe26-fa34-41f9-bcd9-f248b5b6ce59 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:55.183986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dbe26-fa34-41f9-bcd9-f248b5b6ce59 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:55.184242 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dbe26-fa34-41f9-bcd9-f248b5b6ce59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:55.207344 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-677dbe26-fa34-41f9-bcd9-f248b5b6ce59 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:55.208885 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-677dbe26-fa34-41f9-bcd9-f248b5b6ce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:55.222829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ed8cc-20ae-45f3-a7ec-25b2e69f136d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:55.303975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 387/769] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:25:55.304818 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dbe26-fa34-41f9-bcd9-f248b5b6ce59 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:55.322941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c3963-72fc-46ac-a9a3-8b395bade766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:55.323621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c3963-72fc-46ac-a9a3-8b395bade766 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:55.323930 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c3963-72fc-46ac-a9a3-8b395bade766 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:55.324240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c3963-72fc-46ac-a9a3-8b395bade766 None admin] PATH_INFO: `/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/4ae21e13a4414168bd1741dfd642274a/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:55.327528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c3963-72fc-46ac-a9a3-8b395bade766 None admin] RBAC: Authorizing `identity:create_grant(project_id=acd807f8a28d43cdac159fa3d606af60, user_id=4ae21e13a4414168bd1741dfd642274a, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:55.329069 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c3963-72fc-46ac-a9a3-8b395bade766 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:55.410117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:55.436203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dbe26-fa34-41f9-bcd9-f248b5b6ce59 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:55.449855 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 383/770] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:25:55 2022] PUT /identity/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/4ae21e13a4414168bd1741dfd642274a/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:25:55.498655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89863c88-72b9-42e4-a6b3-206f27c50e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:55.499386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89863c88-72b9-42e4-a6b3-206f27c50e6a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:55.499673 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89863c88-72b9-42e4-a6b3-206f27c50e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:55.499988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89863c88-72b9-42e4-a6b3-206f27c50e6a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:55.500597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89863c88-72b9-42e4-a6b3-206f27c50e6a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:55.502084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89863c88-72b9-42e4-a6b3-206f27c50e6a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-89863c88-72b9-42e4-a6b3-206f27c50e6a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:55.517339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:55.518432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:55.519461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 388/771] 10.222.0.91 () {56 vars in 1129 bytes} [Wed Aug 24 10:25:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:55.527645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c3963-72fc-46ac-a9a3-8b395bade766 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:55.668881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89863c88-72b9-42e4-a6b3-206f27c50e6a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:55.705454 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c3963-72fc-46ac-a9a3-8b395bade766 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:55.752173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:55.769971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25d0a-5184-4567-9122-b66046218d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:55.770840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25d0a-5184-4567-9122-b66046218d13 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:55.771331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25d0a-5184-4567-9122-b66046218d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:55.771609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25d0a-5184-4567-9122-b66046218d13 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:55.783204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25d0a-5184-4567-9122-b66046218d13 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:55.783204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25d0a-5184-4567-9122-b66046218d13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:55.783204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25d0a-5184-4567-9122-b66046218d13 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:55.783204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 384/772] 10.222.0.91 () {56 vars in 1124 bytes} [Wed Aug 24 10:25:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:55.788885 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25d0a-5184-4567-9122-b66046218d13 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:55.829310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89863c88-72b9-42e4-a6b3-206f27c50e6a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:55.867362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075664d-9bba-45c1-876c-0fd15f3f18e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:55.868138 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075664d-9bba-45c1-876c-0fd15f3f18e6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:55.868414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075664d-9bba-45c1-876c-0fd15f3f18e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:55.868681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075664d-9bba-45c1-876c-0fd15f3f18e6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:55.869262 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075664d-9bba-45c1-876c-0fd15f3f18e6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:55.870870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075664d-9bba-45c1-876c-0fd15f3f18e6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:55.873952 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-8075664d-9bba-45c1-876c-0fd15f3f18e6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:55.880786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:55.890216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:55.891064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 389/773] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:55 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:55.892453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075664d-9bba-45c1-876c-0fd15f3f18e6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:55.903289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25d0a-5184-4567-9122-b66046218d13 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:55.939128 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b2aa6-d75d-4fbc-a171-3b21825a3d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:55.939761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2aa6-d75d-4fbc-a171-3b21825a3d52 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:55.940043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2aa6-d75d-4fbc-a171-3b21825a3d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:55.940313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2aa6-d75d-4fbc-a171-3b21825a3d52 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:55.940949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b2aa6-d75d-4fbc-a171-3b21825a3d52 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:55.941251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b2aa6-d75d-4fbc-a171-3b21825a3d52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:55.942633 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b2aa6-d75d-4fbc-a171-3b21825a3d52 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:55.948927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 385/774] 10.222.0.91 () {56 vars in 1124 bytes} [Wed Aug 24 10:25:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:55.954764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b2aa6-d75d-4fbc-a171-3b21825a3d52 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:56.001023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075664d-9bba-45c1-876c-0fd15f3f18e6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:56.013903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:56.042164 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625404cc-0e49-4473-9784-4335a5241321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:56.043142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625404cc-0e49-4473-9784-4335a5241321 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:56.043627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625404cc-0e49-4473-9784-4335a5241321 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:56.044165 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625404cc-0e49-4473-9784-4335a5241321 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:56.045013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625404cc-0e49-4473-9784-4335a5241321 None admin] RBAC: Adding query filter params (name=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:56.045531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625404cc-0e49-4473-9784-4335a5241321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:56.047193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625404cc-0e49-4473-9784-4335a5241321 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:56.060225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 390/775] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:25:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:56.067946 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b2aa6-d75d-4fbc-a171-3b21825a3d52 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:56.069294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625404cc-0e49-4473-9784-4335a5241321 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:56.106410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd827e-a810-403a-9007-d5a46e71d7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:56.107029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd827e-a810-403a-9007-d5a46e71d7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:56.107317 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd827e-a810-403a-9007-d5a46e71d7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:56.107597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd827e-a810-403a-9007-d5a46e71d7e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:56.108306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd827e-a810-403a-9007-d5a46e71d7e3 None admin] RBAC: Adding query filter params (interface=public, service_id=216edc1354ef4966b7bc6cfe47aedda6, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:56.108614 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd827e-a810-403a-9007-d5a46e71d7e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:56.109975 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd827e-a810-403a-9007-d5a46e71d7e3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:56.127684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 386/776] 10.222.0.91 () {56 vars in 1251 bytes} [Wed Aug 24 10:25:55 2022] GET /identity/v3/endpoints?service_id=216edc1354ef4966b7bc6cfe47aedda6&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:56.133729 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd827e-a810-403a-9007-d5a46e71d7e3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:56.156185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:56.203896 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625404cc-0e49-4473-9784-4335a5241321 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:56.243294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b13c5c-0afe-4fcc-8a74-d7f247bc4df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:56.244328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b13c5c-0afe-4fcc-8a74-d7f247bc4df7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:56.244810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b13c5c-0afe-4fcc-8a74-d7f247bc4df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:56.245281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b13c5c-0afe-4fcc-8a74-d7f247bc4df7 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:56.246268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b13c5c-0afe-4fcc-8a74-d7f247bc4df7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:56.246801 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b13c5c-0afe-4fcc-8a74-d7f247bc4df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:56.248536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b13c5c-0afe-4fcc-8a74-d7f247bc4df7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:56.254988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 391/777] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:25:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:56.262269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b13c5c-0afe-4fcc-8a74-d7f247bc4df7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:56.286753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd827e-a810-403a-9007-d5a46e71d7e3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:56.321643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:56.355102 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cd157-5892-4c28-ada7-bdad9d5dee78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:56.355982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cd157-5892-4c28-ada7-bdad9d5dee78 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:56.356094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cd157-5892-4c28-ada7-bdad9d5dee78 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:56.356346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cd157-5892-4c28-ada7-bdad9d5dee78 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:56.356964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cd157-5892-4c28-ada7-bdad9d5dee78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:56.358338 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cd157-5892-4c28-ada7-bdad9d5dee78 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:56.376010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 387/778] 10.222.0.91 () {56 vars in 1087 bytes} [Wed Aug 24 10:25:56 2022] GET /identity/v3/services => generated 772 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:56.386814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b13c5c-0afe-4fcc-8a74-d7f247bc4df7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:56.418347 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:56.426616 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decedcb9-07bb-4a71-a4c0-b69ecb7f21c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:56.427223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decedcb9-07bb-4a71-a4c0-b69ecb7f21c9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:56.427496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decedcb9-07bb-4a71-a4c0-b69ecb7f21c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:56.427790 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decedcb9-07bb-4a71-a4c0-b69ecb7f21c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:56.428484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decedcb9-07bb-4a71-a4c0-b69ecb7f21c9 None admin] RBAC: Adding query filter params (interface=public, service_id=044a449fba0e46c185f30fe32d3d6d08, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:56.428789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decedcb9-07bb-4a71-a4c0-b69ecb7f21c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:56.430810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decedcb9-07bb-4a71-a4c0-b69ecb7f21c9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:56.439155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 392/779] 10.222.0.91 () {56 vars in 1251 bytes} [Wed Aug 24 10:25:56 2022] GET /identity/v3/endpoints?service_id=044a449fba0e46c185f30fe32d3d6d08&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:56.444902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cd157-5892-4c28-ada7-bdad9d5dee78 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:56.627460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cd157-5892-4c28-ada7-bdad9d5dee78 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:56.668169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fbd86-19f5-4bd7-9299-16effb272da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:56.668772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fbd86-19f5-4bd7-9299-16effb272da5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:56.669046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fbd86-19f5-4bd7-9299-16effb272da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:56.669312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fbd86-19f5-4bd7-9299-16effb272da5 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:56.669926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fbd86-19f5-4bd7-9299-16effb272da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:56.671339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fbd86-19f5-4bd7-9299-16effb272da5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:56.677761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 388/780] 10.222.0.91 () {56 vars in 1087 bytes} [Wed Aug 24 10:25:56 2022] GET /identity/v3/services => generated 772 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:56.924062 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe33c59-4b10-4913-9754-28f55b1a43ee None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:56.924403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe33c59-4b10-4913-9754-28f55b1a43ee None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:56.924526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe33c59-4b10-4913-9754-28f55b1a43ee None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:56.925850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 393/781] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:56.931619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d7a9f-aa88-4e9e-a311-360bca85c2f0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:56.931934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d7a9f-aa88-4e9e-a311-360bca85c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:56.932208 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d7a9f-aa88-4e9e-a311-360bca85c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:56.951703 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-228d7a9f-aa88-4e9e-a311-360bca85c2f0 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:56.952937 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-228d7a9f-aa88-4e9e-a311-360bca85c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:56.999539 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:57.027466 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 389/782] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:25:57.168397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f508aff-3244-4ea1-bdaf-5539f5e34cce None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:57.168672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f508aff-3244-4ea1-bdaf-5539f5e34cce None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:57.168943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f508aff-3244-4ea1-bdaf-5539f5e34cce None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:57.170538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 394/783] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:57.175843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5542b8-de03-447b-a811-e3eb45b6e5d9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:57.176079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5542b8-de03-447b-a811-e3eb45b6e5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:57.176354 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5542b8-de03-447b-a811-e3eb45b6e5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:57.200728 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7c5542b8-de03-447b-a811-e3eb45b6e5d9 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:57.201924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7c5542b8-de03-447b-a811-e3eb45b6e5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:57.307237 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 390/784] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:25:57.376322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f508aff-3244-4ea1-bdaf-5539f5e34cce None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:57.524326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f508aff-3244-4ea1-bdaf-5539f5e34cce None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:57.577878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b6f49-2f78-4f81-a388-20e4c2a0c4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:57.578523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6f49-2f78-4f81-a388-20e4c2a0c4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:57.578809 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6f49-2f78-4f81-a388-20e4c2a0c4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:57.579085 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6f49-2f78-4f81-a388-20e4c2a0c4b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:57.597784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b6f49-2f78-4f81-a388-20e4c2a0c4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-5c2b6f49-2f78-4f81-a388-20e4c2a0c4b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:57.603548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:57.604585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:57.605426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 395/785] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:25:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:57.610618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5542b8-de03-447b-a811-e3eb45b6e5d9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:57.641396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b6f49-2f78-4f81-a388-20e4c2a0c4b6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:57.744087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:57.805491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5542b8-de03-447b-a811-e3eb45b6e5d9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:57.822420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:57.853270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b6f49-2f78-4f81-a388-20e4c2a0c4b6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:57.858081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afd600-ec02-48a6-bf48-9d26f42a0125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:57.858706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afd600-ec02-48a6-bf48-9d26f42a0125 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:57.858987 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afd600-ec02-48a6-bf48-9d26f42a0125 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:57.859261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afd600-ec02-48a6-bf48-9d26f42a0125 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:57.860235 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afd600-ec02-48a6-bf48-9d26f42a0125 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:57.860543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afd600-ec02-48a6-bf48-9d26f42a0125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:57.862957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afd600-ec02-48a6-bf48-9d26f42a0125 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:57.882824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 391/786] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:25:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:57.889133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afd600-ec02-48a6-bf48-9d26f42a0125 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:57.929194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e950b9-81b6-44f4-9791-5d29ed3ac565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:57.929886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e950b9-81b6-44f4-9791-5d29ed3ac565 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:57.930180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e950b9-81b6-44f4-9791-5d29ed3ac565 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:57.930449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e950b9-81b6-44f4-9791-5d29ed3ac565 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:57.949464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e950b9-81b6-44f4-9791-5d29ed3ac565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d9e950b9-81b6-44f4-9791-5d29ed3ac565 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:57.963001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:57.964087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:57.964927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 396/787] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:57.970386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e950b9-81b6-44f4-9791-5d29ed3ac565 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:58.066863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afd600-ec02-48a6-bf48-9d26f42a0125 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:58.147214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e950b9-81b6-44f4-9791-5d29ed3ac565 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:58.149893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8af76-fa96-46c6-b0da-85b324d87645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:58.151610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8af76-fa96-46c6-b0da-85b324d87645 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:58.151937 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8af76-fa96-46c6-b0da-85b324d87645 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:58.152212 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8af76-fa96-46c6-b0da-85b324d87645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:58.165917 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:58.166871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8af76-fa96-46c6-b0da-85b324d87645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:58.169157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8af76-fa96-46c6-b0da-85b324d87645 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-56e8af76-fa96-46c6-b0da-85b324d87645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:58.188931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:58.189994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:58.190942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:58.190942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:58.190942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:58.195824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 392/788] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:58.197242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59af2e-5461-41c7-a219-7c21246bc46a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:58.197526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59af2e-5461-41c7-a219-7c21246bc46a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:58.198375 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59af2e-5461-41c7-a219-7c21246bc46a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:58.199811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 393/789] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:58.201621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59af2e-5461-41c7-a219-7c21246bc46a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:58.209426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967578-eb54-4c6e-b438-ccd0bea140dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:58.210212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967578-eb54-4c6e-b438-ccd0bea140dd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:58.210752 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967578-eb54-4c6e-b438-ccd0bea140dd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:58.211544 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967578-eb54-4c6e-b438-ccd0bea140dd None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:58.212456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967578-eb54-4c6e-b438-ccd0bea140dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:58.212868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967578-eb54-4c6e-b438-ccd0bea140dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:58.214886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967578-eb54-4c6e-b438-ccd0bea140dd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:58.230320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 397/790] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:58.230518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:58.231849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707536f8-901d-464a-9a8a-172ede6ddcf6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:58.232236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707536f8-901d-464a-9a8a-172ede6ddcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:58.232617 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707536f8-901d-464a-9a8a-172ede6ddcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:58.252253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-707536f8-901d-464a-9a8a-172ede6ddcf6 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:58.253596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-707536f8-901d-464a-9a8a-172ede6ddcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:58.319108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59af2e-5461-41c7-a219-7c21246bc46a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:58.364032 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b73580-3e56-4fda-b5a1-7ace435b27e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:58.364032 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73580-3e56-4fda-b5a1-7ace435b27e1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:58.364032 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73580-3e56-4fda-b5a1-7ace435b27e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:58.364032 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73580-3e56-4fda-b5a1-7ace435b27e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:58.364802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b73580-3e56-4fda-b5a1-7ace435b27e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:58.364802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b73580-3e56-4fda-b5a1-7ace435b27e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:58.364802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b73580-3e56-4fda-b5a1-7ace435b27e1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:58.365507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 398/791] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:25:58.367410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707536f8-901d-464a-9a8a-172ede6ddcf6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:58.377579 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 394/792] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:58.378463 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b73580-3e56-4fda-b5a1-7ace435b27e1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:58.468108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:58.488552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b73580-3e56-4fda-b5a1-7ace435b27e1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:58.529287 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696048a8-703a-49bd-a8c0-e0826888b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:58.529948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696048a8-703a-49bd-a8c0-e0826888b75a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:58.530221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696048a8-703a-49bd-a8c0-e0826888b75a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:58.530488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696048a8-703a-49bd-a8c0-e0826888b75a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:58.538221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696048a8-703a-49bd-a8c0-e0826888b75a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:58.540386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696048a8-703a-49bd-a8c0-e0826888b75a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-696048a8-703a-49bd-a8c0-e0826888b75a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:58.552981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:58.554019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:58.555047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:58.555047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:58.555047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:58.555047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:58.555047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:58.555047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:58.555047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:58.555047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:58.555047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:25:58.555047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:58.555047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 395/793] 10.222.0.91 () {56 vars in 1117 bytes} [Wed Aug 24 10:25:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:25:58.560528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696048a8-703a-49bd-a8c0-e0826888b75a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:58.613094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707536f8-901d-464a-9a8a-172ede6ddcf6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:58.628511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:58.669009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696048a8-703a-49bd-a8c0-e0826888b75a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:58.687520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bccb83-a642-4d15-aac6-a1f89c9ab24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:58.688309 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bccb83-a642-4d15-aac6-a1f89c9ab24c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:58.688592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bccb83-a642-4d15-aac6-a1f89c9ab24c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:58.688865 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bccb83-a642-4d15-aac6-a1f89c9ab24c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:58.706418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d540e-3172-4573-bbdc-56f1c6a66a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:58.707038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d540e-3172-4573-bbdc-56f1c6a66a72 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:58.707311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d540e-3172-4573-bbdc-56f1c6a66a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:58.707578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d540e-3172-4573-bbdc-56f1c6a66a72 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:58.708335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d540e-3172-4573-bbdc-56f1c6a66a72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:58.708636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d540e-3172-4573-bbdc-56f1c6a66a72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:58.710073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d540e-3172-4573-bbdc-56f1c6a66a72 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:58.712688 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bccb83-a642-4d15-aac6-a1f89c9ab24c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:58.714410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bccb83-a642-4d15-aac6-a1f89c9ab24c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:58.721647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:58.731438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 396/794] 10.222.0.91 () {56 vars in 1149 bytes} [Wed Aug 24 10:25:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:25:58.737040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d540e-3172-4573-bbdc-56f1c6a66a72 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-89bccb83-a642-4d15-aac6-a1f89c9ab24c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:58.750501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:58.751520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:58.752446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:58.752446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:58.752446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:58.752446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 399/795] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:58.752890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bccb83-a642-4d15-aac6-a1f89c9ab24c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:58.900499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d540e-3172-4573-bbdc-56f1c6a66a72 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:58.933020 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bccb83-a642-4d15-aac6-a1f89c9ab24c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:58.952031 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caae8d-c4ef-4627-b97c-d13287e3ffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:58.952673 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caae8d-c4ef-4627-b97c-d13287e3ffc7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:58.952950 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caae8d-c4ef-4627-b97c-d13287e3ffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:58.953224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caae8d-c4ef-4627-b97c-d13287e3ffc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:58.965362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83caae8d-c4ef-4627-b97c-d13287e3ffc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:58.966902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83caae8d-c4ef-4627-b97c-d13287e3ffc7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-83caae8d-c4ef-4627-b97c-d13287e3ffc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:58.991261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:58.992852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:58.993782 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:58.993782 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:58.993782 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:58.993782 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 397/796] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:58.994174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3f7dc-9523-4283-9849-c012e42e083b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:58.994174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3f7dc-9523-4283-9849-c012e42e083b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:58.994332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caae8d-c4ef-4627-b97c-d13287e3ffc7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:58.994405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3f7dc-9523-4283-9849-c012e42e083b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:58.994980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3f7dc-9523-4283-9849-c012e42e083b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.016011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3f7dc-9523-4283-9849-c012e42e083b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-cac3f7dc-9523-4283-9849-c012e42e083b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:25:59.021835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:59.024737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 400/797] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:59.026735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3f7dc-9523-4283-9849-c012e42e083b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:59.051339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:59.054019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:59.113395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caae8d-c4ef-4627-b97c-d13287e3ffc7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:59.145525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3f7dc-9523-4283-9849-c012e42e083b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:59.147262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4754d0e-6745-42be-a0fd-94c35ce593c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:59.147909 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4754d0e-6745-42be-a0fd-94c35ce593c9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:59.148186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4754d0e-6745-42be-a0fd-94c35ce593c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:59.148463 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4754d0e-6745-42be-a0fd-94c35ce593c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.149645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4754d0e-6745-42be-a0fd-94c35ce593c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:59.150027 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4754d0e-6745-42be-a0fd-94c35ce593c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:59.151475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4754d0e-6745-42be-a0fd-94c35ce593c9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:59.164979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 398/798] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:59.165762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4754d0e-6745-42be-a0fd-94c35ce593c9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:59.183150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23063942-ad40-4071-a233-a564a3e67b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:59.183782 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23063942-ad40-4071-a233-a564a3e67b36 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:59.184064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23063942-ad40-4071-a233-a564a3e67b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:59.184335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23063942-ad40-4071-a233-a564a3e67b36 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.184968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23063942-ad40-4071-a233-a564a3e67b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:59.185269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23063942-ad40-4071-a233-a564a3e67b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:59.186633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23063942-ad40-4071-a233-a564a3e67b36 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:59.199609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 401/799] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:59.200843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6131614-18de-49ce-a5da-c67aeaea65a7 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:59.201123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6131614-18de-49ce-a5da-c67aeaea65a7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:59.201395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6131614-18de-49ce-a5da-c67aeaea65a7 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.206874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 402/800] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:59.206874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b163a-1360-475d-8881-f48433006176 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:59.206874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b163a-1360-475d-8881-f48433006176 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:59.206874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b163a-1360-475d-8881-f48433006176 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.206874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 403/801] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:25:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:59.206874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b163a-1360-475d-8881-f48433006176 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:59.269882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4754d0e-6745-42be-a0fd-94c35ce593c9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:59.281997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:59.286812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:59.305370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a91b5-7070-4a5a-b0d8-586f7a53cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:59.305974 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a91b5-7070-4a5a-b0d8-586f7a53cea1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:59.306253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a91b5-7070-4a5a-b0d8-586f7a53cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:59.306524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a91b5-7070-4a5a-b0d8-586f7a53cea1 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.307236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a91b5-7070-4a5a-b0d8-586f7a53cea1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:59.307556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a91b5-7070-4a5a-b0d8-586f7a53cea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:59.308958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a91b5-7070-4a5a-b0d8-586f7a53cea1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:59.310371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b163a-1360-475d-8881-f48433006176 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:59.317246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 399/802] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:59.317880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a91b5-7070-4a5a-b0d8-586f7a53cea1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:59.346790 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1a202-19af-46a4-8e15-59002b759ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:59.347414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1a202-19af-46a4-8e15-59002b759ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:59.347685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1a202-19af-46a4-8e15-59002b759ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:59.347981 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1a202-19af-46a4-8e15-59002b759ef8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.356435 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1a202-19af-46a4-8e15-59002b759ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:59.358314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1a202-19af-46a4-8e15-59002b759ef8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4ec1a202-19af-46a4-8e15-59002b759ef8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:25:59.369796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:59.370795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:59.371761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:59.371761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:59.371761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:25:59.371761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:25:59.371761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:25:59.371761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:25:59.371761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:25:59.371761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:25:59.371761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:25:59.371761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:25:59.371761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 404/803] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:25:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:59.372362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dafdb2-5dc8-43cd-8a89-2c6b5c3e577a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:59.372362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dafdb2-5dc8-43cd-8a89-2c6b5c3e577a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:59.372979 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dafdb2-5dc8-43cd-8a89-2c6b5c3e577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.393215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e4dafdb2-5dc8-43cd-8a89-2c6b5c3e577a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:59.394415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e4dafdb2-5dc8-43cd-8a89-2c6b5c3e577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:59.433364 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a91b5-7070-4a5a-b0d8-586f7a53cea1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:59.466009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 405/804] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:25:59.467611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e119368-6feb-4f4d-99cf-719a95000d5e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:59.467924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e119368-6feb-4f4d-99cf-719a95000d5e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:59.468199 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e119368-6feb-4f4d-99cf-719a95000d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.478960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d823d0a-ce49-4db0-96a9-9d09ca3648c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:59.479747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d823d0a-ce49-4db0-96a9-9d09ca3648c4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:59.480533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d823d0a-ce49-4db0-96a9-9d09ca3648c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:59.480900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d823d0a-ce49-4db0-96a9-9d09ca3648c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.490476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d823d0a-ce49-4db0-96a9-9d09ca3648c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:59.492004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d823d0a-ce49-4db0-96a9-9d09ca3648c4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6d823d0a-ce49-4db0-96a9-9d09ca3648c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:25:59.505817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:59.506827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:59.507794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:25:59.507794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:25:59.507794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:25:59.507794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:25:59.507794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:25:59.507794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:25:59.507794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:25:59.507794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:59.511277 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 400/805] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:59.511277 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d823d0a-ce49-4db0-96a9-9d09ca3648c4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:59.547928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:59.602866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5e119368-6feb-4f4d-99cf-719a95000d5e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:59.604038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5e119368-6feb-4f4d-99cf-719a95000d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:59.631177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d823d0a-ce49-4db0-96a9-9d09ca3648c4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:59.670515 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:59.672755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9cac8-8b20-42d3-b36b-7a036aea10d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:59.673498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9cac8-8b20-42d3-b36b-7a036aea10d5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:59.673856 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9cac8-8b20-42d3-b36b-7a036aea10d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:59.674197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9cac8-8b20-42d3-b36b-7a036aea10d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.691843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 406/806] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:25:59.691843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e119368-6feb-4f4d-99cf-719a95000d5e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:59.692101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9cac8-8b20-42d3-b36b-7a036aea10d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:59.692101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9cac8-8b20-42d3-b36b-7a036aea10d5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-31d9cac8-8b20-42d3-b36b-7a036aea10d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:25:59.703960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:59.704967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:25:59.705878 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:25:59.705878 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:25:59.705878 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:25:59.710656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 401/807] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:59.712285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9cac8-8b20-42d3-b36b-7a036aea10d5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:59.815054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:59.816722 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e119368-6feb-4f4d-99cf-719a95000d5e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:59.833306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9cac8-8b20-42d3-b36b-7a036aea10d5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:59.859078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d213ed-593d-4f87-92d7-cc4a69bd8d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:59.860018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d213ed-593d-4f87-92d7-cc4a69bd8d79 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:59.860475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d213ed-593d-4f87-92d7-cc4a69bd8d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:59.860916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d213ed-593d-4f87-92d7-cc4a69bd8d79 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.865845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d213ed-593d-4f87-92d7-cc4a69bd8d79 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:59.865845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d213ed-593d-4f87-92d7-cc4a69bd8d79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:59.865845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d213ed-593d-4f87-92d7-cc4a69bd8d79 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:59.891442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd4776-4799-43af-8cfe-4d7015688dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:59.892184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd4776-4799-43af-8cfe-4d7015688dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:59.892528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd4776-4799-43af-8cfe-4d7015688dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:59.892867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd4776-4799-43af-8cfe-4d7015688dd0 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:59.893651 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd4776-4799-43af-8cfe-4d7015688dd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:59.893991 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd4776-4799-43af-8cfe-4d7015688dd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:59.895803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd4776-4799-43af-8cfe-4d7015688dd0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:59.897279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 407/808] 10.222.0.91 () {56 vars in 1135 bytes} [Wed Aug 24 10:25:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:59.898101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d213ed-593d-4f87-92d7-cc4a69bd8d79 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:59.909936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 402/809] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:59.910591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd4776-4799-43af-8cfe-4d7015688dd0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:59.963259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:00.006012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d213ed-593d-4f87-92d7-cc4a69bd8d79 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:00.018252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd4776-4799-43af-8cfe-4d7015688dd0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:00.040996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2298bf4-47bc-40ec-8e73-53a259a2484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:00.041601 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2298bf4-47bc-40ec-8e73-53a259a2484f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:00.041878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2298bf4-47bc-40ec-8e73-53a259a2484f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:00.042152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2298bf4-47bc-40ec-8e73-53a259a2484f None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:00.042792 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2298bf4-47bc-40ec-8e73-53a259a2484f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:00.043091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2298bf4-47bc-40ec-8e73-53a259a2484f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:00.044567 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2298bf4-47bc-40ec-8e73-53a259a2484f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:00.051550 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445fb01-b144-4333-85b9-9a33fa7170a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:00.052208 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445fb01-b144-4333-85b9-9a33fa7170a2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:00.052494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445fb01-b144-4333-85b9-9a33fa7170a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:00.052764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445fb01-b144-4333-85b9-9a33fa7170a2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:00.053338 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445fb01-b144-4333-85b9-9a33fa7170a2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:00.054691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445fb01-b144-4333-85b9-9a33fa7170a2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:00.056269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 408/810] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:00.057074 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2298bf4-47bc-40ec-8e73-53a259a2484f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d445fb01-b144-4333-85b9-9a33fa7170a2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:00.064442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:00.065585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:00.066488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 403/811] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:25:59 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:00.067307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445fb01-b144-4333-85b9-9a33fa7170a2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:00.081658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:00.161486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2298bf4-47bc-40ec-8e73-53a259a2484f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:00.170187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445fb01-b144-4333-85b9-9a33fa7170a2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:00.175838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:00.196601 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405c810-9ed2-4a39-b7fd-e4abda8764dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:00.197224 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405c810-9ed2-4a39-b7fd-e4abda8764dc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:00.197505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405c810-9ed2-4a39-b7fd-e4abda8764dc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:00.197778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405c810-9ed2-4a39-b7fd-e4abda8764dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:00.203671 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34477a-f8d4-42b6-b88b-1106a69a8f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:00.204416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34477a-f8d4-42b6-b88b-1106a69a8f1c None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:00.204632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34477a-f8d4-42b6-b88b-1106a69a8f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:00.204905 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34477a-f8d4-42b6-b88b-1106a69a8f1c None admin] PATH_INFO: `/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/1ed2c124184645adad2be9cd89c9e88b/roles/baff7a1fa3b34f2fb1062f71bbb73c7f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:00.208116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405c810-9ed2-4a39-b7fd-e4abda8764dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:00.209552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405c810-9ed2-4a39-b7fd-e4abda8764dc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:00.219456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34477a-f8d4-42b6-b88b-1106a69a8f1c None admin] RBAC: Authorizing `identity:create_grant(project_id=acd807f8a28d43cdac159fa3d606af60, user_id=1ed2c124184645adad2be9cd89c9e88b, role_id=baff7a1fa3b34f2fb1062f71bbb73c7f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:00.220841 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34477a-f8d4-42b6-b88b-1106a69a8f1c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f405c810-9ed2-4a39-b7fd-e4abda8764dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:00.223642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:00.224624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:00.225525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:00.225525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:00.225525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:00.225525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 409/812] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:00.225760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405c810-9ed2-4a39-b7fd-e4abda8764dc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:00.298279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 404/813] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:26:00 2022] PUT /identity/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/1ed2c124184645adad2be9cd89c9e88b/roles/baff7a1fa3b34f2fb1062f71bbb73c7f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:26:00.299162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34477a-f8d4-42b6-b88b-1106a69a8f1c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:00.330749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405c810-9ed2-4a39-b7fd-e4abda8764dc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:00.372716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a3808-1d85-4ed8-96c8-7724c0ed9214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:00.373367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a3808-1d85-4ed8-96c8-7724c0ed9214 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:00.373647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a3808-1d85-4ed8-96c8-7724c0ed9214 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:00.373921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a3808-1d85-4ed8-96c8-7724c0ed9214 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:00.374513 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a3808-1d85-4ed8-96c8-7724c0ed9214 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:00.376215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a3808-1d85-4ed8-96c8-7724c0ed9214 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-0f1a3808-1d85-4ed8-96c8-7724c0ed9214 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:00.388318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:00.389413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:00.396239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 410/814] 10.222.0.91 () {56 vars in 1129 bytes} [Wed Aug 24 10:26:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:00.397052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a3808-1d85-4ed8-96c8-7724c0ed9214 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:00.401639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:00.431849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:00.455177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34477a-f8d4-42b6-b88b-1106a69a8f1c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:00.495274 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21718e-e737-4127-a4fb-2d35ecc405c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:00.495847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21718e-e737-4127-a4fb-2d35ecc405c6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:00.496135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21718e-e737-4127-a4fb-2d35ecc405c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:00.496414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21718e-e737-4127-a4fb-2d35ecc405c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:00.505502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21718e-e737-4127-a4fb-2d35ecc405c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:00.506950 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21718e-e737-4127-a4fb-2d35ecc405c6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:00.515707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a3808-1d85-4ed8-96c8-7724c0ed9214 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-bd21718e-e737-4127-a4fb-2d35ecc405c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:26:00.521659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:00.522622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:00.524195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:00.524195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:00.524195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:26:00.524195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:26:00.524195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:26:00.524195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:26:00.524195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:26:00.524195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:26:00.524195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:26:00.524195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:00.524195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 405/815] 10.222.0.91 () {56 vars in 1093 bytes} [Wed Aug 24 10:26:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:00.524195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21718e-e737-4127-a4fb-2d35ecc405c6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:00.558165 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa5200-064b-4554-9066-48ad9dc68f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:00.558772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa5200-064b-4554-9066-48ad9dc68f41 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:00.559045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa5200-064b-4554-9066-48ad9dc68f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:00.559312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa5200-064b-4554-9066-48ad9dc68f41 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:00.559957 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa5200-064b-4554-9066-48ad9dc68f41 None admin] RBAC: Adding query filter params (name=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:00.560253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa5200-064b-4554-9066-48ad9dc68f41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:00.561613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa5200-064b-4554-9066-48ad9dc68f41 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:00.566495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 411/816] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:26:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:00.567274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa5200-064b-4554-9066-48ad9dc68f41 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:00.649005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21718e-e737-4127-a4fb-2d35ecc405c6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:00.667557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:00.672822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:00.679326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa5200-064b-4554-9066-48ad9dc68f41 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:00.686745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55711e67-4a76-486c-a252-b78e829cbebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:00.687866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55711e67-4a76-486c-a252-b78e829cbebb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:00.688147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55711e67-4a76-486c-a252-b78e829cbebb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:00.688418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55711e67-4a76-486c-a252-b78e829cbebb None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:00.689429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55711e67-4a76-486c-a252-b78e829cbebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:00.689734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55711e67-4a76-486c-a252-b78e829cbebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:00.691763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55711e67-4a76-486c-a252-b78e829cbebb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:00.705991 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 406/817] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:00.706756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55711e67-4a76-486c-a252-b78e829cbebb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:00.719562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b041e7-f704-442d-b855-40fdbfc103ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:00.720220 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b041e7-f704-442d-b855-40fdbfc103ba None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:00.720485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b041e7-f704-442d-b855-40fdbfc103ba None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:00.720756 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b041e7-f704-442d-b855-40fdbfc103ba None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:00.721374 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b041e7-f704-442d-b855-40fdbfc103ba None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:00.721659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b041e7-f704-442d-b855-40fdbfc103ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:00.723030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b041e7-f704-442d-b855-40fdbfc103ba None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:00.728704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 412/818] 10.222.0.91 () {56 vars in 1124 bytes} [Wed Aug 24 10:26:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:00.729643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b041e7-f704-442d-b855-40fdbfc103ba None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:00.828533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55711e67-4a76-486c-a252-b78e829cbebb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:00.851322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b041e7-f704-442d-b855-40fdbfc103ba None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:00.869227 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223d92d-4ef4-4288-b53f-fc69f0044105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:00.869837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223d92d-4ef4-4288-b53f-fc69f0044105 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:00.870123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223d92d-4ef4-4288-b53f-fc69f0044105 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:00.870389 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223d92d-4ef4-4288-b53f-fc69f0044105 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:00.871112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223d92d-4ef4-4288-b53f-fc69f0044105 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:00.871415 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223d92d-4ef4-4288-b53f-fc69f0044105 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:00.874636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223d92d-4ef4-4288-b53f-fc69f0044105 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:00.895777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 407/819] 10.222.0.91 () {56 vars in 1133 bytes} [Wed Aug 24 10:26:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:00.898010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8545d62-d172-4d58-a0a3-599c922c2c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:00.899366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8545d62-d172-4d58-a0a3-599c922c2c68 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:00.899647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8545d62-d172-4d58-a0a3-599c922c2c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:00.899968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8545d62-d172-4d58-a0a3-599c922c2c68 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:00.900603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8545d62-d172-4d58-a0a3-599c922c2c68 None admin] RBAC: Adding query filter params (type=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:00.900903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8545d62-d172-4d58-a0a3-599c922c2c68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:00.901837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223d92d-4ef4-4288-b53f-fc69f0044105 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:00.902642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8545d62-d172-4d58-a0a3-599c922c2c68 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:00.913592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 413/820] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:26:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:00.913592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8545d62-d172-4d58-a0a3-599c922c2c68 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:00.949034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:00.957234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:01.041961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223d92d-4ef4-4288-b53f-fc69f0044105 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:01.069839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8545d62-d172-4d58-a0a3-599c922c2c68 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:01.092611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf75b6-a703-4f80-bc28-b27bdb18d5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:01.093978 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf75b6-a703-4f80-bc28-b27bdb18d5fe None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:01.094104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf75b6-a703-4f80-bc28-b27bdb18d5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:01.094494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf75b6-a703-4f80-bc28-b27bdb18d5fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:01.104200 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf75b6-a703-4f80-bc28-b27bdb18d5fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:01.106653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf75b6-a703-4f80-bc28-b27bdb18d5fe None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:01.110718 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18df025-90e6-48c6-918e-c7b4f4f30404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:01.111979 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18df025-90e6-48c6-918e-c7b4f4f30404 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:01.112461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18df025-90e6-48c6-918e-c7b4f4f30404 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:01.112978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18df025-90e6-48c6-918e-c7b4f4f30404 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:01.113801 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18df025-90e6-48c6-918e-c7b4f4f30404 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:01.114294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18df025-90e6-48c6-918e-c7b4f4f30404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:01.116181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18df025-90e6-48c6-918e-c7b4f4f30404 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:01.122976 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 414/821] 10.222.0.91 () {56 vars in 1124 bytes} [Wed Aug 24 10:26:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:01.124150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18df025-90e6-48c6-918e-c7b4f4f30404 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-59bf75b6-a703-4f80-bc28-b27bdb18d5fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:26:01.129625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:01.130664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:01.131692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:26:01.131692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:26:01.131692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:26:01.131692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:26:01.131692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:26:01.131692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:26:01.131692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:01.131692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:01.138163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 408/822] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:01.139875 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf75b6-a703-4f80-bc28-b27bdb18d5fe None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:01.241510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:01.265165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:01.271972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf75b6-a703-4f80-bc28-b27bdb18d5fe None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:01.273171 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18df025-90e6-48c6-918e-c7b4f4f30404 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:01.316710 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d3112-03a5-44b9-b909-5f5c898f3aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:01.317419 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3112-03a5-44b9-b909-5f5c898f3aec None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:01.317697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3112-03a5-44b9-b909-5f5c898f3aec None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:01.317965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3112-03a5-44b9-b909-5f5c898f3aec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:01.318736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d3112-03a5-44b9-b909-5f5c898f3aec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:01.320314 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d3112-03a5-44b9-b909-5f5c898f3aec None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:01.326491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee357bb-831b-4037-b764-c46485456eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:01.327117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee357bb-831b-4037-b764-c46485456eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:01.327395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee357bb-831b-4037-b764-c46485456eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:01.327664 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee357bb-831b-4037-b764-c46485456eb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:01.404246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 409/823] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:26:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:26:01.405158 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d3112-03a5-44b9-b909-5f5c898f3aec None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:01.417836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee357bb-831b-4037-b764-c46485456eb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:01.420690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee357bb-831b-4037-b764-c46485456eb2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:01.543791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:01.569248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d3112-03a5-44b9-b909-5f5c898f3aec None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:01.575840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 415/824] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:26:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:26:01.575840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee357bb-831b-4037-b764-c46485456eb2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:01.622662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb808534-8519-4cd9-a503-8cda73e5c2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:01.623633 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb808534-8519-4cd9-a503-8cda73e5c2bb None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:01.624007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb808534-8519-4cd9-a503-8cda73e5c2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:01.624357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb808534-8519-4cd9-a503-8cda73e5c2bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:01.625108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb808534-8519-4cd9-a503-8cda73e5c2bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:01.626565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb808534-8519-4cd9-a503-8cda73e5c2bb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:01.697523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 410/825] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:26:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:26:01.699161 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb808534-8519-4cd9-a503-8cda73e5c2bb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:01.704454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee357bb-831b-4037-b764-c46485456eb2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:01.706546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:01.770312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87755373-1c91-4173-82f4-2df580f7175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:01.771830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87755373-1c91-4173-82f4-2df580f7175c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:01.772364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87755373-1c91-4173-82f4-2df580f7175c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:01.772843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87755373-1c91-4173-82f4-2df580f7175c None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:01.774375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87755373-1c91-4173-82f4-2df580f7175c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:01.775528 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87755373-1c91-4173-82f4-2df580f7175c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:01.778131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87755373-1c91-4173-82f4-2df580f7175c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:01.798524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 416/826] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:01.806934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87755373-1c91-4173-82f4-2df580f7175c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:01.857156 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb808534-8519-4cd9-a503-8cda73e5c2bb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:01.865969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:01.910634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba78cb-8f8f-4dd2-a1b4-a3645610f53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:01.911272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba78cb-8f8f-4dd2-a1b4-a3645610f53e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:01.911550 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba78cb-8f8f-4dd2-a1b4-a3645610f53e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:01.911855 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba78cb-8f8f-4dd2-a1b4-a3645610f53e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:01.924681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba78cb-8f8f-4dd2-a1b4-a3645610f53e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:01.926133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba78cb-8f8f-4dd2-a1b4-a3645610f53e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:01.940770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87755373-1c91-4173-82f4-2df580f7175c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-59ba78cb-8f8f-4dd2-a1b4-a3645610f53e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:01.943335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:01.944362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:01.946549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:01.946549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:01.946549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:01.946549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 411/827] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:01.951327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba78cb-8f8f-4dd2-a1b4-a3645610f53e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:01.990315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace8bbc-ebb8-4656-b02f-52c5ee0b293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:01.991345 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8bbc-ebb8-4656-b02f-52c5ee0b293c None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:01.991881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8bbc-ebb8-4656-b02f-52c5ee0b293c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:01.992895 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8bbc-ebb8-4656-b02f-52c5ee0b293c None admin] PATH_INFO: `/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/4671efa1526643cdb32f56d44903db1d/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:01.995126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace8bbc-ebb8-4656-b02f-52c5ee0b293c None admin] RBAC: Authorizing `identity:create_grant(project_id=acd807f8a28d43cdac159fa3d606af60, user_id=4671efa1526643cdb32f56d44903db1d, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:01.996807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace8bbc-ebb8-4656-b02f-52c5ee0b293c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:02.016756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:02.066843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba78cb-8f8f-4dd2-a1b4-a3645610f53e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:02.103398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20f0e0-f006-4547-a508-70be67d8eea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:02.104090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20f0e0-f006-4547-a508-70be67d8eea4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:02.104367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20f0e0-f006-4547-a508-70be67d8eea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:02.104645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20f0e0-f006-4547-a508-70be67d8eea4 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:02.105769 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20f0e0-f006-4547-a508-70be67d8eea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:02.105769 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20f0e0-f006-4547-a508-70be67d8eea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:02.106949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20f0e0-f006-4547-a508-70be67d8eea4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:02.118418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 417/828] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:26:01 2022] PUT /identity/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/4671efa1526643cdb32f56d44903db1d/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:26:02.132051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 412/829] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:02.138440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace8bbc-ebb8-4656-b02f-52c5ee0b293c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:02.273025 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace8bbc-ebb8-4656-b02f-52c5ee0b293c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:02.276324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:02.315655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f793b-736f-49e4-9673-1e6aaf3aa914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:02.316419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f793b-736f-49e4-9673-1e6aaf3aa914 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:02.316693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f793b-736f-49e4-9673-1e6aaf3aa914 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:02.316965 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f793b-736f-49e4-9673-1e6aaf3aa914 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:02.325935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f793b-736f-49e4-9673-1e6aaf3aa914 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:02.331055 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f793b-736f-49e4-9673-1e6aaf3aa914 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:02.342573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be66976-1ecd-4d61-aeaa-f3269485ac83 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:02.342867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be66976-1ecd-4d61-aeaa-f3269485ac83 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:02.343133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be66976-1ecd-4d61-aeaa-f3269485ac83 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:02.345274 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 413/830] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d74f793b-736f-49e4-9673-1e6aaf3aa914 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:26:02.345466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:02.346781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:02.347829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:26:02.347829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:26:02.347829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:26:02.347829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:26:02.347829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:26:02.347829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:26:02.347829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:02.347829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:02.350174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 418/831] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:02.357102 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fc767-ea7f-482c-880b-40ae2c8dbdb3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:02.357500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fc767-ea7f-482c-880b-40ae2c8dbdb3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:02.357790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fc767-ea7f-482c-880b-40ae2c8dbdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:02.363966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f793b-736f-49e4-9673-1e6aaf3aa914 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:02.381945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c75fc767-ea7f-482c-880b-40ae2c8dbdb3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:02.390792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c75fc767-ea7f-482c-880b-40ae2c8dbdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:02.487389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f793b-736f-49e4-9673-1e6aaf3aa914 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:02.487824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 414/832] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:02.531771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d6c04-0246-444b-81bd-c9fa7aeb992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:02.532362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d6c04-0246-444b-81bd-c9fa7aeb992b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:02.532638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d6c04-0246-444b-81bd-c9fa7aeb992b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:02.532908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d6c04-0246-444b-81bd-c9fa7aeb992b None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:02.533593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d6c04-0246-444b-81bd-c9fa7aeb992b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:02.533953 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d6c04-0246-444b-81bd-c9fa7aeb992b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:02.535386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d6c04-0246-444b-81bd-c9fa7aeb992b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:02.550178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 419/833] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:02.557019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fc767-ea7f-482c-880b-40ae2c8dbdb3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:02.608986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:02.676955 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fc767-ea7f-482c-880b-40ae2c8dbdb3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:02.716983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c226c9e-bcfa-496b-95f4-6f9b9a5d1092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:02.717957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c226c9e-bcfa-496b-95f4-6f9b9a5d1092 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:02.718432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c226c9e-bcfa-496b-95f4-6f9b9a5d1092 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:02.718927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c226c9e-bcfa-496b-95f4-6f9b9a5d1092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:02.719897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c226c9e-bcfa-496b-95f4-6f9b9a5d1092 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=4ae21e13a4414168bd1741dfd642274a) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:02.720403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c226c9e-bcfa-496b-95f4-6f9b9a5d1092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:02.722023 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c226c9e-bcfa-496b-95f4-6f9b9a5d1092 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:02.730457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 415/834] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:26:02 2022] GET /identity/v3/role_assignments?user.id=4ae21e13a4414168bd1741dfd642274a&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=60abeefc9ac84e31a0162ac559220669 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:02.769601 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d6c04-0246-444b-81bd-c9fa7aeb992b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:02.804884 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:02.901784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d6c04-0246-444b-81bd-c9fa7aeb992b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:02.942284 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabec7b-0ade-45ed-9c06-3e20f3151011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:02.943077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabec7b-0ade-45ed-9c06-3e20f3151011 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:02.943384 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabec7b-0ade-45ed-9c06-3e20f3151011 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:02.943700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabec7b-0ade-45ed-9c06-3e20f3151011 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:02.957119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabec7b-0ade-45ed-9c06-3e20f3151011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-3eabec7b-0ade-45ed-9c06-3e20f3151011 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:26:02.962383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:02.963422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:02.964369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 420/835] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:26:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:02.971482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c226c9e-bcfa-496b-95f4-6f9b9a5d1092 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:03.082178 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c226c9e-bcfa-496b-95f4-6f9b9a5d1092 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:03.094012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:03.122068 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13693e4c-ca60-4406-87c5-eb5d4bf418c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:03.122684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13693e4c-ca60-4406-87c5-eb5d4bf418c8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:03.122960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13693e4c-ca60-4406-87c5-eb5d4bf418c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:03.123230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13693e4c-ca60-4406-87c5-eb5d4bf418c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:03.123926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13693e4c-ca60-4406-87c5-eb5d4bf418c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:03.124226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13693e4c-ca60-4406-87c5-eb5d4bf418c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:03.125672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13693e4c-ca60-4406-87c5-eb5d4bf418c8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:03.137092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 416/836] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:26:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:03.142781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabec7b-0ade-45ed-9c06-3e20f3151011 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:03.241047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:03.261839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabec7b-0ade-45ed-9c06-3e20f3151011 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:03.300864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a326e-42de-48a2-945b-5493a172525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:03.301912 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a326e-42de-48a2-945b-5493a172525b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:03.302389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a326e-42de-48a2-945b-5493a172525b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:03.302853 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a326e-42de-48a2-945b-5493a172525b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:03.315058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a326e-42de-48a2-945b-5493a172525b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:03.316890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a326e-42de-48a2-945b-5493a172525b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b39a326e-42de-48a2-945b-5493a172525b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:03.333759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:03.334733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:03.335678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:03.335678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:03.335678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:03.337675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 421/837] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:03.346488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13693e4c-ca60-4406-87c5-eb5d4bf418c8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:03.475844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13693e4c-ca60-4406-87c5-eb5d4bf418c8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:03.515348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc689044-2a5c-4a0e-b9ab-9ba3f83ba338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:03.516061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689044-2a5c-4a0e-b9ab-9ba3f83ba338 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:03.516345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689044-2a5c-4a0e-b9ab-9ba3f83ba338 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:03.516616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689044-2a5c-4a0e-b9ab-9ba3f83ba338 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:03.517257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc689044-2a5c-4a0e-b9ab-9ba3f83ba338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:03.517556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc689044-2a5c-4a0e-b9ab-9ba3f83ba338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:03.518971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc689044-2a5c-4a0e-b9ab-9ba3f83ba338 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:03.532336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 417/838] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:03.537993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a326e-42de-48a2-945b-5493a172525b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:03.651148 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a326e-42de-48a2-945b-5493a172525b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:03.687010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081db53-2833-4905-92d5-b2961f9c78fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:03.687639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081db53-2833-4905-92d5-b2961f9c78fe None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:03.687946 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081db53-2833-4905-92d5-b2961f9c78fe None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:03.688215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081db53-2833-4905-92d5-b2961f9c78fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:03.690250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:03.696628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081db53-2833-4905-92d5-b2961f9c78fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:03.698379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081db53-2833-4905-92d5-b2961f9c78fe None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-0081db53-2833-4905-92d5-b2961f9c78fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:26:03.712297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:03.713490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:03.714437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:03.714437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:03.714437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:26:03.714437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:26:03.714437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:26:03.714437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:26:03.714437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:26:03.714437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:26:03.714437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:26:03.714437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:03.714437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 422/839] 10.222.0.91 () {56 vars in 1117 bytes} [Wed Aug 24 10:26:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:03.719408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc689044-2a5c-4a0e-b9ab-9ba3f83ba338 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:03.759495 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:03.823390 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b524d-2001-4074-9478-baccf3c6cf53 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:03.823926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b524d-2001-4074-9478-baccf3c6cf53 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:03.824003 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b524d-2001-4074-9478-baccf3c6cf53 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:03.825563 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 423/840] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:03.830779 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9fcb8-caac-4633-b8f2-958a618d8d2e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:03.831063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9fcb8-caac-4633-b8f2-958a618d8d2e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:03.831337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9fcb8-caac-4633-b8f2-958a618d8d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:03.837613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc689044-2a5c-4a0e-b9ab-9ba3f83ba338 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:03.850754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2ba9fcb8-caac-4633-b8f2-958a618d8d2e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:03.852695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2ba9fcb8-caac-4633-b8f2-958a618d8d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:03.878249 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc9174-3044-447e-a5ba-534703bae345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:03.879159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc9174-3044-447e-a5ba-534703bae345 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:03.879559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc9174-3044-447e-a5ba-534703bae345 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:03.879854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc9174-3044-447e-a5ba-534703bae345 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:03.880779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc9174-3044-447e-a5ba-534703bae345 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:03.881523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc9174-3044-447e-a5ba-534703bae345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:03.884403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc9174-3044-447e-a5ba-534703bae345 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:03.909685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 418/841] 10.222.0.91 () {56 vars in 1149 bytes} [Wed Aug 24 10:26:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:03.915390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc9174-3044-447e-a5ba-534703bae345 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:03.942263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 424/842] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:04.037569 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:04.049773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc9174-3044-447e-a5ba-534703bae345 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:04.088456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b47173-f21c-484f-adba-2433c1d64a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:04.089273 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b47173-f21c-484f-adba-2433c1d64a8a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:04.089562 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b47173-f21c-484f-adba-2433c1d64a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:04.090070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b47173-f21c-484f-adba-2433c1d64a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:04.163503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b47173-f21c-484f-adba-2433c1d64a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:04.165926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b47173-f21c-484f-adba-2433c1d64a8a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:04.256913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49c98-6603-490f-8669-5a770460d8b8 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:04.257279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49c98-6603-490f-8669-5a770460d8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:04.257631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49c98-6603-490f-8669-5a770460d8b8 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:04.259428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 425/843] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:26:04.259993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac49c98-6603-490f-8669-5a770460d8b8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:04.263318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:04.277081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 419/844] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:26:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:26:04.278195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149099e7-e405-41f7-87c3-d94cd27a81ed None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:04.278481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149099e7-e405-41f7-87c3-d94cd27a81ed None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:04.278754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149099e7-e405-41f7-87c3-d94cd27a81ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:04.298470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-149099e7-e405-41f7-87c3-d94cd27a81ed None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:04.299854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-149099e7-e405-41f7-87c3-d94cd27a81ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:04.383784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 420/845] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:04.384877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149099e7-e405-41f7-87c3-d94cd27a81ed None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:04.413917 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac49c98-6603-490f-8669-5a770460d8b8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:04.447272 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:04.462149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdef45-ce74-439f-b7b8-9308d5edcf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:04.463431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdef45-ce74-439f-b7b8-9308d5edcf2c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:04.464018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdef45-ce74-439f-b7b8-9308d5edcf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:04.464490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdef45-ce74-439f-b7b8-9308d5edcf2c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:04.469838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdef45-ce74-439f-b7b8-9308d5edcf2c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:04.469838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdef45-ce74-439f-b7b8-9308d5edcf2c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f0bdef45-ce74-439f-b7b8-9308d5edcf2c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:04.478913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:04.480340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:26:04.481393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:04.484047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 426/846] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:26:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:04.495792 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdef45-ce74-439f-b7b8-9308d5edcf2c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:04.520163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149099e7-e405-41f7-87c3-d94cd27a81ed None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:04.550076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:04.570212 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2babfa-559b-4299-a7d8-567649c6dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:04.572889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2babfa-559b-4299-a7d8-567649c6dbcf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:04.572889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2babfa-559b-4299-a7d8-567649c6dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:04.572889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2babfa-559b-4299-a7d8-567649c6dbcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:04.586795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2babfa-559b-4299-a7d8-567649c6dbcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:04.589419 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2babfa-559b-4299-a7d8-567649c6dbcf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-cf2babfa-559b-4299-a7d8-567649c6dbcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:04.608606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:04.609983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:04.611134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:04.611134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:04.611134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:04.616845 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 421/847] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:04.617887 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2babfa-559b-4299-a7d8-567649c6dbcf None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:04.618603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdef45-ce74-439f-b7b8-9308d5edcf2c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:04.658609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df142e6-cf9a-4121-9a1f-ecac757847d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:04.659566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df142e6-cf9a-4121-9a1f-ecac757847d3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:04.661096 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df142e6-cf9a-4121-9a1f-ecac757847d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:04.661564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df142e6-cf9a-4121-9a1f-ecac757847d3 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:04.662424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df142e6-cf9a-4121-9a1f-ecac757847d3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:04.662925 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df142e6-cf9a-4121-9a1f-ecac757847d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:04.664724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df142e6-cf9a-4121-9a1f-ecac757847d3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:04.671928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 427/848] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:26:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:04.677753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df142e6-cf9a-4121-9a1f-ecac757847d3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:04.749017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2babfa-559b-4299-a7d8-567649c6dbcf None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:04.750215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:04.788977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b17032-10d0-47e9-ad5f-1c01dc416780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:04.789866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b17032-10d0-47e9-ad5f-1c01dc416780 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:04.790150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b17032-10d0-47e9-ad5f-1c01dc416780 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:04.790425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b17032-10d0-47e9-ad5f-1c01dc416780 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:04.791078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b17032-10d0-47e9-ad5f-1c01dc416780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:04.791383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b17032-10d0-47e9-ad5f-1c01dc416780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:04.792796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b17032-10d0-47e9-ad5f-1c01dc416780 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:04.807737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df142e6-cf9a-4121-9a1f-ecac757847d3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:04.813164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 422/849] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:04.813164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b17032-10d0-47e9-ad5f-1c01dc416780 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:04.848925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:04.852388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65423e-e8cd-40b2-96e6-65d5f91d9b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:04.853691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65423e-e8cd-40b2-96e6-65d5f91d9b5b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:04.853691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65423e-e8cd-40b2-96e6-65d5f91d9b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:04.853691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65423e-e8cd-40b2-96e6-65d5f91d9b5b None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:04.854431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65423e-e8cd-40b2-96e6-65d5f91d9b5b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:04.854854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65423e-e8cd-40b2-96e6-65d5f91d9b5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:04.856266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65423e-e8cd-40b2-96e6-65d5f91d9b5b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:04.862274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 428/850] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:26:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:04.868794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65423e-e8cd-40b2-96e6-65d5f91d9b5b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:04.944370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b17032-10d0-47e9-ad5f-1c01dc416780 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:04.989854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78393d2-54e9-46e5-a426-e435d52bbb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:04.990479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78393d2-54e9-46e5-a426-e435d52bbb1b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:04.990758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78393d2-54e9-46e5-a426-e435d52bbb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:04.991032 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78393d2-54e9-46e5-a426-e435d52bbb1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:05.001360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65423e-e8cd-40b2-96e6-65d5f91d9b5b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:05.005100 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78393d2-54e9-46e5-a426-e435d52bbb1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b78393d2-54e9-46e5-a426-e435d52bbb1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:26:05.010602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:05.011738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:05.012761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 423/851] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:26:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:05.013688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3fea8-e8a9-4644-a85d-8487952b27ca None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:05.013688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3fea8-e8a9-4644-a85d-8487952b27ca None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:05.013688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3fea8-e8a9-4644-a85d-8487952b27ca None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:05.017094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 424/852] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:05.018054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3fea8-e8a9-4644-a85d-8487952b27ca None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:05.026817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:05.049259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb635fff-d8a2-4e87-8b3f-73b54b68e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:05.049903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb635fff-d8a2-4e87-8b3f-73b54b68e5ff None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:05.050171 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb635fff-d8a2-4e87-8b3f-73b54b68e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:05.050445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb635fff-d8a2-4e87-8b3f-73b54b68e5ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:05.060551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb635fff-d8a2-4e87-8b3f-73b54b68e5ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:05.062016 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb635fff-d8a2-4e87-8b3f-73b54b68e5ff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-fb635fff-d8a2-4e87-8b3f-73b54b68e5ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:26:05.077175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:05.078367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:05.079473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:26:05.079473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:26:05.079473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:26:05.079473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:26:05.079473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:26:05.079473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:26:05.079473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:05.079473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:05.082646 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 429/853] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:05.084030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705b596-6613-479b-b366-dc93b0d5f570 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:05.084421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705b596-6613-479b-b366-dc93b0d5f570 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:05.084797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705b596-6613-479b-b366-dc93b0d5f570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:05.105508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0705b596-6613-479b-b366-dc93b0d5f570 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:05.106041 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0705b596-6613-479b-b366-dc93b0d5f570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:05.138461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:05.149354 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3fea8-e8a9-4644-a85d-8487952b27ca None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:05.181424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 430/854] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:05.182586 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705b596-6613-479b-b366-dc93b0d5f570 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:05.201713 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce65740-d314-4114-a13d-39f292dff0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:05.203829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce65740-d314-4114-a13d-39f292dff0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:05.204556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce65740-d314-4114-a13d-39f292dff0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:05.205412 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce65740-d314-4114-a13d-39f292dff0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:05.207461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce65740-d314-4114-a13d-39f292dff0a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:05.208386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce65740-d314-4114-a13d-39f292dff0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:05.210434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce65740-d314-4114-a13d-39f292dff0a3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:05.224155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 425/855] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:26:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:05.229768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce65740-d314-4114-a13d-39f292dff0a3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:05.321169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705b596-6613-479b-b366-dc93b0d5f570 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:05.331643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:05.363448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce65740-d314-4114-a13d-39f292dff0a3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:05.365544 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5eb9-adfb-4572-8eca-b650708cb98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:05.366421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5eb9-adfb-4572-8eca-b650708cb98f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:05.367055 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5eb9-adfb-4572-8eca-b650708cb98f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:05.368147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5eb9-adfb-4572-8eca-b650708cb98f None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:05.369184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e5eb9-adfb-4572-8eca-b650708cb98f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:05.369733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e5eb9-adfb-4572-8eca-b650708cb98f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:05.371646 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e5eb9-adfb-4572-8eca-b650708cb98f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:05.389956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 431/856] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:05.391332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5eb9-adfb-4572-8eca-b650708cb98f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:05.406668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0158a39-1c48-4593-89ca-52845e74e146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:05.409030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0158a39-1c48-4593-89ca-52845e74e146 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:05.409030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0158a39-1c48-4593-89ca-52845e74e146 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:05.409030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0158a39-1c48-4593-89ca-52845e74e146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:05.422116 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0158a39-1c48-4593-89ca-52845e74e146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:05.424095 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0158a39-1c48-4593-89ca-52845e74e146 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a0158a39-1c48-4593-89ca-52845e74e146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:05.443391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:05.444439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:05.445380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:05.445380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:05.445380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:05.450084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 426/857] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:05.451033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0158a39-1c48-4593-89ca-52845e74e146 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:05.462166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:05.530216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5eb9-adfb-4572-8eca-b650708cb98f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:05.566906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0158a39-1c48-4593-89ca-52845e74e146 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:05.583267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696d5b8-70c6-4630-9908-6345b0288d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:05.584014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696d5b8-70c6-4630-9908-6345b0288d76 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:05.584296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696d5b8-70c6-4630-9908-6345b0288d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:05.584571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696d5b8-70c6-4630-9908-6345b0288d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:05.585297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696d5b8-70c6-4630-9908-6345b0288d76 None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=1ed2c124184645adad2be9cd89c9e88b) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:05.585602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696d5b8-70c6-4630-9908-6345b0288d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:05.587327 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696d5b8-70c6-4630-9908-6345b0288d76 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:05.593678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 432/858] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:26:05 2022] GET /identity/v3/role_assignments?user.id=1ed2c124184645adad2be9cd89c9e88b&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:05.605319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696d5b8-70c6-4630-9908-6345b0288d76 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:05.615674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803d54f-cdc6-4eb3-9b9c-1a4350ea071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:05.617169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d54f-cdc6-4eb3-9b9c-1a4350ea071b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:05.618478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d54f-cdc6-4eb3-9b9c-1a4350ea071b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:05.619063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d54f-cdc6-4eb3-9b9c-1a4350ea071b None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:05.620008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803d54f-cdc6-4eb3-9b9c-1a4350ea071b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:05.620537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803d54f-cdc6-4eb3-9b9c-1a4350ea071b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:05.622225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803d54f-cdc6-4eb3-9b9c-1a4350ea071b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:05.645642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 427/859] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:05.646986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803d54f-cdc6-4eb3-9b9c-1a4350ea071b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:05.649025 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:05.738706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:05.764275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696d5b8-70c6-4630-9908-6345b0288d76 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:05.796886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803d54f-cdc6-4eb3-9b9c-1a4350ea071b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:05.814319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86314-55c2-462e-9132-86ccd07852ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:05.815385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86314-55c2-462e-9132-86ccd07852ed None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:05.815672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86314-55c2-462e-9132-86ccd07852ed None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:05.815984 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86314-55c2-462e-9132-86ccd07852ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:05.816575 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef86314-55c2-462e-9132-86ccd07852ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:05.818237 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef86314-55c2-462e-9132-86ccd07852ed None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-fef86314-55c2-462e-9132-86ccd07852ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:05.831960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:05.833021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:26:05.833937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:05.836613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 433/860] 10.222.0.91 () {56 vars in 1132 bytes} [Wed Aug 24 10:26:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:05.840685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86314-55c2-462e-9132-86ccd07852ed None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:05.854408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8333e-ca72-4e33-b34e-8663bb6173f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:05.860584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8333e-ca72-4e33-b34e-8663bb6173f6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:05.860584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8333e-ca72-4e33-b34e-8663bb6173f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:05.860584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8333e-ca72-4e33-b34e-8663bb6173f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:05.865373 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8333e-ca72-4e33-b34e-8663bb6173f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:05.866981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8333e-ca72-4e33-b34e-8663bb6173f6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a4b8333e-ca72-4e33-b34e-8663bb6173f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:26:05.882460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:05.884499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:05.885708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:05.885708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:05.885708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:26:05.885708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:26:05.885708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:26:05.885708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:26:05.885708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:26:05.885708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:26:05.885708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:26:05.885708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:05.885708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 428/861] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:26:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:05.889817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8333e-ca72-4e33-b34e-8663bb6173f6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:05.973428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:05.982421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86314-55c2-462e-9132-86ccd07852ed None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:06.011926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8333e-ca72-4e33-b34e-8663bb6173f6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:06.028293 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ef2d8-65ed-4426-ad8b-6d75e342c8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:06.028944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ef2d8-65ed-4426-ad8b-6d75e342c8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:06.029223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ef2d8-65ed-4426-ad8b-6d75e342c8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:06.029495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ef2d8-65ed-4426-ad8b-6d75e342c8b1 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:06.030150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ef2d8-65ed-4426-ad8b-6d75e342c8b1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:06.030451 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ef2d8-65ed-4426-ad8b-6d75e342c8b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:06.032175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ef2d8-65ed-4426-ad8b-6d75e342c8b1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:06.038096 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 434/862] 10.222.0.91 () {56 vars in 1126 bytes} [Wed Aug 24 10:26:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:06.044714 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ef2d8-65ed-4426-ad8b-6d75e342c8b1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:06.052041 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2bbd5-5c52-4b9a-91ed-8844fe1e2c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:06.052738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2bbd5-5c52-4b9a-91ed-8844fe1e2c66 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:06.053037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2bbd5-5c52-4b9a-91ed-8844fe1e2c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:06.053356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2bbd5-5c52-4b9a-91ed-8844fe1e2c66 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:06.054097 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2bbd5-5c52-4b9a-91ed-8844fe1e2c66 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:06.054414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2bbd5-5c52-4b9a-91ed-8844fe1e2c66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:06.056851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2bbd5-5c52-4b9a-91ed-8844fe1e2c66 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:06.060528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:06.078948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 429/863] 10.222.0.91 () {56 vars in 1135 bytes} [Wed Aug 24 10:26:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:06.086497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2bbd5-5c52-4b9a-91ed-8844fe1e2c66 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:06.173613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ef2d8-65ed-4426-ad8b-6d75e342c8b1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:06.222221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbb5d8-9605-46b4-9efb-5b6aff408117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:06.222940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbb5d8-9605-46b4-9efb-5b6aff408117 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:06.223280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbb5d8-9605-46b4-9efb-5b6aff408117 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:06.223624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbb5d8-9605-46b4-9efb-5b6aff408117 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:06.224945 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbb5d8-9605-46b4-9efb-5b6aff408117 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:06.225329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbb5d8-9605-46b4-9efb-5b6aff408117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:06.227859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbb5d8-9605-46b4-9efb-5b6aff408117 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:06.239765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 435/864] 10.222.0.91 () {56 vars in 1126 bytes} [Wed Aug 24 10:26:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:06.239993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2bbd5-5c52-4b9a-91ed-8844fe1e2c66 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:06.280805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19275d27-4b23-4dcc-a2b7-96ee223d3469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:06.281332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19275d27-4b23-4dcc-a2b7-96ee223d3469 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:06.281605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19275d27-4b23-4dcc-a2b7-96ee223d3469 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:06.281871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19275d27-4b23-4dcc-a2b7-96ee223d3469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:06.344493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:06.363318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19275d27-4b23-4dcc-a2b7-96ee223d3469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:06.364896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19275d27-4b23-4dcc-a2b7-96ee223d3469 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:06.482194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 430/865] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:26:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 10:26:06.488879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbb5d8-9605-46b4-9efb-5b6aff408117 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:06.520852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:06.602998 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbb5d8-9605-46b4-9efb-5b6aff408117 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:06.640369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030160e7-e25e-47fd-88fd-a6c3ae2317a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:06.641050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030160e7-e25e-47fd-88fd-a6c3ae2317a8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:06.641330 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030160e7-e25e-47fd-88fd-a6c3ae2317a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:06.641596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030160e7-e25e-47fd-88fd-a6c3ae2317a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:06.653561 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030160e7-e25e-47fd-88fd-a6c3ae2317a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:06.655005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030160e7-e25e-47fd-88fd-a6c3ae2317a8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-030160e7-e25e-47fd-88fd-a6c3ae2317a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:06.669603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:06.670569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:06.672054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:06.672054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:06.672054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:06.672054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 436/866] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:06.681140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19275d27-4b23-4dcc-a2b7-96ee223d3469 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:06.779255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:06.797312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19275d27-4b23-4dcc-a2b7-96ee223d3469 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:06.838648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496d7f4-e3a2-4bbe-b764-4b70192d21b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:06.839256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496d7f4-e3a2-4bbe-b764-4b70192d21b1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:06.839533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496d7f4-e3a2-4bbe-b764-4b70192d21b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:06.839834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496d7f4-e3a2-4bbe-b764-4b70192d21b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:06.840697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496d7f4-e3a2-4bbe-b764-4b70192d21b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:06.841001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496d7f4-e3a2-4bbe-b764-4b70192d21b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:06.842611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496d7f4-e3a2-4bbe-b764-4b70192d21b1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:06.856590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 431/867] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:06.862221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030160e7-e25e-47fd-88fd-a6c3ae2317a8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:06.952020 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:06.965037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947081b0-d34b-40b7-90ff-6dcba057e35d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:06.965637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947081b0-d34b-40b7-90ff-6dcba057e35d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:06.966078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947081b0-d34b-40b7-90ff-6dcba057e35d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:06.967871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 432/868] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:06.973531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ac39e-45d8-49c1-b40f-3a6acd29d65c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:06.974096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ac39e-45d8-49c1-b40f-3a6acd29d65c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:06.974593 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ac39e-45d8-49c1-b40f-3a6acd29d65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:06.979427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030160e7-e25e-47fd-88fd-a6c3ae2317a8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:06.995005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f26ac39e-45d8-49c1-b40f-3a6acd29d65c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:06.997697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f26ac39e-45d8-49c1-b40f-3a6acd29d65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:07.016268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98299362-c38a-4674-bd28-a6ca8c2de91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:07.016895 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98299362-c38a-4674-bd28-a6ca8c2de91a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:07.017174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98299362-c38a-4674-bd28-a6ca8c2de91a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:07.017440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98299362-c38a-4674-bd28-a6ca8c2de91a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:07.025898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98299362-c38a-4674-bd28-a6ca8c2de91a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:07.027902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98299362-c38a-4674-bd28-a6ca8c2de91a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-98299362-c38a-4674-bd28-a6ca8c2de91a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:26:07.043009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:07.044013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:07.044932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:26:07.044932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:26:07.044932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:26:07.044932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:26:07.044932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:26:07.044932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:26:07.044932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:07.044932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:07.044932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 437/869] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:07.049999 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98299362-c38a-4674-bd28-a6ca8c2de91a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:07.104053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 433/870] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:07.170647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98299362-c38a-4674-bd28-a6ca8c2de91a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:07.211087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9102bc7-b02b-441b-a8e8-c66eb9e84447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:07.211975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9102bc7-b02b-441b-a8e8-c66eb9e84447 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:07.212364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9102bc7-b02b-441b-a8e8-c66eb9e84447 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:07.212641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9102bc7-b02b-441b-a8e8-c66eb9e84447 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:07.213502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9102bc7-b02b-441b-a8e8-c66eb9e84447 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:07.213863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9102bc7-b02b-441b-a8e8-c66eb9e84447 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:07.215376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9102bc7-b02b-441b-a8e8-c66eb9e84447 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:07.217201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:07.232087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 438/871] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:07.238388 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ac39e-45d8-49c1-b40f-3a6acd29d65c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:07.328844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:07.356209 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ac39e-45d8-49c1-b40f-3a6acd29d65c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:07.393105 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a03fe6-86e9-431d-82e6-f936bd8d642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:07.393714 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a03fe6-86e9-431d-82e6-f936bd8d642d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:07.393992 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a03fe6-86e9-431d-82e6-f936bd8d642d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:07.394262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a03fe6-86e9-431d-82e6-f936bd8d642d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:07.395237 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a03fe6-86e9-431d-82e6-f936bd8d642d None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=4671efa1526643cdb32f56d44903db1d) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:07.395539 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a03fe6-86e9-431d-82e6-f936bd8d642d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:07.396977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a03fe6-86e9-431d-82e6-f936bd8d642d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:07.404536 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 434/872] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:26:07 2022] GET /identity/v3/role_assignments?user.id=4671efa1526643cdb32f56d44903db1d&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=60abeefc9ac84e31a0162ac559220669 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:07.405924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9102bc7-b02b-441b-a8e8-c66eb9e84447 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:07.537082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9102bc7-b02b-441b-a8e8-c66eb9e84447 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:07.580738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722facf9-7e81-4003-ae2c-683c833c9bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:07.581370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722facf9-7e81-4003-ae2c-683c833c9bea None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:07.581650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722facf9-7e81-4003-ae2c-683c833c9bea None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:07.581915 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722facf9-7e81-4003-ae2c-683c833c9bea None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:07.582584 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722facf9-7e81-4003-ae2c-683c833c9bea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:07.584055 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722facf9-7e81-4003-ae2c-683c833c9bea None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:07.678471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 439/873] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:26:07 2022] POST /identity/v3/services => generated 251 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:26:07.778141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5790649-abc9-4964-bf1c-c68286c3b147 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:07.778501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5790649-abc9-4964-bf1c-c68286c3b147 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:07.778690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5790649-abc9-4964-bf1c-c68286c3b147 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:07.780425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 435/874] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:07.786241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac6f21-d667-41ad-8225-4b12d5da0f27 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:07.786524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac6f21-d667-41ad-8225-4b12d5da0f27 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:07.786808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac6f21-d667-41ad-8225-4b12d5da0f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:07.808287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-10ac6f21-d667-41ad-8225-4b12d5da0f27 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:07.809509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-10ac6f21-d667-41ad-8225-4b12d5da0f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:07.876956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:07.903052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 440/875] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:08.181014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5790649-abc9-4964-bf1c-c68286c3b147 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:08.301588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5790649-abc9-4964-bf1c-c68286c3b147 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:08.327827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5777d7e-0286-4f6a-8e0e-626cf2d2c12d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:08.328819 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5777d7e-0286-4f6a-8e0e-626cf2d2c12d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:08.329280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5777d7e-0286-4f6a-8e0e-626cf2d2c12d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:08.331269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 441/876] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:08.337717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4c474-6a0a-4636-8e07-2b3c3eece582 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:08.338062 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4c474-6a0a-4636-8e07-2b3c3eece582 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:08.338309 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4c474-6a0a-4636-8e07-2b3c3eece582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:08.346994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282b9a8-c399-4514-aefc-61d0de06055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:08.348026 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282b9a8-c399-4514-aefc-61d0de06055a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:08.348554 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282b9a8-c399-4514-aefc-61d0de06055a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:08.349644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282b9a8-c399-4514-aefc-61d0de06055a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:08.359770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c1f4c474-6a0a-4636-8e07-2b3c3eece582 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:08.360372 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:08.362530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c1f4c474-6a0a-4636-8e07-2b3c3eece582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:08.364139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282b9a8-c399-4514-aefc-61d0de06055a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a282b9a8-c399-4514-aefc-61d0de06055a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:26:08.369225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:08.370358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:08.371709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 436/877] 10.222.0.91 () {56 vars in 1120 bytes} [Wed Aug 24 10:26:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:08.376571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282b9a8-c399-4514-aefc-61d0de06055a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:08.464943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 442/878] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:08.500113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282b9a8-c399-4514-aefc-61d0de06055a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:08.542458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa51f39-ce7b-4817-9f3b-0342fc2812e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:08.543075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51f39-ce7b-4817-9f3b-0342fc2812e5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:08.543355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51f39-ce7b-4817-9f3b-0342fc2812e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:08.543628 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51f39-ce7b-4817-9f3b-0342fc2812e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:08.544338 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa51f39-ce7b-4817-9f3b-0342fc2812e5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:08.544638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa51f39-ce7b-4817-9f3b-0342fc2812e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:08.546007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa51f39-ce7b-4817-9f3b-0342fc2812e5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:08.556197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 437/879] 10.222.0.91 () {56 vars in 1115 bytes} [Wed Aug 24 10:26:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:08.562066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4c474-6a0a-4636-8e07-2b3c3eece582 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:08.673226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4c474-6a0a-4636-8e07-2b3c3eece582 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:08.686417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:08.713076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9081162-e462-401d-9444-d5fbec75cc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:08.714047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9081162-e462-401d-9444-d5fbec75cc0d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:08.714541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9081162-e462-401d-9444-d5fbec75cc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:08.715053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9081162-e462-401d-9444-d5fbec75cc0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:08.726502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9081162-e462-401d-9444-d5fbec75cc0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:08.728321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9081162-e462-401d-9444-d5fbec75cc0d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c9081162-e462-401d-9444-d5fbec75cc0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:08.744963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:08.745969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:08.746904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:08.746904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:08.746904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:08.748998 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 443/880] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:26:08.755017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa51f39-ce7b-4817-9f3b-0342fc2812e5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:08.769102 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9081162-e462-401d-9444-d5fbec75cc0d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:08.830321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:08.887838 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa51f39-ce7b-4817-9f3b-0342fc2812e5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:08.891847 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9081162-e462-401d-9444-d5fbec75cc0d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:08.933643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb04d60-5c21-4ebf-bf9e-a73c41e6042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:08.934518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb04d60-5c21-4ebf-bf9e-a73c41e6042d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:08.935141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb04d60-5c21-4ebf-bf9e-a73c41e6042d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:08.935575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb04d60-5c21-4ebf-bf9e-a73c41e6042d None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:08.936795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb04d60-5c21-4ebf-bf9e-a73c41e6042d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:08.937252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb04d60-5c21-4ebf-bf9e-a73c41e6042d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:08.939045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb04d60-5c21-4ebf-bf9e-a73c41e6042d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:08.949459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089430fe-cfc5-40fa-be47-fe90117e0ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:08.950459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089430fe-cfc5-40fa-be47-fe90117e0ff5 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:08.951017 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089430fe-cfc5-40fa-be47-fe90117e0ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:08.951759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089430fe-cfc5-40fa-be47-fe90117e0ff5 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:08.952927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089430fe-cfc5-40fa-be47-fe90117e0ff5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:08.954909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089430fe-cfc5-40fa-be47-fe90117e0ff5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:08.960097 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 438/881] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:08.962409 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb04d60-5c21-4ebf-bf9e-a73c41e6042d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:09.067913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 444/882] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:26:08 2022] POST /identity/v3/services => generated 269 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:26:09.096830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb04d60-5c21-4ebf-bf9e-a73c41e6042d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:09.127754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:09.151115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0076b1-cecd-4a30-bfd9-91dbce05a6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:09.151794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0076b1-cecd-4a30-bfd9-91dbce05a6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:09.152081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0076b1-cecd-4a30-bfd9-91dbce05a6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:09.152403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0076b1-cecd-4a30-bfd9-91dbce05a6e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:09.160777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0076b1-cecd-4a30-bfd9-91dbce05a6e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:09.163358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0076b1-cecd-4a30-bfd9-91dbce05a6e3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1d0076b1-cecd-4a30-bfd9-91dbce05a6e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:26:09.177592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:09.178611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:09.180228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:09.180228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:09.180228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:26:09.180228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:26:09.180228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:26:09.180228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:26:09.180228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:26:09.180228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:26:09.180228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:26:09.180228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:09.180228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 439/883] 10.222.0.91 () {56 vars in 1117 bytes} [Wed Aug 24 10:26:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:09.187743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089430fe-cfc5-40fa-be47-fe90117e0ff5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:09.217520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:09.363177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089430fe-cfc5-40fa-be47-fe90117e0ff5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:09.415457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d40650-8da2-482d-bcfc-0149719d1124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:09.416485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d40650-8da2-482d-bcfc-0149719d1124 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:09.416972 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d40650-8da2-482d-bcfc-0149719d1124 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:09.417475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d40650-8da2-482d-bcfc-0149719d1124 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:09.418421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d40650-8da2-482d-bcfc-0149719d1124 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:09.418953 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d40650-8da2-482d-bcfc-0149719d1124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:09.420641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d40650-8da2-482d-bcfc-0149719d1124 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:09.441303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 445/884] 10.222.0.91 () {56 vars in 1149 bytes} [Wed Aug 24 10:26:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:09.448259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0076b1-cecd-4a30-bfd9-91dbce05a6e3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:09.639490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0076b1-cecd-4a30-bfd9-91dbce05a6e3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:09.680796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93979b57-dfee-4a02-bf8c-df2ec78662d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:09.681793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979b57-dfee-4a02-bf8c-df2ec78662d2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:09.682279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979b57-dfee-4a02-bf8c-df2ec78662d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:09.682864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979b57-dfee-4a02-bf8c-df2ec78662d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:09.733117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:09.737295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaf43f-5781-493a-b932-ff859a5834ce None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:09.737579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaf43f-5781-493a-b932-ff859a5834ce None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:09.737878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaf43f-5781-493a-b932-ff859a5834ce None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:09.739476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 446/885] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:26:09.745595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81650f41-fd57-4f97-a43d-2263970f57b1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:09.745859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81650f41-fd57-4f97-a43d-2263970f57b1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:09.746121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81650f41-fd57-4f97-a43d-2263970f57b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:09.762319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93979b57-dfee-4a02-bf8c-df2ec78662d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:09.764140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93979b57-dfee-4a02-bf8c-df2ec78662d2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:09.765290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-81650f41-fd57-4f97-a43d-2263970f57b1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:09.766632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-81650f41-fd57-4f97-a43d-2263970f57b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:09.865746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 447/886] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:09.865746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4ed4c-82b5-4cf3-8a1b-d5fd795521ad None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:09.865746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4ed4c-82b5-4cf3-8a1b-d5fd795521ad None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:09.865746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4ed4c-82b5-4cf3-8a1b-d5fd795521ad None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:09.874763 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 448/887] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:09.876950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ca83e-1b2d-433a-b602-e2a930d8b8c9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:09.877457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ca83e-1b2d-433a-b602-e2a930d8b8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:09.877839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ca83e-1b2d-433a-b602-e2a930d8b8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:09.899995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 440/888] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:26:09 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:26:09.905754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93979b57-dfee-4a02-bf8c-df2ec78662d2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:09.907899 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d74ca83e-1b2d-433a-b602-e2a930d8b8c9 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:09.910027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d74ca83e-1b2d-433a-b602-e2a930d8b8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:09.916424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:10.008478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:10.015890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 449/889] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:10.036256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93979b57-dfee-4a02-bf8c-df2ec78662d2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:10.075164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaad52-5a40-4549-9f2d-49af747eee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:10.076062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaad52-5a40-4549-9f2d-49af747eee12 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:10.076492 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaad52-5a40-4549-9f2d-49af747eee12 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:10.077584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaad52-5a40-4549-9f2d-49af747eee12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:10.088321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaad52-5a40-4549-9f2d-49af747eee12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:10.090025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaad52-5a40-4549-9f2d-49af747eee12 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-afdaad52-5a40-4549-9f2d-49af747eee12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:10.107120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:10.108328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:10.109437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:10.109437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:10.109437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:10.111169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 441/890] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:10.116870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ca83e-1b2d-433a-b602-e2a930d8b8c9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:10.156694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaad52-5a40-4549-9f2d-49af747eee12 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:10.245266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ca83e-1b2d-433a-b602-e2a930d8b8c9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:10.270897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaad52-5a40-4549-9f2d-49af747eee12 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:10.285454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b6e85-a616-407b-8742-d832365c55d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:10.286206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b6e85-a616-407b-8742-d832365c55d2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:10.286576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b6e85-a616-407b-8742-d832365c55d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:10.286921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b6e85-a616-407b-8742-d832365c55d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:10.287699 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b6e85-a616-407b-8742-d832365c55d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:10.288093 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b6e85-a616-407b-8742-d832365c55d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:10.290107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b6e85-a616-407b-8742-d832365c55d2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:10.300238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:10.308442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 450/891] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:10.309405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b6e85-a616-407b-8742-d832365c55d2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:10.318023 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:10.328503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865518c-00cf-4b1a-8bd9-1b3791c1283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:10.329402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865518c-00cf-4b1a-8bd9-1b3791c1283f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:10.329689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865518c-00cf-4b1a-8bd9-1b3791c1283f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:10.330025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865518c-00cf-4b1a-8bd9-1b3791c1283f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:10.330627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865518c-00cf-4b1a-8bd9-1b3791c1283f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:10.332113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865518c-00cf-4b1a-8bd9-1b3791c1283f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c865518c-00cf-4b1a-8bd9-1b3791c1283f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:10.343062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:10.344194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:10.345132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 442/892] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:26:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:26:10.346048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865518c-00cf-4b1a-8bd9-1b3791c1283f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:10.446059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b6e85-a616-407b-8742-d832365c55d2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:10.470140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865518c-00cf-4b1a-8bd9-1b3791c1283f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:10.488741 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057d5e2-7963-47b2-9f08-3228b9dc9ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:10.489677 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057d5e2-7963-47b2-9f08-3228b9dc9ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:10.489961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057d5e2-7963-47b2-9f08-3228b9dc9ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:10.490233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057d5e2-7963-47b2-9f08-3228b9dc9ff5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:10.498543 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057d5e2-7963-47b2-9f08-3228b9dc9ff5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:10.500026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057d5e2-7963-47b2-9f08-3228b9dc9ff5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:10.510656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7e7e4-d6c3-40da-aa56-e2dee46c83a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:10.511632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7e7e4-d6c3-40da-aa56-e2dee46c83a8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:10.512131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7e7e4-d6c3-40da-aa56-e2dee46c83a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7057d5e2-7963-47b2-9f08-3228b9dc9ff5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:26:10.512467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:10.513398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:10.514353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:26:10.514353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:26:10.514353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:26:10.514353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:26:10.514353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:26:10.514353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:26:10.514353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:10.514353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:10.514353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 451/893] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:10.514353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057d5e2-7963-47b2-9f08-3228b9dc9ff5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:10.515563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7e7e4-d6c3-40da-aa56-e2dee46c83a8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:10.516206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7e7e4-d6c3-40da-aa56-e2dee46c83a8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:10.517594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7e7e4-d6c3-40da-aa56-e2dee46c83a8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0bc7e7e4-d6c3-40da-aa56-e2dee46c83a8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:10.530384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:10.531498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:10.532400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:10.536226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 443/894] 10.222.0.91 () {56 vars in 1126 bytes} [Wed Aug 24 10:26:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:10.537746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7e7e4-d6c3-40da-aa56-e2dee46c83a8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:10.587882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:10.601019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:10.633315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057d5e2-7963-47b2-9f08-3228b9dc9ff5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:10.652316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7e7e4-d6c3-40da-aa56-e2dee46c83a8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:10.670180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ea25-e5fe-4f3c-8ff5-a6172bbb36b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:10.670787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ea25-e5fe-4f3c-8ff5-a6172bbb36b9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:10.671060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ea25-e5fe-4f3c-8ff5-a6172bbb36b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:10.671337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ea25-e5fe-4f3c-8ff5-a6172bbb36b9 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:10.671985 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4ea25-e5fe-4f3c-8ff5-a6172bbb36b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:10.672276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4ea25-e5fe-4f3c-8ff5-a6172bbb36b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:10.673646 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4ea25-e5fe-4f3c-8ff5-a6172bbb36b9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:10.683850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 452/895] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:26:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:10.684784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ea25-e5fe-4f3c-8ff5-a6172bbb36b9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:10.688774 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab511778-d7f9-4796-bfac-f84a9648f7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:10.689457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab511778-d7f9-4796-bfac-f84a9648f7af None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:10.689736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab511778-d7f9-4796-bfac-f84a9648f7af None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:10.690004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab511778-d7f9-4796-bfac-f84a9648f7af None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:10.690700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab511778-d7f9-4796-bfac-f84a9648f7af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:10.690999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab511778-d7f9-4796-bfac-f84a9648f7af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:10.692452 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab511778-d7f9-4796-bfac-f84a9648f7af None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:10.707039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 444/896] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:10.707839 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab511778-d7f9-4796-bfac-f84a9648f7af None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:10.800620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ea25-e5fe-4f3c-8ff5-a6172bbb36b9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:10.818382 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab511778-d7f9-4796-bfac-f84a9648f7af None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:10.827801 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:10.837751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:10.840726 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537eca68-f757-42eb-9781-4cb60c4e4879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:10.841364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eca68-f757-42eb-9781-4cb60c4e4879 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:10.841647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eca68-f757-42eb-9781-4cb60c4e4879 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:10.841919 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eca68-f757-42eb-9781-4cb60c4e4879 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:10.842546 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537eca68-f757-42eb-9781-4cb60c4e4879 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:10.842879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537eca68-f757-42eb-9781-4cb60c4e4879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:10.844238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537eca68-f757-42eb-9781-4cb60c4e4879 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:10.849226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 453/897] 10.222.0.91 () {56 vars in 1122 bytes} [Wed Aug 24 10:26:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:10.855310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537eca68-f757-42eb-9781-4cb60c4e4879 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:10.857520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fca659-5927-4571-89f4-27fab9ea51c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:10.858134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fca659-5927-4571-89f4-27fab9ea51c2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:10.858434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fca659-5927-4571-89f4-27fab9ea51c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:10.858701 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fca659-5927-4571-89f4-27fab9ea51c2 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:10.859327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fca659-5927-4571-89f4-27fab9ea51c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:10.859619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fca659-5927-4571-89f4-27fab9ea51c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:10.861008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fca659-5927-4571-89f4-27fab9ea51c2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:10.865970 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 445/898] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:26:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:10.866756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fca659-5927-4571-89f4-27fab9ea51c2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:10.973599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537eca68-f757-42eb-9781-4cb60c4e4879 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:10.987759 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fca659-5927-4571-89f4-27fab9ea51c2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:11.015147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab379c-7e26-4513-a439-856cf032eea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:11.015765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab379c-7e26-4513-a439-856cf032eea9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:11.016047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab379c-7e26-4513-a439-856cf032eea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:11.016318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab379c-7e26-4513-a439-856cf032eea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:11.017027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab379c-7e26-4513-a439-856cf032eea9 None admin] RBAC: Adding query filter params (role.id=04a0de02c1844906ab3379298e71c6a4, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=1ed2c124184645adad2be9cd89c9e88b) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:11.017319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab379c-7e26-4513-a439-856cf032eea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:11.018770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab379c-7e26-4513-a439-856cf032eea9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:11.026101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 454/899] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:26:10 2022] GET /identity/v3/role_assignments?user.id=1ed2c124184645adad2be9cd89c9e88b&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=04a0de02c1844906ab3379298e71c6a4 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:11.027029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab379c-7e26-4513-a439-856cf032eea9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:11.040004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640511b2-f312-416c-bf29-ba9bfaaa1410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:11.040940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640511b2-f312-416c-bf29-ba9bfaaa1410 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:11.041215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640511b2-f312-416c-bf29-ba9bfaaa1410 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:11.041485 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640511b2-f312-416c-bf29-ba9bfaaa1410 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:11.042136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640511b2-f312-416c-bf29-ba9bfaaa1410 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:11.042441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640511b2-f312-416c-bf29-ba9bfaaa1410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:11.043920 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640511b2-f312-416c-bf29-ba9bfaaa1410 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:11.057837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 446/900] 10.222.0.91 () {56 vars in 1122 bytes} [Wed Aug 24 10:26:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:11.113169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:11.175054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab379c-7e26-4513-a439-856cf032eea9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:11.217634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e1ef7-7f57-48be-983d-ced85aa54da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:11.218596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e1ef7-7f57-48be-983d-ced85aa54da7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:11.218877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e1ef7-7f57-48be-983d-ced85aa54da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:11.219146 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e1ef7-7f57-48be-983d-ced85aa54da7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:11.219886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e1ef7-7f57-48be-983d-ced85aa54da7 None admin] RBAC: Adding query filter params (interface=public, service_id=98e8d107236643a1a68ba699fc4a7137, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:11.220193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e1ef7-7f57-48be-983d-ced85aa54da7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:11.221573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e1ef7-7f57-48be-983d-ced85aa54da7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:11.228063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 455/901] 10.222.0.91 () {56 vars in 1251 bytes} [Wed Aug 24 10:26:11 2022] GET /identity/v3/endpoints?service_id=98e8d107236643a1a68ba699fc4a7137&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:11.233861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640511b2-f312-416c-bf29-ba9bfaaa1410 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:11.294949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:11.303322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f45ec-e4cc-48be-9bcd-521a72d3281b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:11.303644 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f45ec-e4cc-48be-9bcd-521a72d3281b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:11.303918 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f45ec-e4cc-48be-9bcd-521a72d3281b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:11.305696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 456/902] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:26:11.311301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ffc14-e524-4613-8404-f57b0d2dcdd8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:11.313267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ffc14-e524-4613-8404-f57b0d2dcdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:11.313267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ffc14-e524-4613-8404-f57b0d2dcdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:11.331104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e89ffc14-e524-4613-8404-f57b0d2dcdd8 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:11.332415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e89ffc14-e524-4613-8404-f57b0d2dcdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:11.367737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640511b2-f312-416c-bf29-ba9bfaaa1410 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:11.408653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083ff0-6b72-4aa5-bc1d-cdfcfc3b3b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:11.409356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083ff0-6b72-4aa5-bc1d-cdfcfc3b3b9b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:11.409787 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083ff0-6b72-4aa5-bc1d-cdfcfc3b3b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:11.410063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083ff0-6b72-4aa5-bc1d-cdfcfc3b3b9b None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:11.410749 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65083ff0-6b72-4aa5-bc1d-cdfcfc3b3b9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:11.412162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65083ff0-6b72-4aa5-bc1d-cdfcfc3b3b9b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:11.419643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 447/904] 10.222.0.91 () {56 vars in 1087 bytes} [Wed Aug 24 10:26:11 2022] GET /identity/v3/services => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:26:11.420340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 457/904] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:11.711377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083ff0-6b72-4aa5-bc1d-cdfcfc3b3b9b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:11.827669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083ff0-6b72-4aa5-bc1d-cdfcfc3b3b9b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:11.837345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:11.863585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151fad0-bc63-42aa-9428-2b8cd68235dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:11.864242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151fad0-bc63-42aa-9428-2b8cd68235dc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:11.864523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151fad0-bc63-42aa-9428-2b8cd68235dc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:11.864800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151fad0-bc63-42aa-9428-2b8cd68235dc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:11.865379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151fad0-bc63-42aa-9428-2b8cd68235dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:11.866808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151fad0-bc63-42aa-9428-2b8cd68235dc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3151fad0-bc63-42aa-9428-2b8cd68235dc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:11.876424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:11.877404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:11.878697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 448/905] 10.222.0.91 () {56 vars in 1132 bytes} [Wed Aug 24 10:26:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:11.884529 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ffc14-e524-4613-8404-f57b0d2dcdd8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:11.936368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:11.994066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ffc14-e524-4613-8404-f57b0d2dcdd8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:12.031554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc923-3102-4035-9ab4-7a88e958d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:12.032189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc923-3102-4035-9ab4-7a88e958d231 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:12.032465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc923-3102-4035-9ab4-7a88e958d231 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:12.032734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc923-3102-4035-9ab4-7a88e958d231 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:12.033361 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfc923-3102-4035-9ab4-7a88e958d231 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:12.033658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfc923-3102-4035-9ab4-7a88e958d231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:12.035028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfc923-3102-4035-9ab4-7a88e958d231 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:12.040558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 458/906] 10.222.0.91 () {56 vars in 1126 bytes} [Wed Aug 24 10:26:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:12.045786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151fad0-bc63-42aa-9428-2b8cd68235dc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:12.153797 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151fad0-bc63-42aa-9428-2b8cd68235dc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:12.190011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09204b62-0f43-4fde-bca4-3c79cf562215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:12.190617 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09204b62-0f43-4fde-bca4-3c79cf562215 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:12.190894 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09204b62-0f43-4fde-bca4-3c79cf562215 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:12.191166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09204b62-0f43-4fde-bca4-3c79cf562215 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:12.191835 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09204b62-0f43-4fde-bca4-3c79cf562215 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:12.192138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09204b62-0f43-4fde-bca4-3c79cf562215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:12.193513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09204b62-0f43-4fde-bca4-3c79cf562215 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:12.199312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 449/907] 10.222.0.91 () {56 vars in 1126 bytes} [Wed Aug 24 10:26:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:12.205202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc923-3102-4035-9ab4-7a88e958d231 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:12.314083 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc923-3102-4035-9ab4-7a88e958d231 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:12.325886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:12.352744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ebabf-e742-48c0-a568-2328d7228a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:12.353358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ebabf-e742-48c0-a568-2328d7228a73 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:12.353631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ebabf-e742-48c0-a568-2328d7228a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:12.353903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ebabf-e742-48c0-a568-2328d7228a73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:12.354670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ebabf-e742-48c0-a568-2328d7228a73 None admin] RBAC: Adding query filter params (interface=public, service_id=dccc02747c334abea1baa125ed5b93c3, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:12.354980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ebabf-e742-48c0-a568-2328d7228a73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:12.356425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ebabf-e742-48c0-a568-2328d7228a73 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:12.362564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 459/908] 10.222.0.91 () {56 vars in 1251 bytes} [Wed Aug 24 10:26:12 2022] GET /identity/v3/endpoints?service_id=dccc02747c334abea1baa125ed5b93c3&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:12.368350 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09204b62-0f43-4fde-bca4-3c79cf562215 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:12.406644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:12.477426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09204b62-0f43-4fde-bca4-3c79cf562215 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:12.515112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ff0a2-8386-4c33-9ae1-53ee3cb1277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:12.515748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ff0a2-8386-4c33-9ae1-53ee3cb1277d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:12.516033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ff0a2-8386-4c33-9ae1-53ee3cb1277d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:12.516305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ff0a2-8386-4c33-9ae1-53ee3cb1277d None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:12.516914 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ff0a2-8386-4c33-9ae1-53ee3cb1277d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:12.518520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ff0a2-8386-4c33-9ae1-53ee3cb1277d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:12.525446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 450/909] 10.222.0.91 () {56 vars in 1087 bytes} [Wed Aug 24 10:26:12 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:26:13.118287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d496363-9b42-4637-97d0-62aa5bcefccd None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:13.118821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d496363-9b42-4637-97d0-62aa5bcefccd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:13.119420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d496363-9b42-4637-97d0-62aa5bcefccd None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:13.122128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 460/910] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:13.127866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89751ca-9ccd-4a8b-8bdd-7e94bd8fb7aa None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:13.128326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89751ca-9ccd-4a8b-8bdd-7e94bd8fb7aa None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:13.128431 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89751ca-9ccd-4a8b-8bdd-7e94bd8fb7aa None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:13.130008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 451/911] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:13.130587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04299a95-ff0a-418d-9631-308e4292af6a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:13.130932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04299a95-ff0a-418d-9631-308e4292af6a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:13.131320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04299a95-ff0a-418d-9631-308e4292af6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:13.136048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ff90b-b75d-4bae-be23-a840822c9dff None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:13.136334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ff90b-b75d-4bae-be23-a840822c9dff None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:13.136674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ff90b-b75d-4bae-be23-a840822c9dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:13.155538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-04299a95-ff0a-418d-9631-308e4292af6a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:13.156849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-04299a95-ff0a-418d-9631-308e4292af6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:13.157433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ac2ff90b-b75d-4bae-be23-a840822c9dff None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:13.158595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ac2ff90b-b75d-4bae-be23-a840822c9dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:13.243844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 452/913] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:13.247791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 461/913] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:13.476267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1de8-51a4-4672-8903-5e615ab4ff6b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:13.476997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1de8-51a4-4672-8903-5e615ab4ff6b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:13.477496 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1de8-51a4-4672-8903-5e615ab4ff6b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:13.479351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 453/914] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:13.485141 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439dfb1-9a8e-4f7d-9f83-b3954ea529e1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:13.485669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439dfb1-9a8e-4f7d-9f83-b3954ea529e1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:13.486145 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439dfb1-9a8e-4f7d-9f83-b3954ea529e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:13.505113 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c439dfb1-9a8e-4f7d-9f83-b3954ea529e1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:13.506750 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c439dfb1-9a8e-4f7d-9f83-b3954ea529e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:13.523984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1de8-51a4-4672-8903-5e615ab4ff6b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:13.556821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:13.582205 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 462/915] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:13.588078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439dfb1-9a8e-4f7d-9f83-b3954ea529e1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:13.624939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:13.655381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1de8-51a4-4672-8903-5e615ab4ff6b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:13.704425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc283482-89f5-4676-ac34-5eafc6f88b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:13.705310 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc283482-89f5-4676-ac34-5eafc6f88b0d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:13.705585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc283482-89f5-4676-ac34-5eafc6f88b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:13.706100 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc283482-89f5-4676-ac34-5eafc6f88b0d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:13.709962 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439dfb1-9a8e-4f7d-9f83-b3954ea529e1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:13.719110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc283482-89f5-4676-ac34-5eafc6f88b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-dc283482-89f5-4676-ac34-5eafc6f88b0d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:26:13.725616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:13.726698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:13.727574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:13.727574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:13.727574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:13.727574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:13.727574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:26:13.727574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:26:13.727574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:26:13.727574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:26:13.727574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:26:13.727574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:26:13.727574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:26:13.727574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:13.728313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 454/916] 10.222.0.91 () {56 vars in 1120 bytes} [Wed Aug 24 10:26:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:26:13.733386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc283482-89f5-4676-ac34-5eafc6f88b0d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:13.749815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52112fb-0f42-4fd5-9fb1-64d851c9d10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:13.750784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52112fb-0f42-4fd5-9fb1-64d851c9d10d None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:13.751065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52112fb-0f42-4fd5-9fb1-64d851c9d10d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:13.751658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52112fb-0f42-4fd5-9fb1-64d851c9d10d None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:13.752627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52112fb-0f42-4fd5-9fb1-64d851c9d10d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:13.754165 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52112fb-0f42-4fd5-9fb1-64d851c9d10d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:13.837017 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 463/917] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:26:13 2022] POST /identity/v3/services => generated 241 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:26:13.847683 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:13.860303 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc283482-89f5-4676-ac34-5eafc6f88b0d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:13.871098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52112fb-0f42-4fd5-9fb1-64d851c9d10d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:13.929317 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99678abf-7623-405d-bab1-1133ebbbf8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:13.931054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99678abf-7623-405d-bab1-1133ebbbf8ee None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:13.931576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99678abf-7623-405d-bab1-1133ebbbf8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:13.932918 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99678abf-7623-405d-bab1-1133ebbbf8ee None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:13.933912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99678abf-7623-405d-bab1-1133ebbbf8ee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:13.934474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99678abf-7623-405d-bab1-1133ebbbf8ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:13.937296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99678abf-7623-405d-bab1-1133ebbbf8ee None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:13.950688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 455/918] 10.222.0.91 () {56 vars in 1115 bytes} [Wed Aug 24 10:26:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:13.956835 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99678abf-7623-405d-bab1-1133ebbbf8ee None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:14.008047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:14.018769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52112fb-0f42-4fd5-9fb1-64d851c9d10d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:14.067779 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeeb482-f6e9-4d1c-8db0-5293cdea4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:14.069090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeb482-f6e9-4d1c-8db0-5293cdea4b8b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:14.069579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeb482-f6e9-4d1c-8db0-5293cdea4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:14.070422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeb482-f6e9-4d1c-8db0-5293cdea4b8b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:14.071499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeeb482-f6e9-4d1c-8db0-5293cdea4b8b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:14.073775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeeb482-f6e9-4d1c-8db0-5293cdea4b8b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-2eeeb482-f6e9-4d1c-8db0-5293cdea4b8b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:14.086506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:14.087591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:26:14.088484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:14.090109 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 464/919] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:26:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:14.099623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeeb482-f6e9-4d1c-8db0-5293cdea4b8b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:14.104800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99678abf-7623-405d-bab1-1133ebbbf8ee None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:14.148361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b837e37-a961-4079-9f78-c8fdcd9e155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:14.149973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b837e37-a961-4079-9f78-c8fdcd9e155d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:14.150445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b837e37-a961-4079-9f78-c8fdcd9e155d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:14.150880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b837e37-a961-4079-9f78-c8fdcd9e155d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:14.165775 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b837e37-a961-4079-9f78-c8fdcd9e155d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:14.167591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b837e37-a961-4079-9f78-c8fdcd9e155d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:14.177288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1b837e37-a961-4079-9f78-c8fdcd9e155d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:14.186355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:14.187526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:14.188674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:14.188674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:14.188674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:14.191001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 456/920] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:14.200821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b837e37-a961-4079-9f78-c8fdcd9e155d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:14.266432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeeb482-f6e9-4d1c-8db0-5293cdea4b8b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:14.312243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890be311-a205-4d4d-83f2-1181cda0f447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:14.312857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890be311-a205-4d4d-83f2-1181cda0f447 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:14.313130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890be311-a205-4d4d-83f2-1181cda0f447 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:14.313397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890be311-a205-4d4d-83f2-1181cda0f447 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:14.314494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890be311-a205-4d4d-83f2-1181cda0f447 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:14.314797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890be311-a205-4d4d-83f2-1181cda0f447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:14.316609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890be311-a205-4d4d-83f2-1181cda0f447 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:14.326375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 465/921] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:26:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:14.333542 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890be311-a205-4d4d-83f2-1181cda0f447 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:14.349479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b837e37-a961-4079-9f78-c8fdcd9e155d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:14.367201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:14.391027 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750611-16cb-493f-a557-0e084a5d8439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:14.391641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750611-16cb-493f-a557-0e084a5d8439 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:14.391964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750611-16cb-493f-a557-0e084a5d8439 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:14.392233 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750611-16cb-493f-a557-0e084a5d8439 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:14.393195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b750611-16cb-493f-a557-0e084a5d8439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:14.393195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b750611-16cb-493f-a557-0e084a5d8439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:14.394521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b750611-16cb-493f-a557-0e084a5d8439 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:14.413009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 457/922] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:14.416007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750611-16cb-493f-a557-0e084a5d8439 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:14.484571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:14.486175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890be311-a205-4d4d-83f2-1181cda0f447 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:14.529072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750611-16cb-493f-a557-0e084a5d8439 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:14.536166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db8651-33a1-4300-a7df-86af7eadd5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:14.537490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db8651-33a1-4300-a7df-86af7eadd5cb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:14.537968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db8651-33a1-4300-a7df-86af7eadd5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:14.538453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db8651-33a1-4300-a7df-86af7eadd5cb None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:14.540090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db8651-33a1-4300-a7df-86af7eadd5cb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:14.540618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db8651-33a1-4300-a7df-86af7eadd5cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:14.542728 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db8651-33a1-4300-a7df-86af7eadd5cb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:14.548444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 466/923] 10.222.0.91 () {56 vars in 1114 bytes} [Wed Aug 24 10:26:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:14.549978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291178aa-bf0c-4d10-821d-57905d1fc2c4 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:14.550453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291178aa-bf0c-4d10-821d-57905d1fc2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:14.550895 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291178aa-bf0c-4d10-821d-57905d1fc2c4 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:14.552613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 467/924] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:14.554642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291178aa-bf0c-4d10-821d-57905d1fc2c4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:14.571226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e9e77-7583-43d8-bb65-3a987da4830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:14.571897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e9e77-7583-43d8-bb65-3a987da4830e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:14.572314 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e9e77-7583-43d8-bb65-3a987da4830e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:14.572589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e9e77-7583-43d8-bb65-3a987da4830e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:14.580906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e9e77-7583-43d8-bb65-3a987da4830e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:14.582698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e9e77-7583-43d8-bb65-3a987da4830e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9e2e9e77-7583-43d8-bb65-3a987da4830e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:26:14.595705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:14.596712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:14.597663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:14.597663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:14.597663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:26:14.597663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:26:14.597663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:26:14.597663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:26:14.597663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:26:14.597663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:26:14.597663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:26:14.597663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:14.600054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 458/925] 10.222.0.91 () {56 vars in 1117 bytes} [Wed Aug 24 10:26:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:14.602037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff16762-87f3-4fa7-a623-e37da091f464 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:14.602550 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff16762-87f3-4fa7-a623-e37da091f464 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:14.602828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff16762-87f3-4fa7-a623-e37da091f464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:14.622061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6ff16762-87f3-4fa7-a623-e37da091f464 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:14.623509 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6ff16762-87f3-4fa7-a623-e37da091f464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:14.654996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:14.672175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291178aa-bf0c-4d10-821d-57905d1fc2c4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:14.696061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 459/926] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:14.696721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff16762-87f3-4fa7-a623-e37da091f464 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:14.713094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850273c6-fc2e-47cf-a5d6-99f4e741e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:14.713795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850273c6-fc2e-47cf-a5d6-99f4e741e02a None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:14.714068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850273c6-fc2e-47cf-a5d6-99f4e741e02a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:14.714335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850273c6-fc2e-47cf-a5d6-99f4e741e02a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:14.714984 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850273c6-fc2e-47cf-a5d6-99f4e741e02a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:14.716703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850273c6-fc2e-47cf-a5d6-99f4e741e02a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:14.755499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:14.811877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff16762-87f3-4fa7-a623-e37da091f464 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:14.813649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 468/927] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:26:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:26:14.861948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88c86d-62bd-4353-b35f-4746ecd20b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:14.862982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88c86d-62bd-4353-b35f-4746ecd20b53 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:14.863495 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88c86d-62bd-4353-b35f-4746ecd20b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:14.863999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88c86d-62bd-4353-b35f-4746ecd20b53 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:14.865012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88c86d-62bd-4353-b35f-4746ecd20b53 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:14.865532 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88c86d-62bd-4353-b35f-4746ecd20b53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:14.867659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88c86d-62bd-4353-b35f-4746ecd20b53 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:14.888950 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 460/928] 10.222.0.91 () {56 vars in 1149 bytes} [Wed Aug 24 10:26:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:14.895216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850273c6-fc2e-47cf-a5d6-99f4e741e02a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:14.981526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88c86d-62bd-4353-b35f-4746ecd20b53 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:15.030386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850273c6-fc2e-47cf-a5d6-99f4e741e02a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:15.077888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813cac-238c-454e-b031-acac9533ff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:15.078502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813cac-238c-454e-b031-acac9533ff21 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:15.078784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813cac-238c-454e-b031-acac9533ff21 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:15.079059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813cac-238c-454e-b031-acac9533ff21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:15.110048 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80813cac-238c-454e-b031-acac9533ff21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:15.112272 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80813cac-238c-454e-b031-acac9533ff21 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:15.115458 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:15.133752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88c86d-62bd-4353-b35f-4746ecd20b53 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-80813cac-238c-454e-b031-acac9533ff21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:15.135031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:15.146633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:15.147541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:15.147541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:15.147541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:15.147744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:15.147840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 469/929] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:15.147840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813cac-238c-454e-b031-acac9533ff21 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:15.189669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903c4fb-0ea2-485b-89b1-d665df18816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:15.190380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903c4fb-0ea2-485b-89b1-d665df18816f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:15.190621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903c4fb-0ea2-485b-89b1-d665df18816f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:15.190881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903c4fb-0ea2-485b-89b1-d665df18816f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:15.191980 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903c4fb-0ea2-485b-89b1-d665df18816f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:15.198259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903c4fb-0ea2-485b-89b1-d665df18816f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d903c4fb-0ea2-485b-89b1-d665df18816f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:15.212825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:15.213836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:26:15.214741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:15.215491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 461/930] 10.222.0.91 () {56 vars in 1132 bytes} [Wed Aug 24 10:26:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:26:15.220014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903c4fb-0ea2-485b-89b1-d665df18816f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:15.272254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813cac-238c-454e-b031-acac9533ff21 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:15.314839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a3f9-c2d4-4129-805b-560f8728c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:15.315514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a3f9-c2d4-4129-805b-560f8728c39d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:15.315821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a3f9-c2d4-4129-805b-560f8728c39d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:15.316096 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a3f9-c2d4-4129-805b-560f8728c39d None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:15.316745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5a3f9-c2d4-4129-805b-560f8728c39d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:15.317041 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5a3f9-c2d4-4129-805b-560f8728c39d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:15.318428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5a3f9-c2d4-4129-805b-560f8728c39d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:15.334635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 470/931] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:15.346229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a3f9-c2d4-4129-805b-560f8728c39d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:15.364037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903c4fb-0ea2-485b-89b1-d665df18816f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:15.410323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb28c88-4b04-4162-a379-1066b81e4a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:15.411142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb28c88-4b04-4162-a379-1066b81e4a30 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:15.411420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb28c88-4b04-4162-a379-1066b81e4a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:15.411684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb28c88-4b04-4162-a379-1066b81e4a30 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:15.412343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb28c88-4b04-4162-a379-1066b81e4a30 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:15.412640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb28c88-4b04-4162-a379-1066b81e4a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:15.414684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb28c88-4b04-4162-a379-1066b81e4a30 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:15.423874 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 462/932] 10.222.0.91 () {56 vars in 1126 bytes} [Wed Aug 24 10:26:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:15.426423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb28c88-4b04-4162-a379-1066b81e4a30 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:15.428338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:15.468411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:15.497894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a3f9-c2d4-4129-805b-560f8728c39d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:15.548637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6a908-e2e5-47fd-89f9-fc81df4a626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:15.549280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6a908-e2e5-47fd-89f9-fc81df4a626d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:15.549558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6a908-e2e5-47fd-89f9-fc81df4a626d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:15.549827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6a908-e2e5-47fd-89f9-fc81df4a626d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:15.551249 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb28c88-4b04-4162-a379-1066b81e4a30 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:15.559388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6a908-e2e5-47fd-89f9-fc81df4a626d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:15.561498 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6a908-e2e5-47fd-89f9-fc81df4a626d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-aff6a908-e2e5-47fd-89f9-fc81df4a626d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:26:15.579445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:15.580475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:15.581412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:26:15.581412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:26:15.581412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:26:15.581412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:26:15.581412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:26:15.581412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:26:15.581412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:15.581412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:15.583933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 471/933] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:15.586878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6a908-e2e5-47fd-89f9-fc81df4a626d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:15.603300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50d928-4350-4f84-b536-cdec674d42b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:15.603947 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50d928-4350-4f84-b536-cdec674d42b7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:15.604234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50d928-4350-4f84-b536-cdec674d42b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:15.604489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50d928-4350-4f84-b536-cdec674d42b7 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:15.605123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50d928-4350-4f84-b536-cdec674d42b7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:15.605421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50d928-4350-4f84-b536-cdec674d42b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:15.606783 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50d928-4350-4f84-b536-cdec674d42b7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:15.615765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 463/934] 10.222.0.91 () {56 vars in 1126 bytes} [Wed Aug 24 10:26:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:15.618629 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50d928-4350-4f84-b536-cdec674d42b7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:15.715975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6a908-e2e5-47fd-89f9-fc81df4a626d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:15.738224 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:15.740403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:15.747096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50d928-4350-4f84-b536-cdec674d42b7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:15.764279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964060d3-3a99-48e7-8e28-0d0abf9c74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:15.764936 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964060d3-3a99-48e7-8e28-0d0abf9c74e6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:15.765424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964060d3-3a99-48e7-8e28-0d0abf9c74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:15.765797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964060d3-3a99-48e7-8e28-0d0abf9c74e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:15.766628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964060d3-3a99-48e7-8e28-0d0abf9c74e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:15.767030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964060d3-3a99-48e7-8e28-0d0abf9c74e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:15.768663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964060d3-3a99-48e7-8e28-0d0abf9c74e6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:15.786688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b5ddb-8d5f-4104-968d-7e6bef53c63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:15.787658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5ddb-8d5f-4104-968d-7e6bef53c63d None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:15.788150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5ddb-8d5f-4104-968d-7e6bef53c63d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:15.788619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5ddb-8d5f-4104-968d-7e6bef53c63d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:15.789889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 472/935] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:15.790677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5ddb-8d5f-4104-968d-7e6bef53c63d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:15.792285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964060d3-3a99-48e7-8e28-0d0abf9c74e6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:15.792432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5ddb-8d5f-4104-968d-7e6bef53c63d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:15.881407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 464/936] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:26:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:26:15.928562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964060d3-3a99-48e7-8e28-0d0abf9c74e6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:15.976788 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d03c-8dcd-4637-97af-bcab41843691 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:15.977398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d03c-8dcd-4637-97af-bcab41843691 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:15.977907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d03c-8dcd-4637-97af-bcab41843691 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:15.979245 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cdfa0-7bb2-4e21-ac3a-7bb555a191c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:15.980203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cdfa0-7bb2-4e21-ac3a-7bb555a191c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:15.980691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cdfa0-7bb2-4e21-ac3a-7bb555a191c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:15.981133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cdfa0-7bb2-4e21-ac3a-7bb555a191c3 None admin] PATH_INFO: `/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/1ed2c124184645adad2be9cd89c9e88b/roles/04a0de02c1844906ab3379298e71c6a4` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:15.983625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cdfa0-7bb2-4e21-ac3a-7bb555a191c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=acd807f8a28d43cdac159fa3d606af60, user_id=1ed2c124184645adad2be9cd89c9e88b, role_id=04a0de02c1844906ab3379298e71c6a4)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:15.985341 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cdfa0-7bb2-4e21-ac3a-7bb555a191c3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:15.987395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 465/937] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:15.989842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b162c8-e468-4cef-82a3-36a68b84ef2c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:15.989842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b162c8-e468-4cef-82a3-36a68b84ef2c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:15.990068 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b162c8-e468-4cef-82a3-36a68b84ef2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:16.012608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-60b162c8-e468-4cef-82a3-36a68b84ef2c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:16.013944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-60b162c8-e468-4cef-82a3-36a68b84ef2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:16.073772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 473/938] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:26:15 2022] PUT /identity/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/1ed2c124184645adad2be9cd89c9e88b/roles/04a0de02c1844906ab3379298e71c6a4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:26:16.104525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 466/939] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:16.380588 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cdfa0-7bb2-4e21-ac3a-7bb555a191c3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:16.420676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:16.506441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cdfa0-7bb2-4e21-ac3a-7bb555a191c3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:16.548978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d9e1b-1d4b-4012-8736-4612f2178638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:16.549620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9e1b-1d4b-4012-8736-4612f2178638 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:16.549894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9e1b-1d4b-4012-8736-4612f2178638 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:16.550159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9e1b-1d4b-4012-8736-4612f2178638 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:16.550744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d9e1b-1d4b-4012-8736-4612f2178638 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:16.552207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d9e1b-1d4b-4012-8736-4612f2178638 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-cf8d9e1b-1d4b-4012-8736-4612f2178638 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:16.564876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:16.565975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:16.566863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 474/940] 10.222.0.91 () {56 vars in 1126 bytes} [Wed Aug 24 10:26:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:16.572741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b162c8-e468-4cef-82a3-36a68b84ef2c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:16.662305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:16.683295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b162c8-e468-4cef-82a3-36a68b84ef2c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:16.719629 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b7972-edfb-4cec-a07e-2758494c5f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:16.720265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b7972-edfb-4cec-a07e-2758494c5f5c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:16.720640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b7972-edfb-4cec-a07e-2758494c5f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:16.720885 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b7972-edfb-4cec-a07e-2758494c5f5c None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:16.721510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b7972-edfb-4cec-a07e-2758494c5f5c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:16.721809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b7972-edfb-4cec-a07e-2758494c5f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:16.723163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b7972-edfb-4cec-a07e-2758494c5f5c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:16.733478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 467/941] 10.222.0.91 () {56 vars in 1122 bytes} [Wed Aug 24 10:26:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:16.735008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d9e1b-1d4b-4012-8736-4612f2178638 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:16.835139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:16.842515 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d9e1b-1d4b-4012-8736-4612f2178638 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:16.879021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46538f34-2946-4dd8-b3b1-ddd5ccd1e81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:16.879632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46538f34-2946-4dd8-b3b1-ddd5ccd1e81a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:16.879944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46538f34-2946-4dd8-b3b1-ddd5ccd1e81a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:16.880213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46538f34-2946-4dd8-b3b1-ddd5ccd1e81a None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:16.880933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46538f34-2946-4dd8-b3b1-ddd5ccd1e81a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:16.881231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46538f34-2946-4dd8-b3b1-ddd5ccd1e81a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:16.882644 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46538f34-2946-4dd8-b3b1-ddd5ccd1e81a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:16.889508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 475/942] 10.222.0.91 () {56 vars in 1122 bytes} [Wed Aug 24 10:26:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:16.896001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b7972-edfb-4cec-a07e-2758494c5f5c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:16.901263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d538a-25e2-4a36-b9e6-0f88ee6ef147 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:16.901470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d538a-25e2-4a36-b9e6-0f88ee6ef147 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:16.901664 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d538a-25e2-4a36-b9e6-0f88ee6ef147 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:16.903326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 476/943] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:16.908951 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ea44c-0797-4333-b6cf-e2b96b6f4fb0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:16.909263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ea44c-0797-4333-b6cf-e2b96b6f4fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:16.909512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ea44c-0797-4333-b6cf-e2b96b6f4fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:16.930284 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4c9ea44c-0797-4333-b6cf-e2b96b6f4fb0 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:16.931583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4c9ea44c-0797-4333-b6cf-e2b96b6f4fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:17.004877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 477/944] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:17.011919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b7972-edfb-4cec-a07e-2758494c5f5c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:17.048182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906ad0-6063-4b3c-a369-fc87e4ba5890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:17.049216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906ad0-6063-4b3c-a369-fc87e4ba5890 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:17.049691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906ad0-6063-4b3c-a369-fc87e4ba5890 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:17.050178 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906ad0-6063-4b3c-a369-fc87e4ba5890 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:17.051099 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906ad0-6063-4b3c-a369-fc87e4ba5890 None admin] RBAC: Adding query filter params (interface=public, service_id=06478e18fc224a00869a82c7134cf32a, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:17.051608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906ad0-6063-4b3c-a369-fc87e4ba5890 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:17.053238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906ad0-6063-4b3c-a369-fc87e4ba5890 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:17.063947 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 468/945] 10.222.0.91 () {56 vars in 1251 bytes} [Wed Aug 24 10:26:16 2022] GET /identity/v3/endpoints?service_id=06478e18fc224a00869a82c7134cf32a&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:17.065664 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ea44c-0797-4333-b6cf-e2b96b6f4fb0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:17.161546 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:17.175490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ea44c-0797-4333-b6cf-e2b96b6f4fb0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:17.214249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6912d23-73c5-4ee9-8061-7ace91d19a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:17.214914 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6912d23-73c5-4ee9-8061-7ace91d19a17 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:17.215200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6912d23-73c5-4ee9-8061-7ace91d19a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:17.215467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6912d23-73c5-4ee9-8061-7ace91d19a17 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:17.216125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6912d23-73c5-4ee9-8061-7ace91d19a17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:17.217518 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6912d23-73c5-4ee9-8061-7ace91d19a17 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:17.229768 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 478/946] 10.222.0.91 () {56 vars in 1087 bytes} [Wed Aug 24 10:26:17 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:26:17.298876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906ad0-6063-4b3c-a369-fc87e4ba5890 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:17.313549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:17.430588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906ad0-6063-4b3c-a369-fc87e4ba5890 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:17.466499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b3e16-86f0-47bb-903b-08a0c7ff7321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:17.467025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b3e16-86f0-47bb-903b-08a0c7ff7321 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:17.467300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b3e16-86f0-47bb-903b-08a0c7ff7321 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:17.467567 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b3e16-86f0-47bb-903b-08a0c7ff7321 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:17.468219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b3e16-86f0-47bb-903b-08a0c7ff7321 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:17.469799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b3e16-86f0-47bb-903b-08a0c7ff7321 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:17.472649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: WARNING keystone.server.flask.common [None req-230b3e16-86f0-47bb-903b-08a0c7ff7321 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 10:26:17.539694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.sql.core [None req-230b3e16-86f0-47bb-903b-08a0c7ff7321 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 10:26:17.539694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 10:26:17.539694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [parameters: {'id': 'fc43304cd9924098bfe02d47b0e14746', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 10:26:17.539694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81632) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-230b3e16-86f0-47bb-903b-08a0c7ff7321 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fc43304cd9924098bfe02d47b0e14746.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fc43304cd9924098bfe02d47b0e14746. Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:26:17.558062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result.read() Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 10:26:17.558964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application yield resource Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise self.value Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application session.commit() Aug 24 10:26:17.559979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.session.flush() Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application compat.raise_( Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 10:26:17.560876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 10:26:17.561806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result.read() Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:26:17.562625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [parameters: {'id': 'fc43304cd9924098bfe02d47b0e14746', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:17.563503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:17.566301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:17.568478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:17.568478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 10:26:17.568478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 10:26:17.568478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:17.568478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:17.568478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 10:26:17.568478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 10:26:17.568478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fc43304cd9924098bfe02d47b0e14746. Aug 24 10:26:17.568478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:17.568478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 469/947] 10.222.0.91 () {60 vars in 1140 bytes} [Wed Aug 24 10:26:17 2022] POST /identity/v3/projects => generated 262 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:17.577762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6912d23-73c5-4ee9-8061-7ace91d19a17 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:17.691910 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6912d23-73c5-4ee9-8061-7ace91d19a17 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:17.728745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413bf5-43bf-4f73-a3d1-851be6cbc90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:17.729294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413bf5-43bf-4f73-a3d1-851be6cbc90e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:17.729571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413bf5-43bf-4f73-a3d1-851be6cbc90e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:17.729846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413bf5-43bf-4f73-a3d1-851be6cbc90e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:17.736944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96413bf5-43bf-4f73-a3d1-851be6cbc90e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:17.738489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96413bf5-43bf-4f73-a3d1-851be6cbc90e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-96413bf5-43bf-4f73-a3d1-851be6cbc90e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:26:17.751213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:17.753364 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:17.755516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:26:17.755516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:26:17.755516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:26:17.755516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:26:17.755516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:26:17.755516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:26:17.755516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:17.755516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:17.755516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 479/948] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:17.763000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b3e16-86f0-47bb-903b-08a0c7ff7321 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:17.841227 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:17.878752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b3e16-86f0-47bb-903b-08a0c7ff7321 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:17.916405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f12b20-b759-48cb-b3c8-647aaf00e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:17.917021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12b20-b759-48cb-b3c8-647aaf00e8ca None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:17.917304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12b20-b759-48cb-b3c8-647aaf00e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:17.917578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12b20-b759-48cb-b3c8-647aaf00e8ca None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:17.918248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f12b20-b759-48cb-b3c8-647aaf00e8ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:17.918564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f12b20-b759-48cb-b3c8-647aaf00e8ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:17.920250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f12b20-b759-48cb-b3c8-647aaf00e8ca None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:17.941762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 470/949] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:26:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:18.099072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ba47d-4d1f-4d0a-920e-02f90f00a31b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:18.099266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ba47d-4d1f-4d0a-920e-02f90f00a31b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:18.099535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ba47d-4d1f-4d0a-920e-02f90f00a31b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:18.101846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 480/950] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:18.107843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3cdd8-189d-43ba-afb5-edc4d6bd6578 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:18.108153 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3cdd8-189d-43ba-afb5-edc4d6bd6578 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:18.108413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3cdd8-189d-43ba-afb5-edc4d6bd6578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:18.130563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-01c3cdd8-189d-43ba-afb5-edc4d6bd6578 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:18.132140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-01c3cdd8-189d-43ba-afb5-edc4d6bd6578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:18.157318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c6789-6b1b-40c2-be67-c96b9e146f79 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:18.157603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c6789-6b1b-40c2-be67-c96b9e146f79 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:18.157880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c6789-6b1b-40c2-be67-c96b9e146f79 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:18.159545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 481/951] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:18.165807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb0738-ea33-4a54-9101-9e40be497f4f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:18.166092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb0738-ea33-4a54-9101-9e40be497f4f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:18.166372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb0738-ea33-4a54-9101-9e40be497f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:18.189947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-39fb0738-ea33-4a54-9101-9e40be497f4f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:18.191155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-39fb0738-ea33-4a54-9101-9e40be497f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:18.201811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:18.216738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 471/952] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:18.271190 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 482/953] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:18.502312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3cdd8-189d-43ba-afb5-edc4d6bd6578 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:18.550186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb0738-ea33-4a54-9101-9e40be497f4f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:18.563390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:18.612861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3cdd8-189d-43ba-afb5-edc4d6bd6578 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:18.654852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc3dae-3762-43d7-8bdb-244099d38409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:18.655859 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc3dae-3762-43d7-8bdb-244099d38409 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:18.656141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc3dae-3762-43d7-8bdb-244099d38409 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:18.656413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc3dae-3762-43d7-8bdb-244099d38409 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:18.672861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc3dae-3762-43d7-8bdb-244099d38409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:26:18.682267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb0738-ea33-4a54-9101-9e40be497f4f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f6bc3dae-3762-43d7-8bdb-244099d38409 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:26:18.684110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:18.685322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:18.686219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 472/954] 10.222.0.91 () {56 vars in 1120 bytes} [Wed Aug 24 10:26:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:18.691886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc3dae-3762-43d7-8bdb-244099d38409 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:18.737857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e6c88-4922-44cb-a74c-088aa8852f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:18.738689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e6c88-4922-44cb-a74c-088aa8852f7f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:18.738968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e6c88-4922-44cb-a74c-088aa8852f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:18.739965 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e6c88-4922-44cb-a74c-088aa8852f7f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:18.740873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e6c88-4922-44cb-a74c-088aa8852f7f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:18.744516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e6c88-4922-44cb-a74c-088aa8852f7f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c00e6c88-4922-44cb-a74c-088aa8852f7f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:18.761820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:18.762928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:26:18.763830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:18.767788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 483/955] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:18.771125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e6c88-4922-44cb-a74c-088aa8852f7f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:18.785072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:18.844155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc3dae-3762-43d7-8bdb-244099d38409 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:18.866968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:18.887590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83a569-e112-465f-a572-9a88eb906ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:18.888308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83a569-e112-465f-a572-9a88eb906ffa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:18.888583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83a569-e112-465f-a572-9a88eb906ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:18.888850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83a569-e112-465f-a572-9a88eb906ffa None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:18.889518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83a569-e112-465f-a572-9a88eb906ffa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:18.889815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83a569-e112-465f-a572-9a88eb906ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:18.891195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83a569-e112-465f-a572-9a88eb906ffa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:18.902963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 473/956] 10.222.0.91 () {56 vars in 1115 bytes} [Wed Aug 24 10:26:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:18.908479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83a569-e112-465f-a572-9a88eb906ffa None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:18.914864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e6c88-4922-44cb-a74c-088aa8852f7f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:18.959230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f7aef-ce94-4d2b-a190-74d23809a8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:18.960153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f7aef-ce94-4d2b-a190-74d23809a8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:18.961205 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f7aef-ce94-4d2b-a190-74d23809a8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:18.961632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f7aef-ce94-4d2b-a190-74d23809a8c6 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:18.962428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f7aef-ce94-4d2b-a190-74d23809a8c6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:18.962882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f7aef-ce94-4d2b-a190-74d23809a8c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:18.964899 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f7aef-ce94-4d2b-a190-74d23809a8c6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:18.976654 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 484/957] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:26:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:18.977949 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f7aef-ce94-4d2b-a190-74d23809a8c6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:19.033135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83a569-e112-465f-a572-9a88eb906ffa None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:19.061227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:19.075246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114c9ce-9494-4f26-8be5-9ff756abed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:19.081701 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c9ce-9494-4f26-8be5-9ff756abed45 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:19.081701 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c9ce-9494-4f26-8be5-9ff756abed45 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:19.081701 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c9ce-9494-4f26-8be5-9ff756abed45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:19.089340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114c9ce-9494-4f26-8be5-9ff756abed45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:19.090968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114c9ce-9494-4f26-8be5-9ff756abed45 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:19.099885 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f7aef-ce94-4d2b-a190-74d23809a8c6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6114c9ce-9494-4f26-8be5-9ff756abed45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:19.108604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:19.109599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:19.110537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:19.110537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:19.110537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:19.114675 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 474/958] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:19.116236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114c9ce-9494-4f26-8be5-9ff756abed45 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:19.139014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8fe4e-c155-4c36-8b86-2edb07d4aa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:19.139930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8fe4e-c155-4c36-8b86-2edb07d4aa1f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:19.140215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8fe4e-c155-4c36-8b86-2edb07d4aa1f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:19.140488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8fe4e-c155-4c36-8b86-2edb07d4aa1f None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:19.141149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8fe4e-c155-4c36-8b86-2edb07d4aa1f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:19.141524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8fe4e-c155-4c36-8b86-2edb07d4aa1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:19.142936 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8fe4e-c155-4c36-8b86-2edb07d4aa1f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:19.156031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 485/959] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:26:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:19.156575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:19.238451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114c9ce-9494-4f26-8be5-9ff756abed45 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:19.279575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6322-d758-424b-96d3-71ed8643bca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:19.280169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de1a6b-72a4-4f78-9b73-33b9542a93ce None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:19.280312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6322-d758-424b-96d3-71ed8643bca7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:19.280450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de1a6b-72a4-4f78-9b73-33b9542a93ce None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:19.280548 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6322-d758-424b-96d3-71ed8643bca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:19.280722 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de1a6b-72a4-4f78-9b73-33b9542a93ce None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:19.280837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6322-d758-424b-96d3-71ed8643bca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:19.281393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a6322-d758-424b-96d3-71ed8643bca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:19.281696 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a6322-d758-424b-96d3-71ed8643bca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:19.283129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a6322-d758-424b-96d3-71ed8643bca7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:19.283542 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 486/960] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:26:19.288242 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbe3da-a667-41a8-bd5f-1e5098dbff2c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:19.289327 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbe3da-a667-41a8-bd5f-1e5098dbff2c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:19.289462 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbe3da-a667-41a8-bd5f-1e5098dbff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:19.297989 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 475/961] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:19.303748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6322-d758-424b-96d3-71ed8643bca7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:19.308697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-39cbe3da-a667-41a8-bd5f-1e5098dbff2c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:19.309883 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-39cbe3da-a667-41a8-bd5f-1e5098dbff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:19.401624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 487/962] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:19.423059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:19.434132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6322-d758-424b-96d3-71ed8643bca7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:19.473108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75bdd0-453e-49c7-9521-1b09bacd4126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:19.474074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75bdd0-453e-49c7-9521-1b09bacd4126 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:19.474515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75bdd0-453e-49c7-9521-1b09bacd4126 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:19.474934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75bdd0-453e-49c7-9521-1b09bacd4126 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:19.483113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75bdd0-453e-49c7-9521-1b09bacd4126 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:19.484825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75bdd0-453e-49c7-9521-1b09bacd4126 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5d75bdd0-453e-49c7-9521-1b09bacd4126 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:26:19.497985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:19.499229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:19.500590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:19.500590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:19.500590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:26:19.500590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:26:19.500590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:26:19.500590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:26:19.500590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:26:19.500590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:26:19.500590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:26:19.500590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:19.502967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 476/963] 10.222.0.91 () {56 vars in 1117 bytes} [Wed Aug 24 10:26:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:19.509881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbe3da-a667-41a8-bd5f-1e5098dbff2c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:19.579580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:19.620510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbe3da-a667-41a8-bd5f-1e5098dbff2c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:19.657799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5b981-c883-4db0-a9d4-b490e6a9aed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:19.658411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5b981-c883-4db0-a9d4-b490e6a9aed8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:19.658689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5b981-c883-4db0-a9d4-b490e6a9aed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:19.658961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5b981-c883-4db0-a9d4-b490e6a9aed8 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:19.659693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5b981-c883-4db0-a9d4-b490e6a9aed8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:19.660032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5b981-c883-4db0-a9d4-b490e6a9aed8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:19.661483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5b981-c883-4db0-a9d4-b490e6a9aed8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:19.680346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 488/964] 10.222.0.91 () {56 vars in 1149 bytes} [Wed Aug 24 10:26:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:19.686178 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75bdd0-453e-49c7-9521-1b09bacd4126 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:19.723091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5b981-c883-4db0-a9d4-b490e6a9aed8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:19.807976 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75bdd0-453e-49c7-9521-1b09bacd4126 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:19.846512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5b981-c883-4db0-a9d4-b490e6a9aed8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:19.848211 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2004a2-4d5b-4730-8f55-35b2456868dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:19.849002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2004a2-4d5b-4730-8f55-35b2456868dc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:19.849528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2004a2-4d5b-4730-8f55-35b2456868dc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:19.849984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2004a2-4d5b-4730-8f55-35b2456868dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:19.865027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:19.873046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:19.884120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c844-b0bd-4ff2-97c9-280681dd3a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:19.884629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c844-b0bd-4ff2-97c9-280681dd3a70 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:19.884988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c844-b0bd-4ff2-97c9-280681dd3a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:19.885338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c844-b0bd-4ff2-97c9-280681dd3a70 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:19.886250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c844-b0bd-4ff2-97c9-280681dd3a70 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:19.888971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c844-b0bd-4ff2-97c9-280681dd3a70 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a9a6c844-b0bd-4ff2-97c9-280681dd3a70 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:19.903328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:19.904525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:19.905411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:19.909892 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 489/965] 10.222.0.91 () {56 vars in 1126 bytes} [Wed Aug 24 10:26:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:26:19.911142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c844-b0bd-4ff2-97c9-280681dd3a70 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:19.933529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2004a2-4d5b-4730-8f55-35b2456868dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:19.935844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2004a2-4d5b-4730-8f55-35b2456868dc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:20.027521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c844-b0bd-4ff2-97c9-280681dd3a70 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:20.047981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 477/966] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:26:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:26:20.049719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2004a2-4d5b-4730-8f55-35b2456868dc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:20.066174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112701f-09c3-4a3e-bd48-d6dd8d05fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:20.067457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112701f-09c3-4a3e-bd48-d6dd8d05fde1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:20.067851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112701f-09c3-4a3e-bd48-d6dd8d05fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:20.068201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112701f-09c3-4a3e-bd48-d6dd8d05fde1 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:20.069055 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112701f-09c3-4a3e-bd48-d6dd8d05fde1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:20.069587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112701f-09c3-4a3e-bd48-d6dd8d05fde1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:20.071965 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112701f-09c3-4a3e-bd48-d6dd8d05fde1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:20.082825 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 490/967] 10.222.0.91 () {56 vars in 1122 bytes} [Wed Aug 24 10:26:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:20.084061 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112701f-09c3-4a3e-bd48-d6dd8d05fde1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:20.106902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:20.144130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:20.169711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2004a2-4d5b-4730-8f55-35b2456868dc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:20.204608 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112701f-09c3-4a3e-bd48-d6dd8d05fde1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:20.215054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c92ad1-4888-4346-8947-d4ea50a7c4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:20.215697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c92ad1-4888-4346-8947-d4ea50a7c4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:20.216024 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c92ad1-4888-4346-8947-d4ea50a7c4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:20.216291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c92ad1-4888-4346-8947-d4ea50a7c4b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:20.228298 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c92ad1-4888-4346-8947-d4ea50a7c4b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:20.229764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c92ad1-4888-4346-8947-d4ea50a7c4b0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-87c92ad1-4888-4346-8947-d4ea50a7c4b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:20.245070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:20.246091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:20.246999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:20.246999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:20.246999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:20.246999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 478/968] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:26:20.247519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58344f27-e408-41a6-8d2d-3e7018401726 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:20.247678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58344f27-e408-41a6-8d2d-3e7018401726 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:20.247977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58344f27-e408-41a6-8d2d-3e7018401726 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:20.249362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 479/969] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:20.252618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58344f27-e408-41a6-8d2d-3e7018401726 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:20.255161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe381e64-f03c-4ac0-bd03-f56072392410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:20.255813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe381e64-f03c-4ac0-bd03-f56072392410 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:20.256096 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe381e64-f03c-4ac0-bd03-f56072392410 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:20.256368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe381e64-f03c-4ac0-bd03-f56072392410 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:20.257004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe381e64-f03c-4ac0-bd03-f56072392410 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:20.257352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe381e64-f03c-4ac0-bd03-f56072392410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:20.258786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe381e64-f03c-4ac0-bd03-f56072392410 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:20.264537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 491/970] 10.222.0.91 () {56 vars in 1122 bytes} [Wed Aug 24 10:26:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:20.269393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4256-9584-491d-82f4-d6dc813b4289 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:20.269941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4256-9584-491d-82f4-d6dc813b4289 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:20.270218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4256-9584-491d-82f4-d6dc813b4289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:20.299209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1f1f4256-9584-491d-82f4-d6dc813b4289 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:20.300489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1f1f4256-9584-491d-82f4-d6dc813b4289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:20.386440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 492/971] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:20.386440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4256-9584-491d-82f4-d6dc813b4289 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:20.396145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58344f27-e408-41a6-8d2d-3e7018401726 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:20.398058 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:20.438678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:20.443037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69ad76-3221-4b4c-9625-694c23fc8fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:20.443667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ad76-3221-4b4c-9625-694c23fc8fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:20.444253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ad76-3221-4b4c-9625-694c23fc8fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:20.444526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ad76-3221-4b4c-9625-694c23fc8fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:20.445847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69ad76-3221-4b4c-9625-694c23fc8fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:20.446149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69ad76-3221-4b4c-9625-694c23fc8fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:20.447663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69ad76-3221-4b4c-9625-694c23fc8fc0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:20.461830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 480/972] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:20.467660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69ad76-3221-4b4c-9625-694c23fc8fc0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:20.512191 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4256-9584-491d-82f4-d6dc813b4289 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:20.559006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927d9d8-9a92-49d5-9ea5-36ae2e8431cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:20.559925 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927d9d8-9a92-49d5-9ea5-36ae2e8431cd None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:20.560205 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927d9d8-9a92-49d5-9ea5-36ae2e8431cd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:20.560476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927d9d8-9a92-49d5-9ea5-36ae2e8431cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:20.561305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927d9d8-9a92-49d5-9ea5-36ae2e8431cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:20.563487 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927d9d8-9a92-49d5-9ea5-36ae2e8431cd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:20.596755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69ad76-3221-4b4c-9625-694c23fc8fc0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:20.641698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fcaaf-386c-451b-a588-27455f59c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:20.642254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fcaaf-386c-451b-a588-27455f59c424 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:20.642536 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fcaaf-386c-451b-a588-27455f59c424 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:20.642840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fcaaf-386c-451b-a588-27455f59c424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:20.652004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fcaaf-386c-451b-a588-27455f59c424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:20.653556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fcaaf-386c-451b-a588-27455f59c424 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:20.671764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 493/973] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:26:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5f7fcaaf-386c-451b-a588-27455f59c424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:26:20.672050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:20.673214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:20.674139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:26:20.674139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:26:20.674139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:26:20.674139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:26:20.674139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:26:20.674139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:26:20.674139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:20.674139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:20.674139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 481/974] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:26:20.676818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fcaaf-386c-451b-a588-27455f59c424 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:20.683407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927d9d8-9a92-49d5-9ea5-36ae2e8431cd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:20.708101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:20.812240 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:20.823614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927d9d8-9a92-49d5-9ea5-36ae2e8431cd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:20.838282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fcaaf-386c-451b-a588-27455f59c424 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:20.873920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3bc47-9dd1-48a5-bfa6-cb6c7ca1b1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:20.874538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3bc47-9dd1-48a5-bfa6-cb6c7ca1b1a7 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:20.874812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3bc47-9dd1-48a5-bfa6-cb6c7ca1b1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:20.875466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3bc47-9dd1-48a5-bfa6-cb6c7ca1b1a7 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:20.876170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3bc47-9dd1-48a5-bfa6-cb6c7ca1b1a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:20.877807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3bc47-9dd1-48a5-bfa6-cb6c7ca1b1a7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:20.880397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: WARNING keystone.server.flask.common [None req-99a3bc47-9dd1-48a5-bfa6-cb6c7ca1b1a7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 10:26:20.884889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d97da-1c48-4485-beef-6dd0d8b7342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:20.887079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d97da-1c48-4485-beef-6dd0d8b7342d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:20.887079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d97da-1c48-4485-beef-6dd0d8b7342d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:20.887079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d97da-1c48-4485-beef-6dd0d8b7342d None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:20.887079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d97da-1c48-4485-beef-6dd0d8b7342d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:20.887381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d97da-1c48-4485-beef-6dd0d8b7342d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:20.888785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d97da-1c48-4485-beef-6dd0d8b7342d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:20.910085 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 482/975] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:26:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:20.911373 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d97da-1c48-4485-beef-6dd0d8b7342d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:20.928219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.sql.core [None req-99a3bc47-9dd1-48a5-bfa6-cb6c7ca1b1a7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 10:26:20.928219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 10:26:20.928219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [parameters: {'user_id': 'e9b97ef639f74fec8909ab9bba277511', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 10:26:20.928219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81633) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-99a3bc47-9dd1-48a5-bfa6-cb6c7ca1b1a7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result.read() Aug 24 10:26:20.935626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:26:20.937340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application yield resource Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise self.value Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application session.commit() Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 10:26:20.939281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.session.flush() Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application compat.raise_( Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 10:26:20.941296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:26:20.942891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result.read() Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:26:20.947021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e9b97ef639f74fec8909ab9bba277511', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:20.949311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 10:26:20.952762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 10:26:20.968417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 10:26:20.968417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 10:26:20.968417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 10:26:20.968417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 10:26:20.968417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 10:26:20.968417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:20.968417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 494/976] 10.222.0.91 () {60 vars in 1131 bytes} [Wed Aug 24 10:26:20 2022] POST /identity/v3/users => generated 160 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:26:20.968417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3bc47-9dd1-48a5-bfa6-cb6c7ca1b1a7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:21.051297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:21.074652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d97da-1c48-4485-beef-6dd0d8b7342d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:21.119940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3bc47-9dd1-48a5-bfa6-cb6c7ca1b1a7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:21.122369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af54407-3f35-4b05-b53a-fe7b949a65b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:21.122986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af54407-3f35-4b05-b53a-fe7b949a65b9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:21.123267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af54407-3f35-4b05-b53a-fe7b949a65b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:21.123559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af54407-3f35-4b05-b53a-fe7b949a65b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:21.124548 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af54407-3f35-4b05-b53a-fe7b949a65b9 None admin] RBAC: Adding query filter params (role.id=04a0de02c1844906ab3379298e71c6a4, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=1ed2c124184645adad2be9cd89c9e88b) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:21.124690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af54407-3f35-4b05-b53a-fe7b949a65b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:21.126071 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af54407-3f35-4b05-b53a-fe7b949a65b9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:21.133289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 483/977] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:26:20 2022] GET /identity/v3/role_assignments?user.id=1ed2c124184645adad2be9cd89c9e88b&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=04a0de02c1844906ab3379298e71c6a4 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:21.168259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707df7-7c43-46ce-bc95-df5f50a105ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:21.169171 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707df7-7c43-46ce-bc95-df5f50a105ec None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:21.169615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707df7-7c43-46ce-bc95-df5f50a105ec None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:21.170045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707df7-7c43-46ce-bc95-df5f50a105ec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:21.180221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707df7-7c43-46ce-bc95-df5f50a105ec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:21.182361 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707df7-7c43-46ce-bc95-df5f50a105ec None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ff707df7-7c43-46ce-bc95-df5f50a105ec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:26:21.195453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:21.196739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:21.197924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:21.197924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:21.197924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:26:21.197924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:26:21.197924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:26:21.197924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:26:21.197924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:26:21.197924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:26:21.197924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:26:21.197924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:21.198608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c192e97-fbdf-4507-a3a8-5f228fd36892 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:21.198845 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c192e97-fbdf-4507-a3a8-5f228fd36892 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:21.199297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c192e97-fbdf-4507-a3a8-5f228fd36892 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:21.200419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 495/978] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:26:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:21.203788 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 484/979] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:21.208024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707df7-7c43-46ce-bc95-df5f50a105ec None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:21.211392 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ae79-1ea5-4a4d-86d4-b2fe5729ae59 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:21.212134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ae79-1ea5-4a4d-86d4-b2fe5729ae59 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:21.212490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ae79-1ea5-4a4d-86d4-b2fe5729ae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:21.232593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:21.234610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5040ae79-1ea5-4a4d-86d4-b2fe5729ae59 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:21.236174 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5040ae79-1ea5-4a4d-86d4-b2fe5729ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:21.345202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 485/980] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:21.359648 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707df7-7c43-46ce-bc95-df5f50a105ec None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:21.404361 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0865b-e1c6-46f5-b7d2-ff411410a03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:21.405052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0865b-e1c6-46f5-b7d2-ff411410a03f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:21.405399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0865b-e1c6-46f5-b7d2-ff411410a03f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:21.405752 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0865b-e1c6-46f5-b7d2-ff411410a03f None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:21.406519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0865b-e1c6-46f5-b7d2-ff411410a03f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:21.406891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0865b-e1c6-46f5-b7d2-ff411410a03f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:21.408536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0865b-e1c6-46f5-b7d2-ff411410a03f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:21.449498 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 496/981] 10.222.0.91 () {56 vars in 1101 bytes} [Wed Aug 24 10:26:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:21.622854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ae79-1ea5-4a4d-86d4-b2fe5729ae59 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:21.708768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:21.733507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ae79-1ea5-4a4d-86d4-b2fe5729ae59 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:21.779922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676895bc-6b90-455b-ae03-d2bbff00b683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:21.780538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676895bc-6b90-455b-ae03-d2bbff00b683 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:21.780843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676895bc-6b90-455b-ae03-d2bbff00b683 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:21.781083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676895bc-6b90-455b-ae03-d2bbff00b683 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:21.781724 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676895bc-6b90-455b-ae03-d2bbff00b683 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:21.783084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676895bc-6b90-455b-ae03-d2bbff00b683 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:21.855763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 486/982] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:26:21 2022] POST /identity/v3/services => generated 242 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:26:22.779033 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8fd44-ebcf-4ce2-acfb-697d7b1bdef0 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:22.779551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8fd44-ebcf-4ce2-acfb-697d7b1bdef0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:22.779666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8fd44-ebcf-4ce2-acfb-697d7b1bdef0 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:22.781130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 497/983] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:22.786136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd5c9e-5d68-4c2c-bddf-8a6eb225164b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:22.786554 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd5c9e-5d68-4c2c-bddf-8a6eb225164b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:22.786739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd5c9e-5d68-4c2c-bddf-8a6eb225164b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:22.806336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-92dd5c9e-5d68-4c2c-bddf-8a6eb225164b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:22.807507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-92dd5c9e-5d68-4c2c-bddf-8a6eb225164b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:22.881411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 487/984] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:23.149200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8fd44-ebcf-4ce2-acfb-697d7b1bdef0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:23.224226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614a887-16e3-4676-a44a-98cc3d30b5b0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:23.224528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614a887-16e3-4676-a44a-98cc3d30b5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:23.224940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614a887-16e3-4676-a44a-98cc3d30b5b0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:23.227008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 488/985] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:26:23.230077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:23.233350 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e77c-fbec-49fb-b107-9eeb65ae8a63 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:23.233881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e77c-fbec-49fb-b107-9eeb65ae8a63 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:23.234348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e77c-fbec-49fb-b107-9eeb65ae8a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:23.253378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a070e77c-fbec-49fb-b107-9eeb65ae8a63 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:23.254867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a070e77c-fbec-49fb-b107-9eeb65ae8a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:23.256429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8fd44-ebcf-4ce2-acfb-697d7b1bdef0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:23.293157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b132994-f039-4c62-b5b9-7331a95cf2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:23.293795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b132994-f039-4c62-b5b9-7331a95cf2ab None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:23.294071 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b132994-f039-4c62-b5b9-7331a95cf2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:23.294344 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b132994-f039-4c62-b5b9-7331a95cf2ab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:23.294931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b132994-f039-4c62-b5b9-7331a95cf2ab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:23.296336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b132994-f039-4c62-b5b9-7331a95cf2ab None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-3b132994-f039-4c62-b5b9-7331a95cf2ab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:23.305687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:23.306715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:23.307564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 498/986] 10.222.0.91 () {56 vars in 1126 bytes} [Wed Aug 24 10:26:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:23.312745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b132994-f039-4c62-b5b9-7331a95cf2ab None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:23.324044 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:23.335029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 489/987] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:23.430663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b132994-f039-4c62-b5b9-7331a95cf2ab None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:23.465221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8297dea-ec15-4f03-bce9-1e7746da8c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:23.465828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8297dea-ec15-4f03-bce9-1e7746da8c90 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:23.466126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8297dea-ec15-4f03-bce9-1e7746da8c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:23.466398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8297dea-ec15-4f03-bce9-1e7746da8c90 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:23.467018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8297dea-ec15-4f03-bce9-1e7746da8c90 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:23.467319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8297dea-ec15-4f03-bce9-1e7746da8c90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:23.468713 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8297dea-ec15-4f03-bce9-1e7746da8c90 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:23.478817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 499/988] 10.222.0.91 () {56 vars in 1122 bytes} [Wed Aug 24 10:26:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:23.480311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070e77c-fbec-49fb-b107-9eeb65ae8a63 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:23.585700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070e77c-fbec-49fb-b107-9eeb65ae8a63 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:23.604766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8297dea-ec15-4f03-bce9-1e7746da8c90 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:23.609335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:23.622234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd4d70-69ef-4af6-ac8e-26f6dfbb85f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:23.622840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd4d70-69ef-4af6-ac8e-26f6dfbb85f6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:23.623117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd4d70-69ef-4af6-ac8e-26f6dfbb85f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:23.623388 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd4d70-69ef-4af6-ac8e-26f6dfbb85f6 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:23.626649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd4d70-69ef-4af6-ac8e-26f6dfbb85f6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:23.626649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd4d70-69ef-4af6-ac8e-26f6dfbb85f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:23.626649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd4d70-69ef-4af6-ac8e-26f6dfbb85f6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:23.631429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 490/989] 10.222.0.91 () {56 vars in 1122 bytes} [Wed Aug 24 10:26:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:23.637242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd4d70-69ef-4af6-ac8e-26f6dfbb85f6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:23.695822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:23.723119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8297dea-ec15-4f03-bce9-1e7746da8c90 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:23.746635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd4d70-69ef-4af6-ac8e-26f6dfbb85f6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:23.764148 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df80b7-13ef-42d3-b382-e4ac9ae58a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:23.764775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df80b7-13ef-42d3-b382-e4ac9ae58a61 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:23.765083 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df80b7-13ef-42d3-b382-e4ac9ae58a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:23.765353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df80b7-13ef-42d3-b382-e4ac9ae58a61 None admin] PATH_INFO: `/v3/services/image` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:23.765927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df80b7-13ef-42d3-b382-e4ac9ae58a61 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:23.767311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df80b7-13ef-42d3-b382-e4ac9ae58a61 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d9df80b7-13ef-42d3-b382-e4ac9ae58a61 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:23.777698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:23.778724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:23.780039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 500/990] 10.222.0.91 () {56 vars in 1105 bytes} [Wed Aug 24 10:26:23 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:26:23.784437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df80b7-13ef-42d3-b382-e4ac9ae58a61 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:23.786049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5fdee-494f-4674-a2a7-d7baebf47f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:23.786839 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5fdee-494f-4674-a2a7-d7baebf47f48 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:23.787666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5fdee-494f-4674-a2a7-d7baebf47f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:23.788107 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5fdee-494f-4674-a2a7-d7baebf47f48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:23.789983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5fdee-494f-4674-a2a7-d7baebf47f48 None admin] RBAC: Adding query filter params (interface=admin, service_id=06478e18fc224a00869a82c7134cf32a, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:23.790454 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5fdee-494f-4674-a2a7-d7baebf47f48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:23.791990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5fdee-494f-4674-a2a7-d7baebf47f48 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:23.797753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 491/991] 10.222.0.91 () {56 vars in 1249 bytes} [Wed Aug 24 10:26:23 2022] GET /identity/v3/endpoints?service_id=06478e18fc224a00869a82c7134cf32a&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:23.803013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5fdee-494f-4674-a2a7-d7baebf47f48 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:23.857695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:23.893535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df80b7-13ef-42d3-b382-e4ac9ae58a61 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:23.915393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5fdee-494f-4674-a2a7-d7baebf47f48 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:23.935747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24574358-ba05-4769-bd4d-13ea16728fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:23.936271 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:23.936408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574358-ba05-4769-bd4d-13ea16728fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:23.936629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574358-ba05-4769-bd4d-13ea16728fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:23.936899 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574358-ba05-4769-bd4d-13ea16728fa3 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:23.937526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24574358-ba05-4769-bd4d-13ea16728fa3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:23.937824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24574358-ba05-4769-bd4d-13ea16728fa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:23.939200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24574358-ba05-4769-bd4d-13ea16728fa3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:23.944228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 501/992] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:23.945760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119b167-b13c-4b7d-8f96-6262ef25b95b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:23.948956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119b167-b13c-4b7d-8f96-6262ef25b95b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:23.948956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119b167-b13c-4b7d-8f96-6262ef25b95b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:23.948956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 502/993] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:23.950472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119b167-b13c-4b7d-8f96-6262ef25b95b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:23.953371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c2e86-0f5d-4c06-9d9e-c34c7e1aef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:23.953982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c2e86-0f5d-4c06-9d9e-c34c7e1aef28 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:23.954258 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c2e86-0f5d-4c06-9d9e-c34c7e1aef28 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:23.954523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c2e86-0f5d-4c06-9d9e-c34c7e1aef28 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:23.955125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c2e86-0f5d-4c06-9d9e-c34c7e1aef28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:23.956516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c2e86-0f5d-4c06-9d9e-c34c7e1aef28 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:23.963863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 492/994] 10.222.0.91 () {56 vars in 1087 bytes} [Wed Aug 24 10:26:23 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:26:23.965011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcfc2f-bd83-415b-83e8-0bbba2d94f8d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:23.965285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcfc2f-bd83-415b-83e8-0bbba2d94f8d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:23.965561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcfc2f-bd83-415b-83e8-0bbba2d94f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:23.998168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-06fcfc2f-bd83-415b-83e8-0bbba2d94f8d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:23.999430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-06fcfc2f-bd83-415b-83e8-0bbba2d94f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:24.091298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119b167-b13c-4b7d-8f96-6262ef25b95b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:24.108764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 493/995] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:24.141359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:24.147313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d721a1-0385-4ccd-9356-a5b0c4940c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:24.148716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d721a1-0385-4ccd-9356-a5b0c4940c79 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:24.160541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d721a1-0385-4ccd-9356-a5b0c4940c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:24.160541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d721a1-0385-4ccd-9356-a5b0c4940c79 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:24.160541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d721a1-0385-4ccd-9356-a5b0c4940c79 None admin] RBAC: Adding query filter params (type=image) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:24.160541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d721a1-0385-4ccd-9356-a5b0c4940c79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:24.160541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d721a1-0385-4ccd-9356-a5b0c4940c79 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:24.160541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 503/996] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:24.385618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcfc2f-bd83-415b-83e8-0bbba2d94f8d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:24.506316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcfc2f-bd83-415b-83e8-0bbba2d94f8d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:24.524119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:24.553193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8f18f-19cd-4128-82fe-3e359207d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:24.553822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f18f-19cd-4128-82fe-3e359207d890 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:24.554202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f18f-19cd-4128-82fe-3e359207d890 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:24.554518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f18f-19cd-4128-82fe-3e359207d890 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:24.555432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8f18f-19cd-4128-82fe-3e359207d890 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:24.557270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8f18f-19cd-4128-82fe-3e359207d890 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6cd8f18f-19cd-4128-82fe-3e359207d890 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:24.567977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:24.569134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:26:24.570066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:24.571881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 494/997] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:24.577769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d721a1-0385-4ccd-9356-a5b0c4940c79 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:24.700109 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d721a1-0385-4ccd-9356-a5b0c4940c79 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:24.738108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245be27d-6b67-4268-8439-f9d2a8e4a245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:24.738717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245be27d-6b67-4268-8439-f9d2a8e4a245 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:24.738996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245be27d-6b67-4268-8439-f9d2a8e4a245 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:24.739265 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245be27d-6b67-4268-8439-f9d2a8e4a245 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:24.739918 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245be27d-6b67-4268-8439-f9d2a8e4a245 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:24.740219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245be27d-6b67-4268-8439-f9d2a8e4a245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:24.742241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245be27d-6b67-4268-8439-f9d2a8e4a245 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:24.752734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 504/998] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:26:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:24.754999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8f18f-19cd-4128-82fe-3e359207d890 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:24.878031 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8f18f-19cd-4128-82fe-3e359207d890 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:24.928106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c9e86-daa1-451e-b9bc-1e34a4ee5960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:24.928106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c9e86-daa1-451e-b9bc-1e34a4ee5960 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:24.928106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c9e86-daa1-451e-b9bc-1e34a4ee5960 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:24.928106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c9e86-daa1-451e-b9bc-1e34a4ee5960 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:24.928564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c9e86-daa1-451e-b9bc-1e34a4ee5960 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:24.928903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c9e86-daa1-451e-b9bc-1e34a4ee5960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:24.930492 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c9e86-daa1-451e-b9bc-1e34a4ee5960 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:24.936260 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 495/999] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:26:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:24.941954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245be27d-6b67-4268-8439-f9d2a8e4a245 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:25.012395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:25.059854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245be27d-6b67-4268-8439-f9d2a8e4a245 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:25.098314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5046b6-7a97-48b4-bed4-38debd5ddb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:25.098314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5046b6-7a97-48b4-bed4-38debd5ddb82 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:25.098704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5046b6-7a97-48b4-bed4-38debd5ddb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:25.098977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5046b6-7a97-48b4-bed4-38debd5ddb82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:25.099579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5046b6-7a97-48b4-bed4-38debd5ddb82 None admin] RBAC: Adding query filter params (interface=public, service_id=10a65e9c65a546f79112242927d1c048, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:25.099921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5046b6-7a97-48b4-bed4-38debd5ddb82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:25.101418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5046b6-7a97-48b4-bed4-38debd5ddb82 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:25.111823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 505/1000] 10.222.0.91 () {56 vars in 1251 bytes} [Wed Aug 24 10:26:24 2022] GET /identity/v3/endpoints?service_id=10a65e9c65a546f79112242927d1c048&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:25.113526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c9e86-daa1-451e-b9bc-1e34a4ee5960 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:25.164622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:25.232295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c9e86-daa1-451e-b9bc-1e34a4ee5960 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:25.277859 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e094544-16ad-4655-a56e-3be3c3f460c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:25.278396 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e094544-16ad-4655-a56e-3be3c3f460c2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:25.278672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e094544-16ad-4655-a56e-3be3c3f460c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:25.278940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e094544-16ad-4655-a56e-3be3c3f460c2 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:25.279850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e094544-16ad-4655-a56e-3be3c3f460c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:25.280947 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e094544-16ad-4655-a56e-3be3c3f460c2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:25.287850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 496/1001] 10.222.0.91 () {56 vars in 1087 bytes} [Wed Aug 24 10:26:25 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:26:26.050249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95adbd-733f-4a53-99c9-016bd1934e05 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:26.050805 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95adbd-733f-4a53-99c9-016bd1934e05 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:26.050805 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95adbd-733f-4a53-99c9-016bd1934e05 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:26.052402 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 506/1002] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:26.058265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc76d55-beb5-4e1f-8e76-9bbb4cfb0220 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:26.058730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc76d55-beb5-4e1f-8e76-9bbb4cfb0220 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:26.058904 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc76d55-beb5-4e1f-8e76-9bbb4cfb0220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:26.078467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-efc76d55-beb5-4e1f-8e76-9bbb4cfb0220 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:26.079644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-efc76d55-beb5-4e1f-8e76-9bbb4cfb0220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:26.155906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 497/1003] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:26.250040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc00c0-a349-4ca8-a743-ac083d726878 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:26.250375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc00c0-a349-4ca8-a743-ac083d726878 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:26.250594 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc00c0-a349-4ca8-a743-ac083d726878 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:26.252115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 507/1004] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:26.258054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4e317-1a11-4e63-ab14-601e66f1e88c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:26.258416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4e317-1a11-4e63-ab14-601e66f1e88c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:26.258675 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4e317-1a11-4e63-ab14-601e66f1e88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:26.278301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1cb4e317-1a11-4e63-ab14-601e66f1e88c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:26.279526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1cb4e317-1a11-4e63-ab14-601e66f1e88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:26.310556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:26.356417 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 498/1005] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:26.430697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc00c0-a349-4ca8-a743-ac083d726878 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:26.569490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc00c0-a349-4ca8-a743-ac083d726878 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:26.596351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:26.608580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71433b2-5415-4b76-900f-f5ea771d2f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:26.612666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71433b2-5415-4b76-900f-f5ea771d2f12 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:26.612666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71433b2-5415-4b76-900f-f5ea771d2f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:26.612666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71433b2-5415-4b76-900f-f5ea771d2f12 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:26.612666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71433b2-5415-4b76-900f-f5ea771d2f12 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:26.612666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71433b2-5415-4b76-900f-f5ea771d2f12 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e71433b2-5415-4b76-900f-f5ea771d2f12 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:26.622645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:26.623700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:26.625300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 508/1006] 10.222.0.91 () {56 vars in 1126 bytes} [Wed Aug 24 10:26:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:26.630127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4e317-1a11-4e63-ab14-601e66f1e88c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:26.635305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71433b2-5415-4b76-900f-f5ea771d2f12 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:26.757030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71433b2-5415-4b76-900f-f5ea771d2f12 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:26.757261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4e317-1a11-4e63-ab14-601e66f1e88c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:26.795513 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a436a8-374e-41cf-bfce-6c42ab85e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:26.796252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a436a8-374e-41cf-bfce-6c42ab85e15c None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:26.796533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a436a8-374e-41cf-bfce-6c42ab85e15c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:26.796805 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a436a8-374e-41cf-bfce-6c42ab85e15c None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:26.797370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbfc4d-fb7b-4381-a204-7e897c4888bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:26.797498 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a436a8-374e-41cf-bfce-6c42ab85e15c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:26.797975 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbfc4d-fb7b-4381-a204-7e897c4888bd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:26.798254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbfc4d-fb7b-4381-a204-7e897c4888bd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:26.798524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbfc4d-fb7b-4381-a204-7e897c4888bd None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:26.798803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a436a8-374e-41cf-bfce-6c42ab85e15c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:26.799155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbfc4d-fb7b-4381-a204-7e897c4888bd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:26.799453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbfc4d-fb7b-4381-a204-7e897c4888bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:26.800843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbfc4d-fb7b-4381-a204-7e897c4888bd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:26.807295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 499/1007] 10.222.0.91 () {56 vars in 1122 bytes} [Wed Aug 24 10:26:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:26.813244 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbfc4d-fb7b-4381-a204-7e897c4888bd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:26.845648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:26.889832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 509/1008] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:26:26 2022] POST /identity/v3/services => generated 242 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:26:26.928187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbfc4d-fb7b-4381-a204-7e897c4888bd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:26.975906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea8855-d9b9-40c5-a164-f0035bf03ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:26.976543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea8855-d9b9-40c5-a164-f0035bf03ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:26.976818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea8855-d9b9-40c5-a164-f0035bf03ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:26.977090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea8855-d9b9-40c5-a164-f0035bf03ef5 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:26.977866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea8855-d9b9-40c5-a164-f0035bf03ef5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:26.978171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea8855-d9b9-40c5-a164-f0035bf03ef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:26.979569 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea8855-d9b9-40c5-a164-f0035bf03ef5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:26.985458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 500/1009] 10.222.0.91 () {56 vars in 1122 bytes} [Wed Aug 24 10:26:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:26.991873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a436a8-374e-41cf-bfce-6c42ab85e15c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:27.050940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:27.107696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a436a8-374e-41cf-bfce-6c42ab85e15c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:27.143279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04cd60-d627-40e1-916e-1123bc7008e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:27.143919 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04cd60-d627-40e1-916e-1123bc7008e5 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:27.144205 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04cd60-d627-40e1-916e-1123bc7008e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:27.144732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04cd60-d627-40e1-916e-1123bc7008e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:27.145407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04cd60-d627-40e1-916e-1123bc7008e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:27.146788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04cd60-d627-40e1-916e-1123bc7008e5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:27.221611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 510/1010] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:26:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:26:27.246888 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20933538-95c7-4e57-a553-cd19994edc40 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:27.247456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20933538-95c7-4e57-a553-cd19994edc40 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:27.247456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20933538-95c7-4e57-a553-cd19994edc40 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:27.249094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 501/1011] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:27.254886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439d60c-a024-4e7b-9e23-c2466825d86e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:27.255260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439d60c-a024-4e7b-9e23-c2466825d86e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:27.255476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439d60c-a024-4e7b-9e23-c2466825d86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:27.282627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2439d60c-a024-4e7b-9e23-c2466825d86e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:27.284233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2439d60c-a024-4e7b-9e23-c2466825d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:27.380249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 511/1012] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:27 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:27.651816 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20933538-95c7-4e57-a553-cd19994edc40 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:27.757775 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:27.768846 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20933538-95c7-4e57-a553-cd19994edc40 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:27.804711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447416cc-28d8-47c2-8571-1c165db2f6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:27.805368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447416cc-28d8-47c2-8571-1c165db2f6fa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:27.805639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447416cc-28d8-47c2-8571-1c165db2f6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:27.805904 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447416cc-28d8-47c2-8571-1c165db2f6fa None admin] PATH_INFO: `/v3/services/compute` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:27.806481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447416cc-28d8-47c2-8571-1c165db2f6fa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:27.807863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447416cc-28d8-47c2-8571-1c165db2f6fa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-447416cc-28d8-47c2-8571-1c165db2f6fa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:27.817173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:27.818290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:27.819203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 502/1013] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:27.827330 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439d60c-a024-4e7b-9e23-c2466825d86e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:27.864384 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:27.937258 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439d60c-a024-4e7b-9e23-c2466825d86e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:27.977911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709f635-666d-44b8-8123-5f684481c8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:27.978527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709f635-666d-44b8-8123-5f684481c8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:27.978800 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709f635-666d-44b8-8123-5f684481c8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:27.979070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709f635-666d-44b8-8123-5f684481c8e2 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:27.979702 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709f635-666d-44b8-8123-5f684481c8e2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:27.980026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709f635-666d-44b8-8123-5f684481c8e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:27.981394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709f635-666d-44b8-8123-5f684481c8e2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:27.992147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 512/1014] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:26:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:27.993965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447416cc-28d8-47c2-8571-1c165db2f6fa None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:28.116958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447416cc-28d8-47c2-8571-1c165db2f6fa None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:28.154474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be077a6-b04b-4f0d-bbff-5509b2ba0754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:28.155415 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be077a6-b04b-4f0d-bbff-5509b2ba0754 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:28.155909 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be077a6-b04b-4f0d-bbff-5509b2ba0754 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:28.156384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be077a6-b04b-4f0d-bbff-5509b2ba0754 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:28.157204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be077a6-b04b-4f0d-bbff-5509b2ba0754 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:28.157685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be077a6-b04b-4f0d-bbff-5509b2ba0754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:28.159223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be077a6-b04b-4f0d-bbff-5509b2ba0754 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:28.165107 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 503/1015] 10.222.0.91 () {56 vars in 1112 bytes} [Wed Aug 24 10:26:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:28.170931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709f635-666d-44b8-8123-5f684481c8e2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:28.298547 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:28.302660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709f635-666d-44b8-8123-5f684481c8e2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:28.347070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913db5e5-180e-47bb-9744-0199597f73b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:28.348234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913db5e5-180e-47bb-9744-0199597f73b1 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:28.348234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913db5e5-180e-47bb-9744-0199597f73b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:28.348234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913db5e5-180e-47bb-9744-0199597f73b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:28.348902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913db5e5-180e-47bb-9744-0199597f73b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:28.350273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913db5e5-180e-47bb-9744-0199597f73b1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:28.463760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 513/1016] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:26:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:26:28.906816 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c40b50-7568-4264-8c6c-1b2306fb03e3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:28.907379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c40b50-7568-4264-8c6c-1b2306fb03e3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:28.907379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c40b50-7568-4264-8c6c-1b2306fb03e3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:28.908945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 504/1017] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:28.915150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d81e7-ee14-4be9-9d9a-4f17e26b49d6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:28.915519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d81e7-ee14-4be9-9d9a-4f17e26b49d6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:28.915856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d81e7-ee14-4be9-9d9a-4f17e26b49d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:28.934045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ef5d81e7-ee14-4be9-9d9a-4f17e26b49d6 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:28.935225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ef5d81e7-ee14-4be9-9d9a-4f17e26b49d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:29.014226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 514/1018] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:29.235292 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8f1df-08c7-4abd-bba2-886bce92c6e2 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:29.235693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8f1df-08c7-4abd-bba2-886bce92c6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:29.235901 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8f1df-08c7-4abd-bba2-886bce92c6e2 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:29.237390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 505/1019] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:29.243399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e0dbf-93ae-4ad2-97bd-28d97b4cf658 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:29.243894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e0dbf-93ae-4ad2-97bd-28d97b4cf658 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:29.244346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e0dbf-93ae-4ad2-97bd-28d97b4cf658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:29.263770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ed4e0dbf-93ae-4ad2-97bd-28d97b4cf658 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:29.265035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ed4e0dbf-93ae-4ad2-97bd-28d97b4cf658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:29.291091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8f1df-08c7-4abd-bba2-886bce92c6e2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:29.318096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:29.341368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 515/1020] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:29.424313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8f1df-08c7-4abd-bba2-886bce92c6e2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:29.470907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c9624-15a7-4e4b-85ff-972eecc839a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:29.471542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c9624-15a7-4e4b-85ff-972eecc839a2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:29.471860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c9624-15a7-4e4b-85ff-972eecc839a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:29.472130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c9624-15a7-4e4b-85ff-972eecc839a2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:29.472713 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c9624-15a7-4e4b-85ff-972eecc839a2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:29.474196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c9624-15a7-4e4b-85ff-972eecc839a2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-fc9c9624-15a7-4e4b-85ff-972eecc839a2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:29.485491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:29.486616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:29.488438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 506/1021] 10.222.0.91 () {56 vars in 1105 bytes} [Wed Aug 24 10:26:29 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:29.493520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e0dbf-93ae-4ad2-97bd-28d97b4cf658 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:29.506757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:29.623526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c9624-15a7-4e4b-85ff-972eecc839a2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:29.626681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e0dbf-93ae-4ad2-97bd-28d97b4cf658 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:29.665450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec377d-09c5-4ab8-a8f3-b918024faee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:29.666061 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec377d-09c5-4ab8-a8f3-b918024faee7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:29.666339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec377d-09c5-4ab8-a8f3-b918024faee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:29.666612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec377d-09c5-4ab8-a8f3-b918024faee7 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:29.667247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec377d-09c5-4ab8-a8f3-b918024faee7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:29.667547 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec377d-09c5-4ab8-a8f3-b918024faee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:29.668963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec377d-09c5-4ab8-a8f3-b918024faee7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:29.675749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 516/1022] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:29.681060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec377d-09c5-4ab8-a8f3-b918024faee7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:29.726104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:29.746728 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c9624-15a7-4e4b-85ff-972eecc839a2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:29.763433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:29.784060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6954f-7a95-46d9-aea5-06c53528c73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:29.784826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6954f-7a95-46d9-aea5-06c53528c73d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:29.785106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6954f-7a95-46d9-aea5-06c53528c73d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:29.785378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6954f-7a95-46d9-aea5-06c53528c73d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:29.786677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6954f-7a95-46d9-aea5-06c53528c73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:29.788886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6954f-7a95-46d9-aea5-06c53528c73d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:29.790292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec377d-09c5-4ab8-a8f3-b918024faee7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:29.795819 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 507/1023] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:29.797131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6954f-7a95-46d9-aea5-06c53528c73d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:29.829761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5ed23-2be7-4910-a10b-f0ad4bf752b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:29.830363 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5ed23-2be7-4910-a10b-f0ad4bf752b7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:29.830645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5ed23-2be7-4910-a10b-f0ad4bf752b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:29.838428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5ed23-2be7-4910-a10b-f0ad4bf752b7 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:29.838428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5ed23-2be7-4910-a10b-f0ad4bf752b7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:29.838428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5ed23-2be7-4910-a10b-f0ad4bf752b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:29.838428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5ed23-2be7-4910-a10b-f0ad4bf752b7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:29.839830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 517/1024] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:29.847533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5ed23-2be7-4910-a10b-f0ad4bf752b7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:29.914292 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6954f-7a95-46d9-aea5-06c53528c73d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:29.954211 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b06b1d-e133-4a7d-9c18-9a31b90645f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:29.954830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06b1d-e133-4a7d-9c18-9a31b90645f9 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:29.955109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06b1d-e133-4a7d-9c18-9a31b90645f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:29.955380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06b1d-e133-4a7d-9c18-9a31b90645f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:29.956059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b06b1d-e133-4a7d-9c18-9a31b90645f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:29.957499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b06b1d-e133-4a7d-9c18-9a31b90645f9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:29.968918 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5ed23-2be7-4910-a10b-f0ad4bf752b7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:30.011270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203b1e1-c016-4f34-9111-af5f70b29ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:30.011270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203b1e1-c016-4f34-9111-af5f70b29ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:30.011270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203b1e1-c016-4f34-9111-af5f70b29ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:30.011270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203b1e1-c016-4f34-9111-af5f70b29ac1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:30.011810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203b1e1-c016-4f34-9111-af5f70b29ac1 None admin] RBAC: Adding query filter params (interface=public, service_id=78a2baf61bcf426ea35c890c70b6fa10, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:30.011810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203b1e1-c016-4f34-9111-af5f70b29ac1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:30.012483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203b1e1-c016-4f34-9111-af5f70b29ac1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:30.017672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 518/1025] 10.222.0.91 () {56 vars in 1251 bytes} [Wed Aug 24 10:26:29 2022] GET /identity/v3/endpoints?service_id=78a2baf61bcf426ea35c890c70b6fa10&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:30.023900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203b1e1-c016-4f34-9111-af5f70b29ac1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:30.026680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:30.083744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 508/1026] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:26:29 2022] POST /identity/v3/projects => generated 311 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:26:30.152052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203b1e1-c016-4f34-9111-af5f70b29ac1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:30.203656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035272f-7da2-4bf5-a626-d953211995ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:30.204317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035272f-7da2-4bf5-a626-d953211995ae None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:30.204605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035272f-7da2-4bf5-a626-d953211995ae None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:30.204923 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035272f-7da2-4bf5-a626-d953211995ae None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:30.205498 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035272f-7da2-4bf5-a626-d953211995ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:30.206902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035272f-7da2-4bf5-a626-d953211995ae None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:30.220333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 519/1027] 10.222.0.91 () {56 vars in 1087 bytes} [Wed Aug 24 10:26:30 2022] GET /identity/v3/services => generated 1957 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:26:30.495221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40e86e-163d-4863-9563-cfa0fa07a258 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:30.495549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40e86e-163d-4863-9563-cfa0fa07a258 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:30.495786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40e86e-163d-4863-9563-cfa0fa07a258 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:30.497308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 509/1028] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:30.502609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f93939-74d8-4433-82aa-afb903ec6c7a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:30.503081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f93939-74d8-4433-82aa-afb903ec6c7a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:30.503159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f93939-74d8-4433-82aa-afb903ec6c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:30.522198 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d1f93939-74d8-4433-82aa-afb903ec6c7a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:30.523421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d1f93939-74d8-4433-82aa-afb903ec6c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:30.587709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:30.596561 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 520/1029] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:30.865404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40e86e-163d-4863-9563-cfa0fa07a258 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:30.869268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:30.985397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40e86e-163d-4863-9563-cfa0fa07a258 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:31.023181 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272070bb-ed2e-4966-b4e0-4e5b9e934f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:31.024006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272070bb-ed2e-4966-b4e0-4e5b9e934f5a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:31.024282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272070bb-ed2e-4966-b4e0-4e5b9e934f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:31.024553 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272070bb-ed2e-4966-b4e0-4e5b9e934f5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:31.034927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272070bb-ed2e-4966-b4e0-4e5b9e934f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-272070bb-ed2e-4966-b4e0-4e5b9e934f5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:26:31.040324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:31.041447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:31.042341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 510/1030] 10.222.0.91 () {56 vars in 1120 bytes} [Wed Aug 24 10:26:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:31.047636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f93939-74d8-4433-82aa-afb903ec6c7a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:31.159701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f93939-74d8-4433-82aa-afb903ec6c7a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:31.193516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9c169-efb0-421c-9ac2-49c740f4ceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:31.196968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9c169-efb0-421c-9ac2-49c740f4ceac None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:31.196968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9c169-efb0-421c-9ac2-49c740f4ceac None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:31.196968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9c169-efb0-421c-9ac2-49c740f4ceac None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:31.196968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9c169-efb0-421c-9ac2-49c740f4ceac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:31.196968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9c169-efb0-421c-9ac2-49c740f4ceac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:31.197726 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9c169-efb0-421c-9ac2-49c740f4ceac None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:31.206859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 521/1031] 10.222.0.91 () {56 vars in 1115 bytes} [Wed Aug 24 10:26:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:31.213003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272070bb-ed2e-4966-b4e0-4e5b9e934f5a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:31.291341 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:31.351036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272070bb-ed2e-4966-b4e0-4e5b9e934f5a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:31.397201 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db65e-b446-4833-bda9-3e438b44b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:31.398365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db65e-b446-4833-bda9-3e438b44b013 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:31.398820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db65e-b446-4833-bda9-3e438b44b013 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:31.399239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db65e-b446-4833-bda9-3e438b44b013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:31.414486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9db65e-b446-4833-bda9-3e438b44b013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:31.417438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9db65e-b446-4833-bda9-3e438b44b013 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-aa9db65e-b446-4833-bda9-3e438b44b013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:31.434276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:31.435368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:31.436316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:31.436316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:31.436316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:31.436492 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 511/1032] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:31.442532 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9c169-efb0-421c-9ac2-49c740f4ceac None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:31.516272 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:31.558963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9c169-efb0-421c-9ac2-49c740f4ceac None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:31.594240 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837454f-f10e-4c29-9336-db3d53c54bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:31.594850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837454f-f10e-4c29-9336-db3d53c54bde None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:31.595126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837454f-f10e-4c29-9336-db3d53c54bde None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:31.595396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837454f-f10e-4c29-9336-db3d53c54bde None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:31.596072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837454f-f10e-4c29-9336-db3d53c54bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:31.596370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837454f-f10e-4c29-9336-db3d53c54bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:31.597742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837454f-f10e-4c29-9336-db3d53c54bde None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:31.611595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 522/1033] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:31.618204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db65e-b446-4833-bda9-3e438b44b013 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:31.739500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db65e-b446-4833-bda9-3e438b44b013 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:31.757671 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:31.782063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c6725-e8d6-4776-90af-3fda7c0b7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:31.782701 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c6725-e8d6-4776-90af-3fda7c0b7bba None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:31.783015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c6725-e8d6-4776-90af-3fda7c0b7bba None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:31.783253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c6725-e8d6-4776-90af-3fda7c0b7bba None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:31.793047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c6725-e8d6-4776-90af-3fda7c0b7bba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:31.794501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c6725-e8d6-4776-90af-3fda7c0b7bba None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-537c6725-e8d6-4776-90af-3fda7c0b7bba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:26:31.808087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:31.809127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:31.814753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:31.814753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:31.814753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:26:31.814753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:26:31.814753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:26:31.814753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:26:31.814753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:26:31.814753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:26:31.814753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:26:31.814753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:31.814753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 512/1034] 10.222.0.91 () {56 vars in 1093 bytes} [Wed Aug 24 10:26:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:31.816867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837454f-f10e-4c29-9336-db3d53c54bde None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:31.925735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837454f-f10e-4c29-9336-db3d53c54bde None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:31.945070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:31.962269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11194eb-04f4-4a1e-b444-b1eeaebc431f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:31.962831 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11194eb-04f4-4a1e-b444-b1eeaebc431f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:31.963102 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11194eb-04f4-4a1e-b444-b1eeaebc431f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:31.963366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11194eb-04f4-4a1e-b444-b1eeaebc431f None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:31.964106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11194eb-04f4-4a1e-b444-b1eeaebc431f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:31.964405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11194eb-04f4-4a1e-b444-b1eeaebc431f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:31.965810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11194eb-04f4-4a1e-b444-b1eeaebc431f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:31.984424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 523/1035] 10.222.0.91 () {56 vars in 1133 bytes} [Wed Aug 24 10:26:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:31.990102 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c6725-e8d6-4776-90af-3fda7c0b7bba None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:32.102221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c6725-e8d6-4776-90af-3fda7c0b7bba None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:32.105153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5b1cb-90ef-42fb-aa5f-8f148d828d28 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:32.105693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5b1cb-90ef-42fb-aa5f-8f148d828d28 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:32.105977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5b1cb-90ef-42fb-aa5f-8f148d828d28 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:32.107336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 524/1036] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:32.112786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432677e4-d42b-4bc8-8367-2c05f06d6097 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:32.113070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432677e4-d42b-4bc8-8367-2c05f06d6097 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:32.113339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432677e4-d42b-4bc8-8367-2c05f06d6097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:32.133197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-432677e4-d42b-4bc8-8367-2c05f06d6097 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:32.134422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-432677e4-d42b-4bc8-8367-2c05f06d6097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:32.143229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa367d-7a09-48bf-a7a8-a0b8f092c445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:32.143880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa367d-7a09-48bf-a7a8-a0b8f092c445 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:32.144188 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa367d-7a09-48bf-a7a8-a0b8f092c445 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:32.145067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa367d-7a09-48bf-a7a8-a0b8f092c445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:32.192167 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:32.204169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 525/1037] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:32.209478 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41af68-56cb-4b53-add1-b6ee17356313 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:32.209478 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41af68-56cb-4b53-add1-b6ee17356313 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:32.209478 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41af68-56cb-4b53-add1-b6ee17356313 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:32.209478 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 526/1038] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:32.213372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fbd70-b004-4dc5-bb40-54e51269698f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:32.213652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fbd70-b004-4dc5-bb40-54e51269698f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:32.213927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fbd70-b004-4dc5-bb40-54e51269698f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:32.223580 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa367d-7a09-48bf-a7a8-a0b8f092c445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:32.225165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa367d-7a09-48bf-a7a8-a0b8f092c445 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:32.237671 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3c0fbd70-b004-4dc5-bb40-54e51269698f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:32.238857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3c0fbd70-b004-4dc5-bb40-54e51269698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:32.313191 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 527/1039] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:32.341192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 513/1040] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:26:31 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:26:32.349009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fbd70-b004-4dc5-bb40-54e51269698f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:32.386911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:32.456942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fbd70-b004-4dc5-bb40-54e51269698f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:32.471934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa367d-7a09-48bf-a7a8-a0b8f092c445 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:32.494251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8b20b-d6bb-4eca-8a8c-9440b2bb809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:32.494879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8b20b-d6bb-4eca-8a8c-9440b2bb809f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:32.495152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8b20b-d6bb-4eca-8a8c-9440b2bb809f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:32.495420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8b20b-d6bb-4eca-8a8c-9440b2bb809f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:32.505898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8b20b-d6bb-4eca-8a8c-9440b2bb809f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:32.508166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8b20b-d6bb-4eca-8a8c-9440b2bb809f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-9bb8b20b-d6bb-4eca-8a8c-9440b2bb809f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:32.524704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:32.526329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:32.527256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:32.527256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:32.527256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:32.527256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 528/1041] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:32.531418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8b20b-d6bb-4eca-8a8c-9440b2bb809f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:32.563431 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:32.589512 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa367d-7a09-48bf-a7a8-a0b8f092c445 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:32.625844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01feb976-d7f5-48fd-b25d-599ecb01d706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:32.626461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01feb976-d7f5-48fd-b25d-599ecb01d706 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:32.626743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01feb976-d7f5-48fd-b25d-599ecb01d706 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:32.627007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01feb976-d7f5-48fd-b25d-599ecb01d706 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:32.627131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:32.628119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01feb976-d7f5-48fd-b25d-599ecb01d706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:32.629540 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01feb976-d7f5-48fd-b25d-599ecb01d706 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:32.631118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 514/1042] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:32.632389 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01feb976-d7f5-48fd-b25d-599ecb01d706 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:32.640376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8b20b-d6bb-4eca-8a8c-9440b2bb809f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:32.676161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fd0a1-3663-4038-9223-58f601f46269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:32.676760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fd0a1-3663-4038-9223-58f601f46269 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:32.677031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fd0a1-3663-4038-9223-58f601f46269 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:32.677297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fd0a1-3663-4038-9223-58f601f46269 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:32.677929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fd0a1-3663-4038-9223-58f601f46269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:32.678226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fd0a1-3663-4038-9223-58f601f46269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:32.680027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fd0a1-3663-4038-9223-58f601f46269 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:32.692383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 529/1043] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:32.693293 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fd0a1-3663-4038-9223-58f601f46269 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:32.740168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01feb976-d7f5-48fd-b25d-599ecb01d706 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:32.775927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899d270-4b51-405c-96d6-901e4f535d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:32.776640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899d270-4b51-405c-96d6-901e4f535d52 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:32.777215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899d270-4b51-405c-96d6-901e4f535d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:32.777215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899d270-4b51-405c-96d6-901e4f535d52 None admin] PATH_INFO: `/v3/services/image` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:32.777676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899d270-4b51-405c-96d6-901e4f535d52 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:32.779055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899d270-4b51-405c-96d6-901e4f535d52 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8899d270-4b51-405c-96d6-901e4f535d52 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:32.787915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:32.789182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:32.790255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 515/1044] 10.222.0.91 () {56 vars in 1105 bytes} [Wed Aug 24 10:26:32 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:32.791777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899d270-4b51-405c-96d6-901e4f535d52 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:32.798650 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:32.802539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fd0a1-3663-4038-9223-58f601f46269 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:32.838917 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea54d8f-3300-4834-866d-af3d2a264cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:32.839433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea54d8f-3300-4834-866d-af3d2a264cd6 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:32.839705 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea54d8f-3300-4834-866d-af3d2a264cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:32.839992 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea54d8f-3300-4834-866d-af3d2a264cd6 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:32.840630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea54d8f-3300-4834-866d-af3d2a264cd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:32.842047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea54d8f-3300-4834-866d-af3d2a264cd6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:32.893117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899d270-4b51-405c-96d6-901e4f535d52 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:32.930280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa7895-61f3-4474-a827-a8f1dfcf672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:32.930897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa7895-61f3-4474-a827-a8f1dfcf672e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:32.931189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa7895-61f3-4474-a827-a8f1dfcf672e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:32.931487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa7895-61f3-4474-a827-a8f1dfcf672e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:32.938325 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa7895-61f3-4474-a827-a8f1dfcf672e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:32.939781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa7895-61f3-4474-a827-a8f1dfcf672e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5bfa7895-61f3-4474-a827-a8f1dfcf672e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:26:32.952620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:32.953731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:32.954725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:26:32.954725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:26:32.954725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:26:32.954725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:26:32.954725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:26:32.954725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:26:32.954725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:32.954725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:32.954725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 516/1045] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:32.954725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa7895-61f3-4474-a827-a8f1dfcf672e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:32.963519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 530/1046] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:26:32 2022] POST /identity/v3/users => generated 285 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:26:32.965265 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea54d8f-3300-4834-866d-af3d2a264cd6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:32.978049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:33.046793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:33.089065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa7895-61f3-4474-a827-a8f1dfcf672e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:33.108125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea54d8f-3300-4834-866d-af3d2a264cd6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:33.136583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e681-3493-4132-b745-e88a17d20ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:33.137194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e681-3493-4132-b745-e88a17d20ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:33.137577 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e681-3493-4132-b745-e88a17d20ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:33.137844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e681-3493-4132-b745-e88a17d20ed5 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:33.138574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17e681-3493-4132-b745-e88a17d20ed5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:33.138871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17e681-3493-4132-b745-e88a17d20ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:33.140278 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17e681-3493-4132-b745-e88a17d20ed5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:33.145794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 517/1047] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:33.147818 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911620a-26a9-4428-b3fd-f470a675530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:33.148511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911620a-26a9-4428-b3fd-f470a675530c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:33.148783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911620a-26a9-4428-b3fd-f470a675530c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:33.149469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911620a-26a9-4428-b3fd-f470a675530c None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:33.149800 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911620a-26a9-4428-b3fd-f470a675530c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:33.150134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911620a-26a9-4428-b3fd-f470a675530c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:33.151584 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911620a-26a9-4428-b3fd-f470a675530c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:33.152321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e681-3493-4132-b745-e88a17d20ed5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:33.165573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 531/1048] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:26:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:33.172367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911620a-26a9-4428-b3fd-f470a675530c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:33.245687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:33.265814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e681-3493-4132-b745-e88a17d20ed5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:33.290067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911620a-26a9-4428-b3fd-f470a675530c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:33.300814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:33.308775 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f915c4-4078-4587-8a5d-1a030c1cf7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:33.309474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f915c4-4078-4587-8a5d-1a030c1cf7cf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:33.309939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f915c4-4078-4587-8a5d-1a030c1cf7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:33.310138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f915c4-4078-4587-8a5d-1a030c1cf7cf None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:33.310776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f915c4-4078-4587-8a5d-1a030c1cf7cf None admin] RBAC: Adding query filter params (type=image) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:33.311067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f915c4-4078-4587-8a5d-1a030c1cf7cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:33.312470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f915c4-4078-4587-8a5d-1a030c1cf7cf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:33.322842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 518/1049] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:33.324549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f915c4-4078-4587-8a5d-1a030c1cf7cf None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:33.331651 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6a725-41a6-4659-b3e2-c737525f746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:33.332307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6a725-41a6-4659-b3e2-c737525f746b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:33.332584 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6a725-41a6-4659-b3e2-c737525f746b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:33.332854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6a725-41a6-4659-b3e2-c737525f746b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:33.333581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6a725-41a6-4659-b3e2-c737525f746b None admin] RBAC: Adding query filter params (role.id=04a0de02c1844906ab3379298e71c6a4, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=4ae21e13a4414168bd1741dfd642274a) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:33.333886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6a725-41a6-4659-b3e2-c737525f746b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:33.335624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6a725-41a6-4659-b3e2-c737525f746b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:33.355836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 532/1050] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:26:33 2022] GET /identity/v3/role_assignments?user.id=4ae21e13a4414168bd1741dfd642274a&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=04a0de02c1844906ab3379298e71c6a4 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:33.468862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f915c4-4078-4587-8a5d-1a030c1cf7cf None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:33.508244 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641d55e-b5a8-4e05-a045-92c3392a7c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:33.508872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d55e-b5a8-4e05-a045-92c3392a7c3f None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:33.509152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d55e-b5a8-4e05-a045-92c3392a7c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:33.509423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d55e-b5a8-4e05-a045-92c3392a7c3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:33.510085 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641d55e-b5a8-4e05-a045-92c3392a7c3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:33.511603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641d55e-b5a8-4e05-a045-92c3392a7c3f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:33.592491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 519/1051] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:26:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:26:34.949038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b861f-1a13-4d5f-9493-0c9d364db777 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:34.949558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b861f-1a13-4d5f-9493-0c9d364db777 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:34.949558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b861f-1a13-4d5f-9493-0c9d364db777 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:34.951088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 533/1052] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:34.956376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07302f10-6f49-4f58-9aa2-c908ba3a6335 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:34.956854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07302f10-6f49-4f58-9aa2-c908ba3a6335 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:34.956931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07302f10-6f49-4f58-9aa2-c908ba3a6335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:34.976171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-07302f10-6f49-4f58-9aa2-c908ba3a6335 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:34.976171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-07302f10-6f49-4f58-9aa2-c908ba3a6335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:35.041801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:35.071356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 520/1053] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:35.295477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a1dae-3cdc-4146-8291-e5bbd861ad13 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:35.295838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a1dae-3cdc-4146-8291-e5bbd861ad13 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:35.295997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a1dae-3cdc-4146-8291-e5bbd861ad13 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:35.297579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 534/1054] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:35.302729 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07694a5-5729-40ce-9d28-7be9ed41cffb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:35.303019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07694a5-5729-40ce-9d28-7be9ed41cffb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:35.303290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07694a5-5729-40ce-9d28-7be9ed41cffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:35.322945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e07694a5-5729-40ce-9d28-7be9ed41cffb None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:35.324166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e07694a5-5729-40ce-9d28-7be9ed41cffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:35.339386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a1dae-3cdc-4146-8291-e5bbd861ad13 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:35.408417 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 521/1055] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:35.456860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a1dae-3cdc-4146-8291-e5bbd861ad13 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:35.488298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:35.498441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c329c30-9b8d-4a25-b618-ed0af9bcff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:35.499164 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329c30-9b8d-4a25-b618-ed0af9bcff38 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:35.499559 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329c30-9b8d-4a25-b618-ed0af9bcff38 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:35.500068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329c30-9b8d-4a25-b618-ed0af9bcff38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:35.511748 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c329c30-9b8d-4a25-b618-ed0af9bcff38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7c329c30-9b8d-4a25-b618-ed0af9bcff38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:26:35.516369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:35.517307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:35.519632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:35.519632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:35.519632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:35.519632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:35.519632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:26:35.519632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:26:35.519632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:26:35.519632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:26:35.519632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:26:35.519632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:26:35.519632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:26:35.519632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:35.522845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 535/1056] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:26:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:26:35.523705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07694a5-5729-40ce-9d28-7be9ed41cffb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:35.560588 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0711d1-9fae-42dc-869b-ce5a08bee67e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:35.561360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0711d1-9fae-42dc-869b-ce5a08bee67e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:35.561648 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0711d1-9fae-42dc-869b-ce5a08bee67e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:35.563151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 536/1057] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:26:35.568143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6220009-f592-4fc1-8748-0d41274ad6d3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:35.568432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6220009-f592-4fc1-8748-0d41274ad6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:35.568705 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6220009-f592-4fc1-8748-0d41274ad6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:35.587670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e6220009-f592-4fc1-8748-0d41274ad6d3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:35.588920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e6220009-f592-4fc1-8748-0d41274ad6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:35.640859 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07694a5-5729-40ce-9d28-7be9ed41cffb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:35.649379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:35.668494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 537/1058] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:35.678357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8e251-ccfd-4ad9-95d1-ca7527dcabeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:35.679982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8e251-ccfd-4ad9-95d1-ca7527dcabeb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:35.680682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8e251-ccfd-4ad9-95d1-ca7527dcabeb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:35.681829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6220009-f592-4fc1-8748-0d41274ad6d3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:35.682241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8e251-ccfd-4ad9-95d1-ca7527dcabeb None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:35.683763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8e251-ccfd-4ad9-95d1-ca7527dcabeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:35.683763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8e251-ccfd-4ad9-95d1-ca7527dcabeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:35.685631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8e251-ccfd-4ad9-95d1-ca7527dcabeb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:35.696542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 522/1059] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:26:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:35.702344 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8e251-ccfd-4ad9-95d1-ca7527dcabeb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:35.793949 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6220009-f592-4fc1-8748-0d41274ad6d3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:35.816855 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:35.824366 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8e251-ccfd-4ad9-95d1-ca7527dcabeb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:35.838455 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b9e03-5b09-4128-b3e0-30d6145313e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:35.839108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b9e03-5b09-4128-b3e0-30d6145313e5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:35.839386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b9e03-5b09-4128-b3e0-30d6145313e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:35.839660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b9e03-5b09-4128-b3e0-30d6145313e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:35.851441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b9e03-5b09-4128-b3e0-30d6145313e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-278b9e03-5b09-4128-b3e0-30d6145313e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:26:35.857091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:35.858263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:35.859379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 538/1060] 10.222.0.91 () {56 vars in 1120 bytes} [Wed Aug 24 10:26:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:26:35.864822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b9e03-5b09-4128-b3e0-30d6145313e5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:35.865248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a73331-15cf-4d48-b324-774ce5134fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:35.866037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a73331-15cf-4d48-b324-774ce5134fef None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:35.866467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a73331-15cf-4d48-b324-774ce5134fef None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:35.868419 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a73331-15cf-4d48-b324-774ce5134fef None admin] PATH_INFO: `/v3/users/1429247f888a449f9d4ce08b4c0e1a2e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:35.890447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a73331-15cf-4d48-b324-774ce5134fef None admin] RBAC: Authorizing `identity:get_user(user_id=1429247f888a449f9d4ce08b4c0e1a2e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:35.891941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a73331-15cf-4d48-b324-774ce5134fef None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:35.893735 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 523/1061] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:26:35 2022] GET /identity/v3/users/1429247f888a449f9d4ce08b4c0e1a2e => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:35.900505 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a73331-15cf-4d48-b324-774ce5134fef None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:35.936980 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:35.991030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b9e03-5b09-4128-b3e0-30d6145313e5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:36.012200 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a73331-15cf-4d48-b324-774ce5134fef None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:36.026203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793a534-731a-415f-8eeb-0b9174157782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:36.026808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a534-731a-415f-8eeb-0b9174157782 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:36.027107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a534-731a-415f-8eeb-0b9174157782 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:36.027362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a534-731a-415f-8eeb-0b9174157782 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:36.028050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793a534-731a-415f-8eeb-0b9174157782 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:36.028356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793a534-731a-415f-8eeb-0b9174157782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:36.029772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793a534-731a-415f-8eeb-0b9174157782 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:36.037665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 539/1062] 10.222.0.91 () {56 vars in 1115 bytes} [Wed Aug 24 10:26:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:36.038564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793a534-731a-415f-8eeb-0b9174157782 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:36.051190 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03d157-b8e2-4cd9-94fc-aad0807a925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:36.052030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03d157-b8e2-4cd9-94fc-aad0807a925f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:36.052329 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03d157-b8e2-4cd9-94fc-aad0807a925f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:36.052598 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03d157-b8e2-4cd9-94fc-aad0807a925f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:36.083303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:36.125372 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03d157-b8e2-4cd9-94fc-aad0807a925f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:36.126878 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03d157-b8e2-4cd9-94fc-aad0807a925f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:36.144545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793a534-731a-415f-8eeb-0b9174157782 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:36.155050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:36.182295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809c486-cffe-4bbe-80ad-eb9a7d6eedda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:36.182900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809c486-cffe-4bbe-80ad-eb9a7d6eedda None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:36.183178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809c486-cffe-4bbe-80ad-eb9a7d6eedda None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:36.183442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809c486-cffe-4bbe-80ad-eb9a7d6eedda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:36.231845 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 524/1063] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:26:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:26:36.232699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03d157-b8e2-4cd9-94fc-aad0807a925f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:36.317642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809c486-cffe-4bbe-80ad-eb9a7d6eedda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:36.319211 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809c486-cffe-4bbe-80ad-eb9a7d6eedda None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:36.363901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:36.384528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03d157-b8e2-4cd9-94fc-aad0807a925f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:36.410500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:36.422194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa28b4-7507-4799-95f2-10294d388866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:36.422906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa28b4-7507-4799-95f2-10294d388866 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:36.424251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa28b4-7507-4799-95f2-10294d388866 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:36.424251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa28b4-7507-4799-95f2-10294d388866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:36.425276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 540/1064] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:26:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:26:36.426128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809c486-cffe-4bbe-80ad-eb9a7d6eedda None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:36.436000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa28b4-7507-4799-95f2-10294d388866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:36.439150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa28b4-7507-4799-95f2-10294d388866 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b9fa28b4-7507-4799-95f2-10294d388866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:36.456050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:36.457184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:36.463296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:36.463296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:36.463296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:36.463296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 525/1065] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:36.463296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa28b4-7507-4799-95f2-10294d388866 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:36.539849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809c486-cffe-4bbe-80ad-eb9a7d6eedda None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:36.564105 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa28b4-7507-4799-95f2-10294d388866 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:36.575437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea7850-748a-4950-b645-612c78357fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:36.576101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea7850-748a-4950-b645-612c78357fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:36.576384 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea7850-748a-4950-b645-612c78357fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:36.576658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea7850-748a-4950-b645-612c78357fd1 None admin] PATH_INFO: `/v3/projects/4c6d440496fa49a2b97c1bf589af35a0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:36.577777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea7850-748a-4950-b645-612c78357fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=4c6d440496fa49a2b97c1bf589af35a0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:36.579206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea7850-748a-4950-b645-612c78357fd1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:36.580871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 541/1066] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:26:36 2022] GET /identity/v3/projects/4c6d440496fa49a2b97c1bf589af35a0 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:36.581663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea7850-748a-4950-b645-612c78357fd1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:36.597717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:36.605708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d93960-aad6-4980-9505-dc8e07fbdf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:36.606400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d93960-aad6-4980-9505-dc8e07fbdf19 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:36.606684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d93960-aad6-4980-9505-dc8e07fbdf19 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:36.606953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d93960-aad6-4980-9505-dc8e07fbdf19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:36.618251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d93960-aad6-4980-9505-dc8e07fbdf19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:36.621101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d93960-aad6-4980-9505-dc8e07fbdf19 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d5d93960-aad6-4980-9505-dc8e07fbdf19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:36.634757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:36.639853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:36.641119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:36.641119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:36.641119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:36.641119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 526/1067] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:36.641119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d93960-aad6-4980-9505-dc8e07fbdf19 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:36.671910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:36.699738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea7850-748a-4950-b645-612c78357fd1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:36.740221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e596f-d6b6-49d2-81da-4c7711e1a3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:36.740957 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e596f-d6b6-49d2-81da-4c7711e1a3bb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:36.741241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e596f-d6b6-49d2-81da-4c7711e1a3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:36.741550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e596f-d6b6-49d2-81da-4c7711e1a3bb None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:36.742210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e596f-d6b6-49d2-81da-4c7711e1a3bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:36.742512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e596f-d6b6-49d2-81da-4c7711e1a3bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:36.742662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d93960-aad6-4980-9505-dc8e07fbdf19 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:36.743934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e596f-d6b6-49d2-81da-4c7711e1a3bb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:36.755814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 542/1068] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:36.756780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e596f-d6b6-49d2-81da-4c7711e1a3bb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:36.778875 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee4261-dd47-4426-9fb8-3b8cf7b85aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:36.779469 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee4261-dd47-4426-9fb8-3b8cf7b85aaf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:36.779760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee4261-dd47-4426-9fb8-3b8cf7b85aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:36.780027 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee4261-dd47-4426-9fb8-3b8cf7b85aaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:36.780737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee4261-dd47-4426-9fb8-3b8cf7b85aaf None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=4c6d440496fa49a2b97c1bf589af35a0, user.id=1429247f888a449f9d4ce08b4c0e1a2e) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:36.781035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee4261-dd47-4426-9fb8-3b8cf7b85aaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:36.782436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee4261-dd47-4426-9fb8-3b8cf7b85aaf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:36.788807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 527/1069] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:26:36 2022] GET /identity/v3/role_assignments?user.id=1429247f888a449f9d4ce08b4c0e1a2e&scope.project.id=4c6d440496fa49a2b97c1bf589af35a0&role.id=60abeefc9ac84e31a0162ac559220669 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:36.789664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee4261-dd47-4426-9fb8-3b8cf7b85aaf None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:36.850421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:36.895243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e596f-d6b6-49d2-81da-4c7711e1a3bb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:36.915313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:36.922928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee4261-dd47-4426-9fb8-3b8cf7b85aaf None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:36.946270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12ea62-bc84-4123-84b0-616e26091602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:36.946881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12ea62-bc84-4123-84b0-616e26091602 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:36.947159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12ea62-bc84-4123-84b0-616e26091602 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:36.947429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12ea62-bc84-4123-84b0-616e26091602 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:36.948180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12ea62-bc84-4123-84b0-616e26091602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:36.948483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12ea62-bc84-4123-84b0-616e26091602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:36.949858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12ea62-bc84-4123-84b0-616e26091602 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:36.963880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 543/1070] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:36.974139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6bc69-b80a-46b5-b0cc-979fc69bbcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:36.974807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6bc69-b80a-46b5-b0cc-979fc69bbcfb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:36.975094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6bc69-b80a-46b5-b0cc-979fc69bbcfb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:36.975427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6bc69-b80a-46b5-b0cc-979fc69bbcfb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:36.984837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6bc69-b80a-46b5-b0cc-979fc69bbcfb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:36.986332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6bc69-b80a-46b5-b0cc-979fc69bbcfb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b9d6bc69-b80a-46b5-b0cc-979fc69bbcfb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:26:37.000171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:37.001279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:37.002253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:37.002253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:37.002253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:26:37.002253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:26:37.002253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:26:37.002253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:26:37.002253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:26:37.002253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:26:37.002253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:26:37.002253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:37.002253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 528/1071] 10.222.0.91 () {56 vars in 1093 bytes} [Wed Aug 24 10:26:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:37.008267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12ea62-bc84-4123-84b0-616e26091602 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:37.130770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12ea62-bc84-4123-84b0-616e26091602 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:37.162298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:37.170873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759857-7b18-438d-b9af-5e824fdb3406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:37.173433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759857-7b18-438d-b9af-5e824fdb3406 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:37.173433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759857-7b18-438d-b9af-5e824fdb3406 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:37.173433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759857-7b18-438d-b9af-5e824fdb3406 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:37.173433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73759857-7b18-438d-b9af-5e824fdb3406 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:37.173433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73759857-7b18-438d-b9af-5e824fdb3406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:37.174649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73759857-7b18-438d-b9af-5e824fdb3406 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:37.203760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 544/1072] 10.222.0.91 () {56 vars in 1133 bytes} [Wed Aug 24 10:26:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:37.205821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6bc69-b80a-46b5-b0cc-979fc69bbcfb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:37.315181 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6bc69-b80a-46b5-b0cc-979fc69bbcfb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:37.349713 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c156aa-2eff-4ba4-9389-7938a08becbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:37.350344 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c156aa-2eff-4ba4-9389-7938a08becbe None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:37.350623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c156aa-2eff-4ba4-9389-7938a08becbe None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:37.350907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c156aa-2eff-4ba4-9389-7938a08becbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:37.362647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c156aa-2eff-4ba4-9389-7938a08becbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:37.364177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c156aa-2eff-4ba4-9389-7938a08becbe None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a3c156aa-2eff-4ba4-9389-7938a08becbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:37.379180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:37.380216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:37.381163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:37.381163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:37.381163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:37.381163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 529/1073] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:37.386968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759857-7b18-438d-b9af-5e824fdb3406 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:37.487693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759857-7b18-438d-b9af-5e824fdb3406 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:37.524033 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c0efa-f187-44cd-93ef-46293d872ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:37.524633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c0efa-f187-44cd-93ef-46293d872ecf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:37.524905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c0efa-f187-44cd-93ef-46293d872ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:37.525172 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c0efa-f187-44cd-93ef-46293d872ecf None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:37.525802 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c0efa-f187-44cd-93ef-46293d872ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:37.526096 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c0efa-f187-44cd-93ef-46293d872ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:37.527453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c0efa-f187-44cd-93ef-46293d872ecf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:37.539044 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 545/1074] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:37.544762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c156aa-2eff-4ba4-9389-7938a08becbe None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:37.554712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:37.650522 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c156aa-2eff-4ba4-9389-7938a08becbe None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:37.687410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a64719-0cf5-4ec2-bc01-abba2443a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:37.688067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a64719-0cf5-4ec2-bc01-abba2443a242 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:37.688348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a64719-0cf5-4ec2-bc01-abba2443a242 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:37.688619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a64719-0cf5-4ec2-bc01-abba2443a242 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:37.695869 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a64719-0cf5-4ec2-bc01-abba2443a242 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:37.697327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a64719-0cf5-4ec2-bc01-abba2443a242 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-83a64719-0cf5-4ec2-bc01-abba2443a242 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:26:37.708907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:37.710074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:37.711122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:26:37.711122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:26:37.711122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:26:37.711122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:26:37.711122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:26:37.711122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:26:37.711122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:37.711122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:37.711122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 530/1075] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:37.717260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c0efa-f187-44cd-93ef-46293d872ecf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:37.766046 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:37.827931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c0efa-f187-44cd-93ef-46293d872ecf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:37.863379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f507667-24a3-43fb-b691-6bae29ade718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:37.864013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f507667-24a3-43fb-b691-6bae29ade718 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:37.864290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f507667-24a3-43fb-b691-6bae29ade718 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:37.864559 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f507667-24a3-43fb-b691-6bae29ade718 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:37.865245 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f507667-24a3-43fb-b691-6bae29ade718 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:37.865573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f507667-24a3-43fb-b691-6bae29ade718 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:37.867753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f507667-24a3-43fb-b691-6bae29ade718 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:37.880311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 546/1076] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:37.887221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a64719-0cf5-4ec2-bc01-abba2443a242 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:37.955347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:37.990457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a64719-0cf5-4ec2-bc01-abba2443a242 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:38.028095 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20e54a-1b6c-4d80-a851-ce1274aa22b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:38.028746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20e54a-1b6c-4d80-a851-ce1274aa22b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:38.029025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20e54a-1b6c-4d80-a851-ce1274aa22b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:38.029299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20e54a-1b6c-4d80-a851-ce1274aa22b4 None admin] PATH_INFO: `/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/4ae21e13a4414168bd1741dfd642274a/roles/04a0de02c1844906ab3379298e71c6a4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:38.031510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20e54a-1b6c-4d80-a851-ce1274aa22b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=acd807f8a28d43cdac159fa3d606af60, user_id=4ae21e13a4414168bd1741dfd642274a, role_id=04a0de02c1844906ab3379298e71c6a4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:38.033021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20e54a-1b6c-4d80-a851-ce1274aa22b4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:38.117380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 531/1077] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:26:37 2022] PUT /identity/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/4ae21e13a4414168bd1741dfd642274a/roles/04a0de02c1844906ab3379298e71c6a4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:26:38.758070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e192f0-3453-405c-8f6b-9c1645355c84 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:38.758605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e192f0-3453-405c-8f6b-9c1645355c84 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:38.758605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e192f0-3453-405c-8f6b-9c1645355c84 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:38.760198 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 547/1078] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:38.765486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf56e50-9bd2-469b-9d16-b1e1e3dc13b4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:38.765951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf56e50-9bd2-469b-9d16-b1e1e3dc13b4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:38.766144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf56e50-9bd2-469b-9d16-b1e1e3dc13b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:38.786952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-aaf56e50-9bd2-469b-9d16-b1e1e3dc13b4 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:38.788471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-aaf56e50-9bd2-469b-9d16-b1e1e3dc13b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:38.857830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 532/1079] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:39.131990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e192f0-3453-405c-8f6b-9c1645355c84 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:39.241896 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e192f0-3453-405c-8f6b-9c1645355c84 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:39.249587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:39.278192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528586af-1f1c-458d-a0c9-ac8ab7ce2847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:39.278818 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528586af-1f1c-458d-a0c9-ac8ab7ce2847 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:39.279122 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528586af-1f1c-458d-a0c9-ac8ab7ce2847 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:39.279391 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528586af-1f1c-458d-a0c9-ac8ab7ce2847 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:39.291018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528586af-1f1c-458d-a0c9-ac8ab7ce2847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-528586af-1f1c-458d-a0c9-ac8ab7ce2847 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:26:39.295794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:39.296867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:39.297704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 548/1080] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:26:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:39.303046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf56e50-9bd2-469b-9d16-b1e1e3dc13b4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:39.364516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:39.415552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf56e50-9bd2-469b-9d16-b1e1e3dc13b4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:39.454200 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a09fc4-3ca5-4ed3-9208-490889699254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:39.454812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a09fc4-3ca5-4ed3-9208-490889699254 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:39.455081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a09fc4-3ca5-4ed3-9208-490889699254 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:39.455346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a09fc4-3ca5-4ed3-9208-490889699254 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:39.456039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a09fc4-3ca5-4ed3-9208-490889699254 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:39.456334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a09fc4-3ca5-4ed3-9208-490889699254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:39.457692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a09fc4-3ca5-4ed3-9208-490889699254 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:39.466973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 533/1081] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:26:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:39.472915 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528586af-1f1c-458d-a0c9-ac8ab7ce2847 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:39.584307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528586af-1f1c-458d-a0c9-ac8ab7ce2847 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:39.626652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd35cc-f56d-4ac6-a711-91fa2ab5b29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:39.627353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd35cc-f56d-4ac6-a711-91fa2ab5b29c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:39.627663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd35cc-f56d-4ac6-a711-91fa2ab5b29c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:39.627947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd35cc-f56d-4ac6-a711-91fa2ab5b29c None admin] PATH_INFO: `/v3/users/1429247f888a449f9d4ce08b4c0e1a2e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:39.629097 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd35cc-f56d-4ac6-a711-91fa2ab5b29c None admin] RBAC: Authorizing `identity:get_user(user_id=1429247f888a449f9d4ce08b4c0e1a2e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:39.630535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd35cc-f56d-4ac6-a711-91fa2ab5b29c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:39.632664 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 549/1082] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:26:39 2022] GET /identity/v3/users/1429247f888a449f9d4ce08b4c0e1a2e => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:39.638517 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a09fc4-3ca5-4ed3-9208-490889699254 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:39.747218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a09fc4-3ca5-4ed3-9208-490889699254 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:39.766458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:39.783969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32387ea5-3677-4231-aa2d-c984b83f0da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:39.785208 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32387ea5-3677-4231-aa2d-c984b83f0da2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:39.785208 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32387ea5-3677-4231-aa2d-c984b83f0da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:39.785208 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32387ea5-3677-4231-aa2d-c984b83f0da2 None admin] PATH_INFO: `/v3/projects/4c6d440496fa49a2b97c1bf589af35a0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:39.786752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32387ea5-3677-4231-aa2d-c984b83f0da2 None admin] RBAC: Authorizing `identity:get_project(project_id=4c6d440496fa49a2b97c1bf589af35a0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:39.789207 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32387ea5-3677-4231-aa2d-c984b83f0da2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:39.790992 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 534/1083] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:26:39 2022] GET /identity/v3/projects/4c6d440496fa49a2b97c1bf589af35a0 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:39.796965 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd35cc-f56d-4ac6-a711-91fa2ab5b29c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:39.833685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:39.906512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd35cc-f56d-4ac6-a711-91fa2ab5b29c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:39.940963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0c617-3fa2-4cc6-8a6b-adc16a3ec8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:39.941625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0c617-3fa2-4cc6-8a6b-adc16a3ec8e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:39.941898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0c617-3fa2-4cc6-8a6b-adc16a3ec8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:39.942159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0c617-3fa2-4cc6-8a6b-adc16a3ec8e3 None admin] PATH_INFO: `/v3/projects/4c6d440496fa49a2b97c1bf589af35a0/users/1429247f888a449f9d4ce08b4c0e1a2e/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:39.944640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0c617-3fa2-4cc6-8a6b-adc16a3ec8e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c6d440496fa49a2b97c1bf589af35a0, user_id=1429247f888a449f9d4ce08b4c0e1a2e, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:39.946524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0c617-3fa2-4cc6-8a6b-adc16a3ec8e3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:40.021642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 550/1084] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:26:39 2022] PUT /identity/v3/projects/4c6d440496fa49a2b97c1bf589af35a0/users/1429247f888a449f9d4ce08b4c0e1a2e/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:26:40.056713 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86e8fb-980e-4e68-a1ed-8bd796c56705 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:40.056999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86e8fb-980e-4e68-a1ed-8bd796c56705 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:40.057272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86e8fb-980e-4e68-a1ed-8bd796c56705 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:40.058872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 535/1085] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:40.064794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc1792-d1dd-4317-bd59-48815cb20e21 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:40.065077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc1792-d1dd-4317-bd59-48815cb20e21 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:40.065334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc1792-d1dd-4317-bd59-48815cb20e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:40.086072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b1bc1792-d1dd-4317-bd59-48815cb20e21 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:40.087570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b1bc1792-d1dd-4317-bd59-48815cb20e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:40.173074 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 551/1086] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:40.450124 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86e8fb-980e-4e68-a1ed-8bd796c56705 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:40.620546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86e8fb-980e-4e68-a1ed-8bd796c56705 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:40.677449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e913d-8a08-4967-916f-4b954e16774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:40.679024 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e913d-8a08-4967-916f-4b954e16774a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:40.679504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e913d-8a08-4967-916f-4b954e16774a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:40.680124 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e913d-8a08-4967-916f-4b954e16774a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:40.697542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e913d-8a08-4967-916f-4b954e16774a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d87e913d-8a08-4967-916f-4b954e16774a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:26:40.706924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:40.708088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:40.712004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 536/1087] 10.222.0.91 () {56 vars in 1120 bytes} [Wed Aug 24 10:26:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:40.718183 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc1792-d1dd-4317-bd59-48815cb20e21 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:40.743283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:40.830202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc1792-d1dd-4317-bd59-48815cb20e21 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:40.866696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769b9c-e623-47b1-906a-6491ea1ef323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:40.867305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769b9c-e623-47b1-906a-6491ea1ef323 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:40.867580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769b9c-e623-47b1-906a-6491ea1ef323 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:40.867881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769b9c-e623-47b1-906a-6491ea1ef323 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:40.868533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1769b9c-e623-47b1-906a-6491ea1ef323 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:40.868860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1769b9c-e623-47b1-906a-6491ea1ef323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:40.870216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1769b9c-e623-47b1-906a-6491ea1ef323 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:40.880650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 552/1088] 10.222.0.91 () {56 vars in 1115 bytes} [Wed Aug 24 10:26:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:40.885044 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e913d-8a08-4967-916f-4b954e16774a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:40.934665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:40.988756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e913d-8a08-4967-916f-4b954e16774a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:41.023653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc9432-253f-41af-b4e3-da1e18222925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:41.024333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc9432-253f-41af-b4e3-da1e18222925 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:41.024608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc9432-253f-41af-b4e3-da1e18222925 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:41.024877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc9432-253f-41af-b4e3-da1e18222925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:41.035619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc9432-253f-41af-b4e3-da1e18222925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:41.037132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc9432-253f-41af-b4e3-da1e18222925 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6fcc9432-253f-41af-b4e3-da1e18222925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:41.052458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:41.053679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:41.054599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:41.054599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:41.054599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:41.054599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 537/1089] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:41.059736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769b9c-e623-47b1-906a-6491ea1ef323 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:41.158524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:41.174135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769b9c-e623-47b1-906a-6491ea1ef323 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:41.207021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae87fa-deaa-4bbe-8e9d-52571a6311a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:41.207625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae87fa-deaa-4bbe-8e9d-52571a6311a0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:41.207929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae87fa-deaa-4bbe-8e9d-52571a6311a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:41.208200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae87fa-deaa-4bbe-8e9d-52571a6311a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:41.208832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae87fa-deaa-4bbe-8e9d-52571a6311a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:41.209129 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae87fa-deaa-4bbe-8e9d-52571a6311a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:41.211052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae87fa-deaa-4bbe-8e9d-52571a6311a0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:41.223004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 553/1090] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:41.229748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc9432-253f-41af-b4e3-da1e18222925 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:41.327919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:41.331401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc9432-253f-41af-b4e3-da1e18222925 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:41.367942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1f6f9-542d-4f1b-bd9c-fc316c896c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:41.368566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1f6f9-542d-4f1b-bd9c-fc316c896c52 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:41.368921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1f6f9-542d-4f1b-bd9c-fc316c896c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:41.369177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1f6f9-542d-4f1b-bd9c-fc316c896c52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:41.376475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1f6f9-542d-4f1b-bd9c-fc316c896c52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:41.377900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1f6f9-542d-4f1b-bd9c-fc316c896c52 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-dae1f6f9-542d-4f1b-bd9c-fc316c896c52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:26:41.390206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:41.391349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:41.392436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:41.392436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:41.392436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:26:41.392436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:26:41.392436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:26:41.392436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:26:41.392436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:26:41.392436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:26:41.392436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:26:41.392436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:26:41.392436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 538/1091] 10.222.0.91 () {56 vars in 1093 bytes} [Wed Aug 24 10:26:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:41.397675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae87fa-deaa-4bbe-8e9d-52571a6311a0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:41.503395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae87fa-deaa-4bbe-8e9d-52571a6311a0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:41.540303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da42cf-097c-4158-ab99-b7f12151b90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:41.540898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da42cf-097c-4158-ab99-b7f12151b90b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:41.541171 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da42cf-097c-4158-ab99-b7f12151b90b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:41.541438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da42cf-097c-4158-ab99-b7f12151b90b None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:41.542156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da42cf-097c-4158-ab99-b7f12151b90b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:41.542457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da42cf-097c-4158-ab99-b7f12151b90b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:41.544038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da42cf-097c-4158-ab99-b7f12151b90b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:41.561522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 554/1092] 10.222.0.91 () {56 vars in 1133 bytes} [Wed Aug 24 10:26:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:41.567343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1f6f9-542d-4f1b-bd9c-fc316c896c52 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:41.673018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1f6f9-542d-4f1b-bd9c-fc316c896c52 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:41.707528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ee903-431e-4db9-b4f0-21e463071aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:41.708197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ee903-431e-4db9-b4f0-21e463071aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:41.708475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ee903-431e-4db9-b4f0-21e463071aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:41.708744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ee903-431e-4db9-b4f0-21e463071aa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:41.738595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:41.783029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ee903-431e-4db9-b4f0-21e463071aa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:41.784417 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ee903-431e-4db9-b4f0-21e463071aa0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:41.888368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 539/1093] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:26:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:26:41.895955 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da42cf-097c-4158-ab99-b7f12151b90b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:41.900711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:42.000318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da42cf-097c-4158-ab99-b7f12151b90b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:42.035183 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ea429-539e-4b19-8532-31b70ed0c66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:42.035772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ea429-539e-4b19-8532-31b70ed0c66b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:42.036030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ea429-539e-4b19-8532-31b70ed0c66b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:42.036296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ea429-539e-4b19-8532-31b70ed0c66b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:42.049590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ea429-539e-4b19-8532-31b70ed0c66b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:42.051042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ea429-539e-4b19-8532-31b70ed0c66b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a24ea429-539e-4b19-8532-31b70ed0c66b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:26:42.066480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:42.067698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:26:42.069873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:26:42.069873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:26:42.069873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:42.069873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 555/1094] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:42.073982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ee903-431e-4db9-b4f0-21e463071aa0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:42.081597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092dbd5-cb44-41c9-b42f-7306ae9c21af None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:42.081874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092dbd5-cb44-41c9-b42f-7306ae9c21af None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:42.082143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092dbd5-cb44-41c9-b42f-7306ae9c21af None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:42.083494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 556/1095] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:42.089027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e209bb-99d8-4abb-8bc5-4c1ada81b37d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:42.089310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e209bb-99d8-4abb-8bc5-4c1ada81b37d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:42.089583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e209bb-99d8-4abb-8bc5-4c1ada81b37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:42.108605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e3e209bb-99d8-4abb-8bc5-4c1ada81b37d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:42.109824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e3e209bb-99d8-4abb-8bc5-4c1ada81b37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:42.139620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:42.165487 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:42.181992 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 557/1096] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:42.184499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ee903-431e-4db9-b4f0-21e463071aa0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:42.221912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30e164-ba33-4abd-a38b-ae57e63dce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:42.222523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30e164-ba33-4abd-a38b-ae57e63dce10 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:42.222804 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30e164-ba33-4abd-a38b-ae57e63dce10 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:42.223075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30e164-ba33-4abd-a38b-ae57e63dce10 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:42.223736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30e164-ba33-4abd-a38b-ae57e63dce10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:42.224047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30e164-ba33-4abd-a38b-ae57e63dce10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:42.225433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30e164-ba33-4abd-a38b-ae57e63dce10 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:42.237754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 540/1097] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:42.243929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e209bb-99d8-4abb-8bc5-4c1ada81b37d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:42.346197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e209bb-99d8-4abb-8bc5-4c1ada81b37d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:42.380690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473432ca-5df0-4609-8e53-c0096ad5396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:42.381815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473432ca-5df0-4609-8e53-c0096ad5396f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:42.382131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473432ca-5df0-4609-8e53-c0096ad5396f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:42.382398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473432ca-5df0-4609-8e53-c0096ad5396f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:42.392539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473432ca-5df0-4609-8e53-c0096ad5396f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:42.393999 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473432ca-5df0-4609-8e53-c0096ad5396f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-473432ca-5df0-4609-8e53-c0096ad5396f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:26:42.406256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:42.407417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:42.408639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:26:42.408639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:26:42.408639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:26:42.408639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:26:42.408639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:26:42.408639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:26:42.408639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:26:42.408639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:42.408639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 558/1098] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:26:42.415297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30e164-ba33-4abd-a38b-ae57e63dce10 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:42.455770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473432ca-5df0-4609-8e53-c0096ad5396f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:42.504362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:42.520642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30e164-ba33-4abd-a38b-ae57e63dce10 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:42.538149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:42.556116 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca09911-db9d-4aab-a7a0-25ec0e52c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:42.556726 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca09911-db9d-4aab-a7a0-25ec0e52c925 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:42.557002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca09911-db9d-4aab-a7a0-25ec0e52c925 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:42.557272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca09911-db9d-4aab-a7a0-25ec0e52c925 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:42.558024 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca09911-db9d-4aab-a7a0-25ec0e52c925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:42.558329 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca09911-db9d-4aab-a7a0-25ec0e52c925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:42.559569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473432ca-5df0-4609-8e53-c0096ad5396f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:42.559796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca09911-db9d-4aab-a7a0-25ec0e52c925 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:42.573151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 541/1099] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:26:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:42.579222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca09911-db9d-4aab-a7a0-25ec0e52c925 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:42.594093 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7bd92-a77a-410a-aac8-6d975569f058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:42.595317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7bd92-a77a-410a-aac8-6d975569f058 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:42.595317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7bd92-a77a-410a-aac8-6d975569f058 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:42.595317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7bd92-a77a-410a-aac8-6d975569f058 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:42.606675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7bd92-a77a-410a-aac8-6d975569f058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-9ad7bd92-a77a-410a-aac8-6d975569f058 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:26:42.611866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:26:42.613004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:26:42.614200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 559/1100] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:26:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:26:42.619797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7bd92-a77a-410a-aac8-6d975569f058 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:42.687996 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca09911-db9d-4aab-a7a0-25ec0e52c925 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:42.722435 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec8c35-814b-4ab4-99ab-93b89f9eb084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:42.722955 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7bd92-a77a-410a-aac8-6d975569f058 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:42.723081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec8c35-814b-4ab4-99ab-93b89f9eb084 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:42.723308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec8c35-814b-4ab4-99ab-93b89f9eb084 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:42.723576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec8c35-814b-4ab4-99ab-93b89f9eb084 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:42.724494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec8c35-814b-4ab4-99ab-93b89f9eb084 None admin] RBAC: Adding query filter params (role.id=04a0de02c1844906ab3379298e71c6a4, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=4ae21e13a4414168bd1741dfd642274a) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:42.724679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec8c35-814b-4ab4-99ab-93b89f9eb084 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:42.726329 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec8c35-814b-4ab4-99ab-93b89f9eb084 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:42.730205 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:42.732416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 542/1101] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:26:42 2022] GET /identity/v3/role_assignments?user.id=4ae21e13a4414168bd1741dfd642274a&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=04a0de02c1844906ab3379298e71c6a4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:42.760989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baead033-e4e3-4d71-b879-611addbe45e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:42.761616 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baead033-e4e3-4d71-b879-611addbe45e7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:42.761891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baead033-e4e3-4d71-b879-611addbe45e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:42.762161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baead033-e4e3-4d71-b879-611addbe45e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:42.762830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baead033-e4e3-4d71-b879-611addbe45e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:42.763128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baead033-e4e3-4d71-b879-611addbe45e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:42.764580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baead033-e4e3-4d71-b879-611addbe45e7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:42.774365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 560/1102] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:26:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:42.782184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec8c35-814b-4ab4-99ab-93b89f9eb084 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:42.830455 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:42.896329 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec8c35-814b-4ab4-99ab-93b89f9eb084 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:42.931969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae2027-13df-456d-899b-8e48a6a4277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:42.932612 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae2027-13df-456d-899b-8e48a6a4277e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:42.932890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae2027-13df-456d-899b-8e48a6a4277e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:42.933705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae2027-13df-456d-899b-8e48a6a4277e None admin] PATH_INFO: `/v3/users/1429247f888a449f9d4ce08b4c0e1a2e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:42.934300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae2027-13df-456d-899b-8e48a6a4277e None admin] RBAC: Authorizing `identity:get_user(user_id=1429247f888a449f9d4ce08b4c0e1a2e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:42.935805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae2027-13df-456d-899b-8e48a6a4277e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:42.937356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 543/1103] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:26:42 2022] GET /identity/v3/users/1429247f888a449f9d4ce08b4c0e1a2e => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:42.943494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baead033-e4e3-4d71-b879-611addbe45e7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:43.051455 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baead033-e4e3-4d71-b879-611addbe45e7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:43.088309 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5381c4-eac9-49c3-bd0f-4aa4329df62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:43.088922 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5381c4-eac9-49c3-bd0f-4aa4329df62c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:43.089204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5381c4-eac9-49c3-bd0f-4aa4329df62c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:43.089468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5381c4-eac9-49c3-bd0f-4aa4329df62c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:43.127821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:43.163949 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5381c4-eac9-49c3-bd0f-4aa4329df62c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:43.165414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5381c4-eac9-49c3-bd0f-4aa4329df62c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:43.265596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 561/1104] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:26:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:26:43.272504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae2027-13df-456d-899b-8e48a6a4277e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:43.381503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae2027-13df-456d-899b-8e48a6a4277e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:43.392609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:43.420311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90349-485e-4fdb-a40a-2340f5d7dcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:43.420882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90349-485e-4fdb-a40a-2340f5d7dcb5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:43.421164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90349-485e-4fdb-a40a-2340f5d7dcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:43.421437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90349-485e-4fdb-a40a-2340f5d7dcb5 None admin] PATH_INFO: `/v3/projects/4c6d440496fa49a2b97c1bf589af35a0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:43.422605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90349-485e-4fdb-a40a-2340f5d7dcb5 None admin] RBAC: Authorizing `identity:get_project(project_id=4c6d440496fa49a2b97c1bf589af35a0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:43.424062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90349-485e-4fdb-a40a-2340f5d7dcb5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:43.425704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 544/1105] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:26:43 2022] GET /identity/v3/projects/4c6d440496fa49a2b97c1bf589af35a0 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:43.433203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5381c4-eac9-49c3-bd0f-4aa4329df62c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:43.503208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:43.537351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5381c4-eac9-49c3-bd0f-4aa4329df62c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:43.575671 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca93cdb-de8d-4d55-b787-64dd90d91113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:43.576401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93cdb-de8d-4d55-b787-64dd90d91113 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:43.576689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93cdb-de8d-4d55-b787-64dd90d91113 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:43.576960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93cdb-de8d-4d55-b787-64dd90d91113 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:43.577690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca93cdb-de8d-4d55-b787-64dd90d91113 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=4c6d440496fa49a2b97c1bf589af35a0, user.id=1429247f888a449f9d4ce08b4c0e1a2e) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:43.577997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca93cdb-de8d-4d55-b787-64dd90d91113 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:43.579480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca93cdb-de8d-4d55-b787-64dd90d91113 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:43.588228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 562/1106] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:26:43 2022] GET /identity/v3/role_assignments?user.id=1429247f888a449f9d4ce08b4c0e1a2e&scope.project.id=4c6d440496fa49a2b97c1bf589af35a0&role.id=60abeefc9ac84e31a0162ac559220669 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:45.525035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca5669-fbdd-415a-bbf1-0fb66da4ae46 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:45.525590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca5669-fbdd-415a-bbf1-0fb66da4ae46 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:45.525590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca5669-fbdd-415a-bbf1-0fb66da4ae46 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:45.526903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 545/1107] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:45.532274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5264e61-6bc7-4381-8f7d-8a32a620328a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:45.532716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5264e61-6bc7-4381-8f7d-8a32a620328a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:45.532822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5264e61-6bc7-4381-8f7d-8a32a620328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:45.551116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d5264e61-6bc7-4381-8f7d-8a32a620328a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:45.552331 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d5264e61-6bc7-4381-8f7d-8a32a620328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:45.619571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 563/1108] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:45.891249 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca5669-fbdd-415a-bbf1-0fb66da4ae46 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:45.990312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca5669-fbdd-415a-bbf1-0fb66da4ae46 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:46.024439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfd2d8-0cc4-4fa0-ab47-224200fa4914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:46.025044 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfd2d8-0cc4-4fa0-ab47-224200fa4914 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:46.025325 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfd2d8-0cc4-4fa0-ab47-224200fa4914 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:46.025586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfd2d8-0cc4-4fa0-ab47-224200fa4914 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:46.026670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfd2d8-0cc4-4fa0-ab47-224200fa4914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:46.028099 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfd2d8-0cc4-4fa0-ab47-224200fa4914 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:46.029637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 546/1109] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:46.035456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5264e61-6bc7-4381-8f7d-8a32a620328a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:46.095674 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:46.134273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5264e61-6bc7-4381-8f7d-8a32a620328a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:46.167595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477015b1-dbe8-48a2-b97c-187c51d9786a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:46.168158 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477015b1-dbe8-48a2-b97c-187c51d9786a None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:46.168440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477015b1-dbe8-48a2-b97c-187c51d9786a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:46.168712 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477015b1-dbe8-48a2-b97c-187c51d9786a None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:46.169346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477015b1-dbe8-48a2-b97c-187c51d9786a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:46.170776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477015b1-dbe8-48a2-b97c-187c51d9786a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:46.247901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 564/1110] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:26:46 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:26:48.185735 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd164f44-c2fa-4361-9a2d-a29ec8d47259 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:48.186275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd164f44-c2fa-4361-9a2d-a29ec8d47259 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:48.186275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd164f44-c2fa-4361-9a2d-a29ec8d47259 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:48.187591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 547/1111] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:48.193156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287c404-87c0-41df-9c01-cd395e8c9552 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:48.193549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287c404-87c0-41df-9c01-cd395e8c9552 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:48.193766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287c404-87c0-41df-9c01-cd395e8c9552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:48.212194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7287c404-87c0-41df-9c01-cd395e8c9552 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:48.213440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7287c404-87c0-41df-9c01-cd395e8c9552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:48.284045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 565/1112] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:48.565052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd164f44-c2fa-4361-9a2d-a29ec8d47259 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:48.612959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:48.666629 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd164f44-c2fa-4361-9a2d-a29ec8d47259 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:48.700220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67e304-bbc2-49f2-b857-27bf1f0d065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:48.700837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67e304-bbc2-49f2-b857-27bf1f0d065b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:48.701117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67e304-bbc2-49f2-b857-27bf1f0d065b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:48.701389 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67e304-bbc2-49f2-b857-27bf1f0d065b None admin] PATH_INFO: `/v3/roles/2d3147d5707740a9995645aee5e671b3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:48.702768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67e304-bbc2-49f2-b857-27bf1f0d065b None admin] RBAC: Authorizing `identity:get_role(role_id=2d3147d5707740a9995645aee5e671b3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:48.704165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67e304-bbc2-49f2-b857-27bf1f0d065b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:48.705493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 548/1113] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:26:48 2022] GET /identity/v3/roles/2d3147d5707740a9995645aee5e671b3 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:48.711449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287c404-87c0-41df-9c01-cd395e8c9552 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:48.760014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:48.809050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287c404-87c0-41df-9c01-cd395e8c9552 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:48.842511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31c906-06f8-4c4c-a805-a72eb889f299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:48.843062 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31c906-06f8-4c4c-a805-a72eb889f299 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:48.843342 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31c906-06f8-4c4c-a805-a72eb889f299 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:48.843614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31c906-06f8-4c4c-a805-a72eb889f299 None admin] PATH_INFO: `/v3/users/7d56873c19ba4f7fb932175f20097651` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:48.857690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31c906-06f8-4c4c-a805-a72eb889f299 None admin] RBAC: Authorizing `identity:get_user(user_id=7d56873c19ba4f7fb932175f20097651)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:48.859125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31c906-06f8-4c4c-a805-a72eb889f299 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:48.860837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 566/1114] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:26:48 2022] GET /identity/v3/users/7d56873c19ba4f7fb932175f20097651 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:48.867038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67e304-bbc2-49f2-b857-27bf1f0d065b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:48.979623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67e304-bbc2-49f2-b857-27bf1f0d065b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:48.994441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:49.014980 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa647-ad43-4518-9cb6-b060e7b018e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:49.015586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa647-ad43-4518-9cb6-b060e7b018e4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:49.015892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa647-ad43-4518-9cb6-b060e7b018e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:49.016165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa647-ad43-4518-9cb6-b060e7b018e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:49.086951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aa647-ad43-4518-9cb6-b060e7b018e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:49.088466 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aa647-ad43-4518-9cb6-b060e7b018e4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:49.191832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 549/1115] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:26:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:26:49.198649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31c906-06f8-4c4c-a805-a72eb889f299 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:49.297115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31c906-06f8-4c4c-a805-a72eb889f299 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:49.305147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:49.331528 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670f52e-92fb-4f71-9bcd-1ec5843b44c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:49.332233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670f52e-92fb-4f71-9bcd-1ec5843b44c2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:49.332556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670f52e-92fb-4f71-9bcd-1ec5843b44c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:49.332834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670f52e-92fb-4f71-9bcd-1ec5843b44c2 None admin] PATH_INFO: `/v3/projects/4c6d440496fa49a2b97c1bf589af35a0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:49.333943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670f52e-92fb-4f71-9bcd-1ec5843b44c2 None admin] RBAC: Authorizing `identity:get_project(project_id=4c6d440496fa49a2b97c1bf589af35a0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:49.336186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670f52e-92fb-4f71-9bcd-1ec5843b44c2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:49.338340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 567/1116] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:26:49 2022] GET /identity/v3/projects/4c6d440496fa49a2b97c1bf589af35a0 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:49.344207 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa647-ad43-4518-9cb6-b060e7b018e4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:49.359533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:49.442664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa647-ad43-4518-9cb6-b060e7b018e4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:49.475576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26d87d-11ea-4540-b824-607896a22c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:49.476191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26d87d-11ea-4540-b824-607896a22c2a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:49.476469 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26d87d-11ea-4540-b824-607896a22c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:49.476737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26d87d-11ea-4540-b824-607896a22c2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:49.477450 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26d87d-11ea-4540-b824-607896a22c2a None admin] RBAC: Adding query filter params (role.id=2d3147d5707740a9995645aee5e671b3, scope.project.id=4c6d440496fa49a2b97c1bf589af35a0, user.id=7d56873c19ba4f7fb932175f20097651) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:49.477753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26d87d-11ea-4540-b824-607896a22c2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:49.479165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26d87d-11ea-4540-b824-607896a22c2a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:49.484383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 550/1117] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:26:49 2022] GET /identity/v3/role_assignments?user.id=7d56873c19ba4f7fb932175f20097651&scope.project.id=4c6d440496fa49a2b97c1bf589af35a0&role.id=2d3147d5707740a9995645aee5e671b3 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:51.365827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3f9dc-6729-4141-be28-818c6c15901e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:51.366446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3f9dc-6729-4141-be28-818c6c15901e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:51.366737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3f9dc-6729-4141-be28-818c6c15901e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:51.368418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 568/1118] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:51.373976 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145829bc-98e1-468a-9ea8-c83138c1fa43 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:51.374454 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145829bc-98e1-468a-9ea8-c83138c1fa43 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:51.374543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145829bc-98e1-468a-9ea8-c83138c1fa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:51.393354 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-145829bc-98e1-468a-9ea8-c83138c1fa43 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:51.394783 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-145829bc-98e1-468a-9ea8-c83138c1fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:51.462035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 551/1119] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:26:51.729413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3f9dc-6729-4141-be28-818c6c15901e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:51.846023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3f9dc-6729-4141-be28-818c6c15901e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:51.885090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d7600-4afb-4115-b53c-4efec0419029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:51.889333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d7600-4afb-4115-b53c-4efec0419029 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:51.889333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d7600-4afb-4115-b53c-4efec0419029 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:51.889333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d7600-4afb-4115-b53c-4efec0419029 None admin] PATH_INFO: `/v3/roles/2d3147d5707740a9995645aee5e671b3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:51.889333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d7600-4afb-4115-b53c-4efec0419029 None admin] RBAC: Authorizing `identity:get_role(role_id=2d3147d5707740a9995645aee5e671b3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:51.889333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d7600-4afb-4115-b53c-4efec0419029 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:51.890457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 569/1120] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:26:51 2022] GET /identity/v3/roles/2d3147d5707740a9995645aee5e671b3 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:51.897600 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145829bc-98e1-468a-9ea8-c83138c1fa43 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:51.908691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:52.015018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145829bc-98e1-468a-9ea8-c83138c1fa43 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:52.049467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0515634-caf3-426b-be53-a48a0fad9142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:52.050090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0515634-caf3-426b-be53-a48a0fad9142 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:52.050367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0515634-caf3-426b-be53-a48a0fad9142 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:52.050634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0515634-caf3-426b-be53-a48a0fad9142 None admin] PATH_INFO: `/v3/users/7d56873c19ba4f7fb932175f20097651` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:52.051770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0515634-caf3-426b-be53-a48a0fad9142 None admin] RBAC: Authorizing `identity:get_user(user_id=7d56873c19ba4f7fb932175f20097651)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:52.053356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0515634-caf3-426b-be53-a48a0fad9142 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:52.055041 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 552/1121] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:26:51 2022] GET /identity/v3/users/7d56873c19ba4f7fb932175f20097651 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:26:52.060968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d7600-4afb-4115-b53c-4efec0419029 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:52.105133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:52.161096 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d7600-4afb-4115-b53c-4efec0419029 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:52.197126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa4c5d-efc3-4d4f-b462-4915c3daad3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:52.197772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4c5d-efc3-4d4f-b462-4915c3daad3a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:52.198049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4c5d-efc3-4d4f-b462-4915c3daad3a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:52.198318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4c5d-efc3-4d4f-b462-4915c3daad3a None admin] PATH_INFO: `/v3/projects/4c6d440496fa49a2b97c1bf589af35a0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:52.199549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa4c5d-efc3-4d4f-b462-4915c3daad3a None admin] RBAC: Authorizing `identity:get_project(project_id=4c6d440496fa49a2b97c1bf589af35a0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:52.201122 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa4c5d-efc3-4d4f-b462-4915c3daad3a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:52.202808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 570/1122] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:26:52 2022] GET /identity/v3/projects/4c6d440496fa49a2b97c1bf589af35a0 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:52.208826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0515634-caf3-426b-be53-a48a0fad9142 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:52.285228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:52.308009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0515634-caf3-426b-be53-a48a0fad9142 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:52.342972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca08bd8-d940-497d-a73a-00d8b22ceb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:52.343636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca08bd8-d940-497d-a73a-00d8b22ceb06 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:52.343957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca08bd8-d940-497d-a73a-00d8b22ceb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:52.344232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca08bd8-d940-497d-a73a-00d8b22ceb06 None admin] PATH_INFO: `/v3/projects/4c6d440496fa49a2b97c1bf589af35a0/users/7d56873c19ba4f7fb932175f20097651/roles/2d3147d5707740a9995645aee5e671b3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:52.346454 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca08bd8-d940-497d-a73a-00d8b22ceb06 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c6d440496fa49a2b97c1bf589af35a0, user_id=7d56873c19ba4f7fb932175f20097651, role_id=2d3147d5707740a9995645aee5e671b3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:52.347923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca08bd8-d940-497d-a73a-00d8b22ceb06 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:52.447103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 553/1123] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:26:52 2022] PUT /identity/v3/projects/4c6d440496fa49a2b97c1bf589af35a0/users/7d56873c19ba4f7fb932175f20097651/roles/2d3147d5707740a9995645aee5e671b3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:26:54.352801 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366e384-4b9b-47e9-a1b6-f505824a78a0 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:54.353293 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366e384-4b9b-47e9-a1b6-f505824a78a0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:54.353418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366e384-4b9b-47e9-a1b6-f505824a78a0 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:54.354697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 571/1124] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:54.360219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19e8c-b564-4282-8318-478b67ade99b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:54.360707 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19e8c-b564-4282-8318-478b67ade99b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:54.360802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19e8c-b564-4282-8318-478b67ade99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:54.379184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4cb19e8c-b564-4282-8318-478b67ade99b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:54.380419 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4cb19e8c-b564-4282-8318-478b67ade99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:54.456779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 554/1125] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:54.728106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366e384-4b9b-47e9-a1b6-f505824a78a0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:54.838443 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366e384-4b9b-47e9-a1b6-f505824a78a0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:54.853770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:54.878715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820931c-1bbc-45d8-aac8-44cbfe0fe9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:54.879339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820931c-1bbc-45d8-aac8-44cbfe0fe9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:54.879613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820931c-1bbc-45d8-aac8-44cbfe0fe9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:54.879911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820931c-1bbc-45d8-aac8-44cbfe0fe9e7 None admin] PATH_INFO: `/v3/roles/2d3147d5707740a9995645aee5e671b3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:54.881305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820931c-1bbc-45d8-aac8-44cbfe0fe9e7 None admin] RBAC: Authorizing `identity:get_role(role_id=2d3147d5707740a9995645aee5e671b3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:54.883118 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820931c-1bbc-45d8-aac8-44cbfe0fe9e7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:54.884476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 572/1126] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:26:54 2022] GET /identity/v3/roles/2d3147d5707740a9995645aee5e671b3 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:54.890309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19e8c-b564-4282-8318-478b67ade99b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:54.959117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:54.998001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19e8c-b564-4282-8318-478b67ade99b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:55.033686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b691bc-9658-43dd-ae36-b53aa06d20f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:55.034313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b691bc-9658-43dd-ae36-b53aa06d20f8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:55.034594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b691bc-9658-43dd-ae36-b53aa06d20f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:55.034865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b691bc-9658-43dd-ae36-b53aa06d20f8 None admin] PATH_INFO: `/v3/users/7d56873c19ba4f7fb932175f20097651` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:55.036012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b691bc-9658-43dd-ae36-b53aa06d20f8 None admin] RBAC: Authorizing `identity:get_user(user_id=7d56873c19ba4f7fb932175f20097651)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:55.037439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b691bc-9658-43dd-ae36-b53aa06d20f8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:55.040022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 555/1127] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:26:54 2022] GET /identity/v3/users/7d56873c19ba4f7fb932175f20097651 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:55.045824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820931c-1bbc-45d8-aac8-44cbfe0fe9e7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:55.146307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820931c-1bbc-45d8-aac8-44cbfe0fe9e7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:55.180845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596259bd-882a-42de-a58e-5567c689e801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:55.181441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596259bd-882a-42de-a58e-5567c689e801 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:55.181714 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596259bd-882a-42de-a58e-5567c689e801 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:55.182009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596259bd-882a-42de-a58e-5567c689e801 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:55.229301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:55.250722 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596259bd-882a-42de-a58e-5567c689e801 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:55.252170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596259bd-882a-42de-a58e-5567c689e801 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:55.354821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 573/1128] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:26:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:26:55.360989 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b691bc-9658-43dd-ae36-b53aa06d20f8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:55.468380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b691bc-9658-43dd-ae36-b53aa06d20f8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:55.502320 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0a568-f472-4166-8897-ded40e5c4305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:55.502862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0a568-f472-4166-8897-ded40e5c4305 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:55.503142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0a568-f472-4166-8897-ded40e5c4305 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:55.503413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0a568-f472-4166-8897-ded40e5c4305 None admin] PATH_INFO: `/v3/projects/4c6d440496fa49a2b97c1bf589af35a0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:55.504565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0a568-f472-4166-8897-ded40e5c4305 None admin] RBAC: Authorizing `identity:get_project(project_id=4c6d440496fa49a2b97c1bf589af35a0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:55.505994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0a568-f472-4166-8897-ded40e5c4305 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:55.508269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 556/1129] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:26:55 2022] GET /identity/v3/projects/4c6d440496fa49a2b97c1bf589af35a0 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:55.515098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596259bd-882a-42de-a58e-5567c689e801 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:55.591254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:55.612495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596259bd-882a-42de-a58e-5567c689e801 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:55.648184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1045db2-d07d-4513-adec-281f92bb2939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:55.648844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1045db2-d07d-4513-adec-281f92bb2939 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:55.649125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1045db2-d07d-4513-adec-281f92bb2939 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:55.649399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1045db2-d07d-4513-adec-281f92bb2939 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:55.650124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1045db2-d07d-4513-adec-281f92bb2939 None admin] RBAC: Adding query filter params (role.id=2d3147d5707740a9995645aee5e671b3, scope.project.id=4c6d440496fa49a2b97c1bf589af35a0, user.id=7d56873c19ba4f7fb932175f20097651) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:26:55.650429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1045db2-d07d-4513-adec-281f92bb2939 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:55.651894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1045db2-d07d-4513-adec-281f92bb2939 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:55.657877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 574/1130] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:26:55 2022] GET /identity/v3/role_assignments?user.id=7d56873c19ba4f7fb932175f20097651&scope.project.id=4c6d440496fa49a2b97c1bf589af35a0&role.id=2d3147d5707740a9995645aee5e671b3 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:57.602166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0e2ef-f600-4c46-a2ce-ca234ae0a707 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:57.602679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0e2ef-f600-4c46-a2ce-ca234ae0a707 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:57.602679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0e2ef-f600-4c46-a2ce-ca234ae0a707 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:57.604029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 557/1131] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:26:57.609284 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f53b0-3cac-45e9-a19e-50e764888c97 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:57.609690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f53b0-3cac-45e9-a19e-50e764888c97 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:57.609833 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f53b0-3cac-45e9-a19e-50e764888c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:57.628153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5f4f53b0-3cac-45e9-a19e-50e764888c97 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:26:57.629360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5f4f53b0-3cac-45e9-a19e-50e764888c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:26:57.703073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 575/1132] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:26:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:26:57.978029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0e2ef-f600-4c46-a2ce-ca234ae0a707 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:57.980973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:58.080443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0e2ef-f600-4c46-a2ce-ca234ae0a707 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:58.114933 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5f3db-0148-4612-861e-2db64958f516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:58.115559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5f3db-0148-4612-861e-2db64958f516 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:58.115879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5f3db-0148-4612-861e-2db64958f516 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:58.116138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5f3db-0148-4612-861e-2db64958f516 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:58.117835 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5f3db-0148-4612-861e-2db64958f516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:58.119266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5f3db-0148-4612-861e-2db64958f516 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:58.120869 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 558/1133] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:26:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:26:58.126707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f53b0-3cac-45e9-a19e-50e764888c97 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:26:58.196234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:58.225489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f53b0-3cac-45e9-a19e-50e764888c97 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:26:58.259327 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94632186-3e4c-417c-847f-8796656b2542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:26:58.259894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94632186-3e4c-417c-847f-8796656b2542 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:26:58.260173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94632186-3e4c-417c-847f-8796656b2542 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:26:58.260444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94632186-3e4c-417c-847f-8796656b2542 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:26:58.261094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94632186-3e4c-417c-847f-8796656b2542 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:26:58.262525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94632186-3e4c-417c-847f-8796656b2542 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:26:58.379023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 576/1134] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:26:58 2022] POST /identity/v3/projects => generated 311 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:27:00.330383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468b44-0154-4f99-8f82-010ff1244582 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:00.330943 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468b44-0154-4f99-8f82-010ff1244582 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:00.330943 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468b44-0154-4f99-8f82-010ff1244582 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:00.332300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 559/1135] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:27:00.337996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c6efd-1b11-46e5-9109-29d51ebd50cc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:00.338413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c6efd-1b11-46e5-9109-29d51ebd50cc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:00.338552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c6efd-1b11-46e5-9109-29d51ebd50cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:00.357746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-333c6efd-1b11-46e5-9109-29d51ebd50cc None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:27:00.358930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-333c6efd-1b11-46e5-9109-29d51ebd50cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:27:00.424655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 577/1136] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:27:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:27:00.701624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05468b44-0154-4f99-8f82-010ff1244582 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:00.774790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:00.807541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05468b44-0154-4f99-8f82-010ff1244582 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:00.843243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb9f57-cbf5-4b8e-a641-ef5a1ea2a1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:00.843897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb9f57-cbf5-4b8e-a641-ef5a1ea2a1dc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:00.844178 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb9f57-cbf5-4b8e-a641-ef5a1ea2a1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:00.844511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb9f57-cbf5-4b8e-a641-ef5a1ea2a1dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:00.845632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb9f57-cbf5-4b8e-a641-ef5a1ea2a1dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:00.847061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb9f57-cbf5-4b8e-a641-ef5a1ea2a1dc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:00.848662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 560/1137] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:27:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:00.854947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c6efd-1b11-46e5-9109-29d51ebd50cc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:00.911466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:00.956226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c6efd-1b11-46e5-9109-29d51ebd50cc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:00.990869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14d5b2-ad2d-4ed5-a16e-2c70a1068b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:00.991772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d5b2-ad2d-4ed5-a16e-2c70a1068b57 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:00.992088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d5b2-ad2d-4ed5-a16e-2c70a1068b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:00.992305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d5b2-ad2d-4ed5-a16e-2c70a1068b57 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:00.992951 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14d5b2-ad2d-4ed5-a16e-2c70a1068b57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:00.994378 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14d5b2-ad2d-4ed5-a16e-2c70a1068b57 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:01.080501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 578/1138] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:27:00 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:27:03.034234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eb60b-61d2-447f-8924-d48a26bd6c1e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:03.034794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eb60b-61d2-447f-8924-d48a26bd6c1e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:03.034794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eb60b-61d2-447f-8924-d48a26bd6c1e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:03.036155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 561/1139] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:27:03.041534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b0da-963e-4066-9387-25883e49b3a6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:03.041948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b0da-963e-4066-9387-25883e49b3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:03.042086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b0da-963e-4066-9387-25883e49b3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:03.060459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8743b0da-963e-4066-9387-25883e49b3a6 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:27:03.061649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8743b0da-963e-4066-9387-25883e49b3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:27:03.128342 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 579/1140] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:27:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:27:03.396952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eb60b-61d2-447f-8924-d48a26bd6c1e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:03.498366 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eb60b-61d2-447f-8924-d48a26bd6c1e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:03.532101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf03b0-26ea-4938-b346-3b4074c7593f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:03.532745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf03b0-26ea-4938-b346-3b4074c7593f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:03.533016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf03b0-26ea-4938-b346-3b4074c7593f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:03.533280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf03b0-26ea-4938-b346-3b4074c7593f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:03.540184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:03.543693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf03b0-26ea-4938-b346-3b4074c7593f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-15bf03b0-26ea-4938-b346-3b4074c7593f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:27:03.548449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:27:03.549632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:27:03.550773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 562/1141] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:27:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:27:03.556490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743b0da-963e-4066-9387-25883e49b3a6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:03.608746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:03.656736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743b0da-963e-4066-9387-25883e49b3a6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:03.697070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff316082-7100-468c-8e59-bbfb12ee5ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:03.697864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316082-7100-468c-8e59-bbfb12ee5ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:03.698389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316082-7100-468c-8e59-bbfb12ee5ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:03.699227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316082-7100-468c-8e59-bbfb12ee5ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:03.700115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff316082-7100-468c-8e59-bbfb12ee5ae1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:27:03.700421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff316082-7100-468c-8e59-bbfb12ee5ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:03.701804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff316082-7100-468c-8e59-bbfb12ee5ae1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:03.711482 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 580/1142] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:27:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:03.717654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf03b0-26ea-4938-b346-3b4074c7593f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:03.826330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf03b0-26ea-4938-b346-3b4074c7593f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:03.860616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc451f-bc0e-4948-bd5d-f7ce48569f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:03.861154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc451f-bc0e-4948-bd5d-f7ce48569f32 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:03.861432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc451f-bc0e-4948-bd5d-f7ce48569f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:03.861708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc451f-bc0e-4948-bd5d-f7ce48569f32 None admin] PATH_INFO: `/v3/users/cacd164cd50e4fd386a44ab259f01ee7` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:03.876858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc451f-bc0e-4948-bd5d-f7ce48569f32 None admin] RBAC: Authorizing `identity:get_user(user_id=cacd164cd50e4fd386a44ab259f01ee7)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:03.878315 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc451f-bc0e-4948-bd5d-f7ce48569f32 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:03.880016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 563/1143] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:27:03 2022] GET /identity/v3/users/cacd164cd50e4fd386a44ab259f01ee7 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:03.887089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff316082-7100-468c-8e59-bbfb12ee5ae1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:03.988261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff316082-7100-468c-8e59-bbfb12ee5ae1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:03.989888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:04.023413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992c3c-1cfb-4f0c-ab3b-e55455e2e39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:04.024163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992c3c-1cfb-4f0c-ab3b-e55455e2e39b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:04.024443 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992c3c-1cfb-4f0c-ab3b-e55455e2e39b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:04.024711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992c3c-1cfb-4f0c-ab3b-e55455e2e39b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:04.091803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7992c3c-1cfb-4f0c-ab3b-e55455e2e39b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:04.093249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7992c3c-1cfb-4f0c-ab3b-e55455e2e39b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:04.189059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 581/1144] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:27:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:27:04.195918 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc451f-bc0e-4948-bd5d-f7ce48569f32 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:04.252469 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:04.296351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc451f-bc0e-4948-bd5d-f7ce48569f32 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:04.337910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce742275-1c9d-4bea-aef8-467fc398a5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:04.338530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742275-1c9d-4bea-aef8-467fc398a5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:04.338804 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742275-1c9d-4bea-aef8-467fc398a5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:04.339071 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742275-1c9d-4bea-aef8-467fc398a5c2 None admin] PATH_INFO: `/v3/projects/4e418a56071f459f87370933c9a16de1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:04.340191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce742275-1c9d-4bea-aef8-467fc398a5c2 None admin] RBAC: Authorizing `identity:get_project(project_id=4e418a56071f459f87370933c9a16de1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:04.341614 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce742275-1c9d-4bea-aef8-467fc398a5c2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:04.343226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 564/1145] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:27:04 2022] GET /identity/v3/projects/4e418a56071f459f87370933c9a16de1 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:04.349419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992c3c-1cfb-4f0c-ab3b-e55455e2e39b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:04.351590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:04.447866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992c3c-1cfb-4f0c-ab3b-e55455e2e39b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:04.480710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecca2b-4593-479f-95b6-67e8139d4c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:04.481297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecca2b-4593-479f-95b6-67e8139d4c39 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:04.481574 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecca2b-4593-479f-95b6-67e8139d4c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:04.481845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecca2b-4593-479f-95b6-67e8139d4c39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:04.482557 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecca2b-4593-479f-95b6-67e8139d4c39 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=4e418a56071f459f87370933c9a16de1, user.id=cacd164cd50e4fd386a44ab259f01ee7) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:27:04.482863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecca2b-4593-479f-95b6-67e8139d4c39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:04.484324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecca2b-4593-479f-95b6-67e8139d4c39 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:04.489592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 582/1146] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:27:04 2022] GET /identity/v3/role_assignments?user.id=cacd164cd50e4fd386a44ab259f01ee7&scope.project.id=4e418a56071f459f87370933c9a16de1&role.id=60abeefc9ac84e31a0162ac559220669 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:06.383165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03bf1e-b77d-40dc-98ff-725d45d70968 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:06.383696 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03bf1e-b77d-40dc-98ff-725d45d70968 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:06.383696 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03bf1e-b77d-40dc-98ff-725d45d70968 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:06.385082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 565/1147] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:27:06.390358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e7c32-32d1-4ac9-969e-e614df5ceead None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:06.390767 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e7c32-32d1-4ac9-969e-e614df5ceead None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:06.390903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e7c32-32d1-4ac9-969e-e614df5ceead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:06.409026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-614e7c32-32d1-4ac9-969e-e614df5ceead None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:27:06.410188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-614e7c32-32d1-4ac9-969e-e614df5ceead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:27:06.468694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:06.476610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 583/1148] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:27:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:27:06.747243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03bf1e-b77d-40dc-98ff-725d45d70968 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:06.846961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03bf1e-b77d-40dc-98ff-725d45d70968 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:06.870872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:06.881011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17cfe-b257-4796-bd22-8b302d170d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:06.881666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17cfe-b257-4796-bd22-8b302d170d0f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:06.881945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17cfe-b257-4796-bd22-8b302d170d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:06.882219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17cfe-b257-4796-bd22-8b302d170d0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:06.892030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc17cfe-b257-4796-bd22-8b302d170d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-cfc17cfe-b257-4796-bd22-8b302d170d0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:27:06.896945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:27:06.898323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:27:06.899514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 566/1149] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:27:06.904373 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e7c32-32d1-4ac9-969e-e614df5ceead None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:07.002972 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e7c32-32d1-4ac9-969e-e614df5ceead None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:07.037942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cac73-eeae-429c-bd5d-771b5395186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:07.038569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cac73-eeae-429c-bd5d-771b5395186a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:07.038846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cac73-eeae-429c-bd5d-771b5395186a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:07.039123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cac73-eeae-429c-bd5d-771b5395186a None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:07.039813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cac73-eeae-429c-bd5d-771b5395186a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:27:07.040117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cac73-eeae-429c-bd5d-771b5395186a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:07.041485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cac73-eeae-429c-bd5d-771b5395186a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:07.049441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 584/1150] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:27:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:07.055684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17cfe-b257-4796-bd22-8b302d170d0f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:07.158128 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17cfe-b257-4796-bd22-8b302d170d0f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:07.192649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9cd3e-26ff-4d35-a6d1-c4a35d4ef2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:07.193272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9cd3e-26ff-4d35-a6d1-c4a35d4ef2eb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:07.193558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9cd3e-26ff-4d35-a6d1-c4a35d4ef2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:07.193830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9cd3e-26ff-4d35-a6d1-c4a35d4ef2eb None admin] PATH_INFO: `/v3/users/cacd164cd50e4fd386a44ab259f01ee7` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:07.195002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9cd3e-26ff-4d35-a6d1-c4a35d4ef2eb None admin] RBAC: Authorizing `identity:get_user(user_id=cacd164cd50e4fd386a44ab259f01ee7)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:07.196470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9cd3e-26ff-4d35-a6d1-c4a35d4ef2eb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:07.198068 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 567/1151] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:27:07 2022] GET /identity/v3/users/cacd164cd50e4fd386a44ab259f01ee7 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:07.204944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cac73-eeae-429c-bd5d-771b5395186a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:07.266729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:07.310026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cac73-eeae-429c-bd5d-771b5395186a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:07.344149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5df38-a31c-411f-810c-0aac6d157682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:07.344769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5df38-a31c-411f-810c-0aac6d157682 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:07.345042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5df38-a31c-411f-810c-0aac6d157682 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:07.345310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5df38-a31c-411f-810c-0aac6d157682 None admin] PATH_INFO: `/v3/projects/4e418a56071f459f87370933c9a16de1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:07.346407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5df38-a31c-411f-810c-0aac6d157682 None admin] RBAC: Authorizing `identity:get_project(project_id=4e418a56071f459f87370933c9a16de1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:07.347862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5df38-a31c-411f-810c-0aac6d157682 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:07.349484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 585/1152] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:27:07 2022] GET /identity/v3/projects/4e418a56071f459f87370933c9a16de1 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:07.356496 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9cd3e-26ff-4d35-a6d1-c4a35d4ef2eb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:07.417855 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:07.466637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9cd3e-26ff-4d35-a6d1-c4a35d4ef2eb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:07.501360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b645880-d062-44c8-a5b8-38a6c54b01af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:07.502012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b645880-d062-44c8-a5b8-38a6c54b01af None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:07.502292 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b645880-d062-44c8-a5b8-38a6c54b01af None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:07.502564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b645880-d062-44c8-a5b8-38a6c54b01af None admin] PATH_INFO: `/v3/projects/4e418a56071f459f87370933c9a16de1/users/cacd164cd50e4fd386a44ab259f01ee7/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:07.504486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b645880-d062-44c8-a5b8-38a6c54b01af None admin] RBAC: Authorizing `identity:create_grant(project_id=4e418a56071f459f87370933c9a16de1, user_id=cacd164cd50e4fd386a44ab259f01ee7, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:07.505920 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b645880-d062-44c8-a5b8-38a6c54b01af None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:07.590210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 568/1153] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:27:07 2022] PUT /identity/v3/projects/4e418a56071f459f87370933c9a16de1/users/cacd164cd50e4fd386a44ab259f01ee7/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:27:09.494543 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584731c6-0561-45a2-997d-bce5bfe2b37f None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:09.495058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584731c6-0561-45a2-997d-bce5bfe2b37f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:09.495058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584731c6-0561-45a2-997d-bce5bfe2b37f None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:09.496470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 586/1154] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:27:09.501669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4b65c-bbd9-47b4-849c-eca1932d30c2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:09.502066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4b65c-bbd9-47b4-849c-eca1932d30c2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:09.502216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4b65c-bbd9-47b4-849c-eca1932d30c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:09.521033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e0d4b65c-bbd9-47b4-849c-eca1932d30c2 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:27:09.522291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e0d4b65c-bbd9-47b4-849c-eca1932d30c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:27:09.588290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 569/1155] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:27:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:27:09.861015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584731c6-0561-45a2-997d-bce5bfe2b37f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:09.963356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584731c6-0561-45a2-997d-bce5bfe2b37f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:09.989577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:09.998311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e1620-df14-42f5-ba14-99e80a465b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:09.998935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e1620-df14-42f5-ba14-99e80a465b8e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:09.999212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e1620-df14-42f5-ba14-99e80a465b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:09.999481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e1620-df14-42f5-ba14-99e80a465b8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:10.010317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e1620-df14-42f5-ba14-99e80a465b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f20e1620-df14-42f5-ba14-99e80a465b8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:27:10.015043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:27:10.016207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:27:10.017499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 587/1156] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:27:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:27:10.024920 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4b65c-bbd9-47b4-849c-eca1932d30c2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:10.066895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:10.123664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4b65c-bbd9-47b4-849c-eca1932d30c2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:10.157941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce9569-f1d1-408a-b0e7-e96863e62d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:10.158537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce9569-f1d1-408a-b0e7-e96863e62d6c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:10.158814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce9569-f1d1-408a-b0e7-e96863e62d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:10.159087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce9569-f1d1-408a-b0e7-e96863e62d6c None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:10.159761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce9569-f1d1-408a-b0e7-e96863e62d6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:27:10.160066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce9569-f1d1-408a-b0e7-e96863e62d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:10.161432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce9569-f1d1-408a-b0e7-e96863e62d6c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:10.169447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 570/1157] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:27:10.175403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e1620-df14-42f5-ba14-99e80a465b8e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:10.275028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e1620-df14-42f5-ba14-99e80a465b8e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:10.307760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f555a49-1975-47b0-aa00-6e24a47ff8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:10.308381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555a49-1975-47b0-aa00-6e24a47ff8ee None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:10.308659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555a49-1975-47b0-aa00-6e24a47ff8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:10.308930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555a49-1975-47b0-aa00-6e24a47ff8ee None admin] PATH_INFO: `/v3/users/cacd164cd50e4fd386a44ab259f01ee7` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:10.310034 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f555a49-1975-47b0-aa00-6e24a47ff8ee None admin] RBAC: Authorizing `identity:get_user(user_id=cacd164cd50e4fd386a44ab259f01ee7)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:10.311468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f555a49-1975-47b0-aa00-6e24a47ff8ee None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:10.313087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 588/1158] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:27:10 2022] GET /identity/v3/users/cacd164cd50e4fd386a44ab259f01ee7 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:10.320027 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce9569-f1d1-408a-b0e7-e96863e62d6c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:10.419028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce9569-f1d1-408a-b0e7-e96863e62d6c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:10.421275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:10.454618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf1b9c-f4d7-47b1-91e3-6c3b27974996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:10.455273 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf1b9c-f4d7-47b1-91e3-6c3b27974996 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:10.455552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf1b9c-f4d7-47b1-91e3-6c3b27974996 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:10.455890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf1b9c-f4d7-47b1-91e3-6c3b27974996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:10.525769 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf1b9c-f4d7-47b1-91e3-6c3b27974996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:10.527205 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf1b9c-f4d7-47b1-91e3-6c3b27974996 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:10.627850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 571/1159] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:27:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:27:10.634844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f555a49-1975-47b0-aa00-6e24a47ff8ee None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:10.699570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:10.744214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f555a49-1975-47b0-aa00-6e24a47ff8ee None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:10.779564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8de3-a91c-4aaa-a123-5fc6c8045dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:10.780213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8de3-a91c-4aaa-a123-5fc6c8045dff None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:10.780494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8de3-a91c-4aaa-a123-5fc6c8045dff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:10.780775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8de3-a91c-4aaa-a123-5fc6c8045dff None admin] PATH_INFO: `/v3/projects/4e418a56071f459f87370933c9a16de1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:10.781898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca8de3-a91c-4aaa-a123-5fc6c8045dff None admin] RBAC: Authorizing `identity:get_project(project_id=4e418a56071f459f87370933c9a16de1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:10.783335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca8de3-a91c-4aaa-a123-5fc6c8045dff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:10.785008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 589/1160] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:27:10 2022] GET /identity/v3/projects/4e418a56071f459f87370933c9a16de1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:10.791538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf1b9c-f4d7-47b1-91e3-6c3b27974996 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:10.794688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:10.897891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf1b9c-f4d7-47b1-91e3-6c3b27974996 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:10.932226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278b214-15ba-4fbd-b040-fa225b06dca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:10.932808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278b214-15ba-4fbd-b040-fa225b06dca0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:10.933080 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278b214-15ba-4fbd-b040-fa225b06dca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:10.933345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278b214-15ba-4fbd-b040-fa225b06dca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:10.934059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278b214-15ba-4fbd-b040-fa225b06dca0 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=4e418a56071f459f87370933c9a16de1, user.id=cacd164cd50e4fd386a44ab259f01ee7) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:27:10.934357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278b214-15ba-4fbd-b040-fa225b06dca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:10.935855 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278b214-15ba-4fbd-b040-fa225b06dca0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:10.941602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 572/1161] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:27:10 2022] GET /identity/v3/role_assignments?user.id=cacd164cd50e4fd386a44ab259f01ee7&scope.project.id=4e418a56071f459f87370933c9a16de1&role.id=60abeefc9ac84e31a0162ac559220669 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:27:12.895117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305c17b-9507-45b3-8781-0ad9ab432a33 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:12.895701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305c17b-9507-45b3-8781-0ad9ab432a33 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:12.895701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305c17b-9507-45b3-8781-0ad9ab432a33 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:12.897072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 590/1162] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:27:12.902450 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1d55b-cf50-49bc-bac9-8c5814e6f60f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:12.902861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1d55b-cf50-49bc-bac9-8c5814e6f60f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:12.902996 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1d55b-cf50-49bc-bac9-8c5814e6f60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:12.921156 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5df1d55b-cf50-49bc-bac9-8c5814e6f60f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:27:12.922335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5df1d55b-cf50-49bc-bac9-8c5814e6f60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:27:12.981804 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:12.987040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 573/1163] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:27:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:27:13.259214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305c17b-9507-45b3-8781-0ad9ab432a33 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:13.359910 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305c17b-9507-45b3-8781-0ad9ab432a33 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:13.381385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:13.392649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddafa1-0900-478a-bf01-37dc8f3a10d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:13.393249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddafa1-0900-478a-bf01-37dc8f3a10d2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:13.393781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddafa1-0900-478a-bf01-37dc8f3a10d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:13.394054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddafa1-0900-478a-bf01-37dc8f3a10d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:13.467419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddafa1-0900-478a-bf01-37dc8f3a10d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:13.468911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddafa1-0900-478a-bf01-37dc8f3a10d2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:13.569985 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 591/1164] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:27:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:27:13.575898 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1d55b-cf50-49bc-bac9-8c5814e6f60f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:13.674279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1d55b-cf50-49bc-bac9-8c5814e6f60f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:13.707418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc984145-df8a-412e-a05a-5c30773b799b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:13.708059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc984145-df8a-412e-a05a-5c30773b799b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:13.708343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc984145-df8a-412e-a05a-5c30773b799b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:13.708616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc984145-df8a-412e-a05a-5c30773b799b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:13.716003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc984145-df8a-412e-a05a-5c30773b799b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:13.717434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc984145-df8a-412e-a05a-5c30773b799b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-bc984145-df8a-412e-a05a-5c30773b799b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:27:13.728515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:27:13.729644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:27:13.730678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 574/1165] 10.222.0.91 () {56 vars in 1117 bytes} [Wed Aug 24 10:27:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:27:13.735684 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddafa1-0900-478a-bf01-37dc8f3a10d2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:13.759429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:13.834586 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddafa1-0900-478a-bf01-37dc8f3a10d2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:13.868393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d047c4-410f-4c05-916b-6d7ee42d5b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:13.869001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d047c4-410f-4c05-916b-6d7ee42d5b9c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:13.869281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d047c4-410f-4c05-916b-6d7ee42d5b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:13.869553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d047c4-410f-4c05-916b-6d7ee42d5b9c None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:13.870193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d047c4-410f-4c05-916b-6d7ee42d5b9c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:27:13.870494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d047c4-410f-4c05-916b-6d7ee42d5b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:13.871897 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d047c4-410f-4c05-916b-6d7ee42d5b9c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:13.879152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 592/1166] 10.222.0.91 () {56 vars in 1115 bytes} [Wed Aug 24 10:27:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:15.789938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc3a7-ab7b-4c8e-8886-cd2838ac365e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:15.790488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc3a7-ab7b-4c8e-8886-cd2838ac365e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:15.790488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc3a7-ab7b-4c8e-8886-cd2838ac365e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:15.791848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 575/1167] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:27:15.796963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a039f-e390-4533-be63-2f4bbe12eefe None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:15.797369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a039f-e390-4533-be63-2f4bbe12eefe None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:15.797507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a039f-e390-4533-be63-2f4bbe12eefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:15.816772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1b8a039f-e390-4533-be63-2f4bbe12eefe None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:27:15.817937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1b8a039f-e390-4533-be63-2f4bbe12eefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:27:15.886291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 593/1168] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:27:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:27:16.154734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc3a7-ab7b-4c8e-8886-cd2838ac365e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:16.214258 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:16.256447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc3a7-ab7b-4c8e-8886-cd2838ac365e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:16.291277 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ea72b-2634-43e6-8d56-499efceb6df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:16.291892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ea72b-2634-43e6-8d56-499efceb6df2 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:16.292174 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ea72b-2634-43e6-8d56-499efceb6df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:16.292451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ea72b-2634-43e6-8d56-499efceb6df2 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:16.293114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ea72b-2634-43e6-8d56-499efceb6df2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:16.294465 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ea72b-2634-43e6-8d56-499efceb6df2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:16.362246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 576/1169] 10.222.0.91 () {60 vars in 1138 bytes} [Wed Aug 24 10:27:16 2022] POST /identity/v3/domains => generated 267 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:27:18.298191 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e090d-5413-41b6-af21-f2a720353e8e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:18.298746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e090d-5413-41b6-af21-f2a720353e8e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:18.298746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e090d-5413-41b6-af21-f2a720353e8e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:18.300086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 594/1170] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:27:18.305554 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebe209-ac4b-4292-89b2-9c0e2c0df29d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:18.305995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebe209-ac4b-4292-89b2-9c0e2c0df29d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:18.306111 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebe209-ac4b-4292-89b2-9c0e2c0df29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:18.324292 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-33ebe209-ac4b-4292-89b2-9c0e2c0df29d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:27:18.325464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-33ebe209-ac4b-4292-89b2-9c0e2c0df29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:27:18.392728 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 577/1171] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:27:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:27:18.662954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e090d-5413-41b6-af21-f2a720353e8e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:18.682004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:18.766181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e090d-5413-41b6-af21-f2a720353e8e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:18.799254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881a412-6dc2-4ecf-b9f5-9e8d3cb4c9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:18.799901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881a412-6dc2-4ecf-b9f5-9e8d3cb4c9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:18.800179 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881a412-6dc2-4ecf-b9f5-9e8d3cb4c9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:18.800448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881a412-6dc2-4ecf-b9f5-9e8d3cb4c9e6 None admin] PATH_INFO: `/v3/domains/20c80afc615c41139e6a2a19afc38dbb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:18.811136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881a412-6dc2-4ecf-b9f5-9e8d3cb4c9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=20c80afc615c41139e6a2a19afc38dbb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:18.812608 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881a412-6dc2-4ecf-b9f5-9e8d3cb4c9e6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:18.814193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 595/1172] 10.222.0.91 () {56 vars in 1183 bytes} [Wed Aug 24 10:27:18 2022] GET /identity/v3/domains/20c80afc615c41139e6a2a19afc38dbb => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:18.820744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebe209-ac4b-4292-89b2-9c0e2c0df29d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:18.869003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:18.918734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebe209-ac4b-4292-89b2-9c0e2c0df29d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:18.951092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15daa0-6e97-4b83-a1de-146416a12ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:18.951689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15daa0-6e97-4b83-a1de-146416a12ef1 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:18.951996 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15daa0-6e97-4b83-a1de-146416a12ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:18.952267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15daa0-6e97-4b83-a1de-146416a12ef1 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:18.952905 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15daa0-6e97-4b83-a1de-146416a12ef1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:18.954430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15daa0-6e97-4b83-a1de-146416a12ef1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:19.063916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 578/1173] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:27:18 2022] POST /identity/v3/projects => generated 361 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:27:20.991224 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10f9ce-84bc-4a88-becb-7c8d5ee97b42 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:20.991805 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10f9ce-84bc-4a88-becb-7c8d5ee97b42 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:20.991805 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10f9ce-84bc-4a88-becb-7c8d5ee97b42 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:20.993119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 596/1174] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:27:20.998524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c8ed-4d42-4268-a21c-4fb9ac6c5829 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:20.998935 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c8ed-4d42-4268-a21c-4fb9ac6c5829 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:20.999081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c8ed-4d42-4268-a21c-4fb9ac6c5829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:21.016737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ac15c8ed-4d42-4268-a21c-4fb9ac6c5829 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:27:21.017919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ac15c8ed-4d42-4268-a21c-4fb9ac6c5829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:27:21.083387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 579/1175] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:27:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:27:21.353611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10f9ce-84bc-4a88-becb-7c8d5ee97b42 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:21.432218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:21.455741 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10f9ce-84bc-4a88-becb-7c8d5ee97b42 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:21.489556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d2e68-84a4-4e53-b9bb-314cf882b40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:21.490172 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d2e68-84a4-4e53-b9bb-314cf882b40f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:21.491096 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d2e68-84a4-4e53-b9bb-314cf882b40f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:21.491365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d2e68-84a4-4e53-b9bb-314cf882b40f None admin] PATH_INFO: `/v3/domains/20c80afc615c41139e6a2a19afc38dbb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:21.492507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d2e68-84a4-4e53-b9bb-314cf882b40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=20c80afc615c41139e6a2a19afc38dbb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:21.493927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d2e68-84a4-4e53-b9bb-314cf882b40f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:21.495494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 597/1176] 10.222.0.91 () {56 vars in 1183 bytes} [Wed Aug 24 10:27:21 2022] GET /identity/v3/domains/20c80afc615c41139e6a2a19afc38dbb => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:21.501291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15c8ed-4d42-4268-a21c-4fb9ac6c5829 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:21.531141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:21.600204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15c8ed-4d42-4268-a21c-4fb9ac6c5829 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:21.634024 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bd10c-23bf-4e4d-9cb7-954edcb2b66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:21.634621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bd10c-23bf-4e4d-9cb7-954edcb2b66a None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:21.634900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bd10c-23bf-4e4d-9cb7-954edcb2b66a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:21.635172 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bd10c-23bf-4e4d-9cb7-954edcb2b66a None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:21.635847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bd10c-23bf-4e4d-9cb7-954edcb2b66a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:21.637283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bd10c-23bf-4e4d-9cb7-954edcb2b66a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:21.726866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 580/1177] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:27:21 2022] POST /identity/v3/users => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:27:23.684415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa2e3-ffca-4cda-96bd-aa490986ed42 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:23.684934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa2e3-ffca-4cda-96bd-aa490986ed42 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:23.684934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa2e3-ffca-4cda-96bd-aa490986ed42 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:23.686260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 598/1178] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:27:23.691811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b5b15-2351-4fdb-8911-7647e105769d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:23.692259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b5b15-2351-4fdb-8911-7647e105769d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:23.692504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b5b15-2351-4fdb-8911-7647e105769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:23.711604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-410b5b15-2351-4fdb-8911-7647e105769d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:27:23.712812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-410b5b15-2351-4fdb-8911-7647e105769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:27:23.781649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 581/1179] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:27:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:27:24.053780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa2e3-ffca-4cda-96bd-aa490986ed42 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:24.157221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa2e3-ffca-4cda-96bd-aa490986ed42 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:24.191209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f731da7-bd37-44c0-a08f-9ffdac7ed03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:24.191876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731da7-bd37-44c0-a08f-9ffdac7ed03a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:24.192160 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731da7-bd37-44c0-a08f-9ffdac7ed03a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:24.192431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731da7-bd37-44c0-a08f-9ffdac7ed03a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:24.203139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f731da7-bd37-44c0-a08f-9ffdac7ed03a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-1f731da7-bd37-44c0-a08f-9ffdac7ed03a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:27:24.207871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:27:24.209054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:27:24.210605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 599/1180] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:27:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:27:24.215037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b5b15-2351-4fdb-8911-7647e105769d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:24.232871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:24.316603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b5b15-2351-4fdb-8911-7647e105769d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:24.351156 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beade99b-8fac-4899-a108-5c99731d90a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:24.351793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beade99b-8fac-4899-a108-5c99731d90a3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:24.352076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beade99b-8fac-4899-a108-5c99731d90a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:24.352349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beade99b-8fac-4899-a108-5c99731d90a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:24.353013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beade99b-8fac-4899-a108-5c99731d90a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:27:24.353315 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beade99b-8fac-4899-a108-5c99731d90a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:24.354690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beade99b-8fac-4899-a108-5c99731d90a3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:24.363105 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 582/1181] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:27:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:24.369835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f731da7-bd37-44c0-a08f-9ffdac7ed03a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:24.373625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:24.473034 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f731da7-bd37-44c0-a08f-9ffdac7ed03a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:24.507019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d22375-15d0-4850-8b83-741e6b6615b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:24.507648 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d22375-15d0-4850-8b83-741e6b6615b5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:24.507960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d22375-15d0-4850-8b83-741e6b6615b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:24.508236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d22375-15d0-4850-8b83-741e6b6615b5 None admin] PATH_INFO: `/v3/users/b179a36ea51f434db70b0f24f8a33854` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:24.522447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d22375-15d0-4850-8b83-741e6b6615b5 None admin] RBAC: Authorizing `identity:get_user(user_id=b179a36ea51f434db70b0f24f8a33854)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:24.523927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d22375-15d0-4850-8b83-741e6b6615b5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:24.525579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 600/1182] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:27:24 2022] GET /identity/v3/users/b179a36ea51f434db70b0f24f8a33854 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:24.536073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beade99b-8fac-4899-a108-5c99731d90a3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:24.617560 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:24.638553 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beade99b-8fac-4899-a108-5c99731d90a3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:24.672936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed205e-7833-43cc-9a51-3700571549ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:24.673526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed205e-7833-43cc-9a51-3700571549ec None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:24.673799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed205e-7833-43cc-9a51-3700571549ec None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:24.674062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed205e-7833-43cc-9a51-3700571549ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:24.744667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed205e-7833-43cc-9a51-3700571549ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:24.746246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed205e-7833-43cc-9a51-3700571549ec None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:24.822986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:24.844977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 583/1183] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:27:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:27:24.851354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d22375-15d0-4850-8b83-741e6b6615b5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:24.914414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:24.958174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d22375-15d0-4850-8b83-741e6b6615b5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:24.994864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590ecac-43ad-4efe-987d-41ced43aceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:24.995485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590ecac-43ad-4efe-987d-41ced43aceb5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:24.995789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590ecac-43ad-4efe-987d-41ced43aceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:24.996064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590ecac-43ad-4efe-987d-41ced43aceb5 None admin] PATH_INFO: `/v3/projects/76c9ba45462f442d861722b1728f19c8` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:24.997178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590ecac-43ad-4efe-987d-41ced43aceb5 None admin] RBAC: Authorizing `identity:get_project(project_id=76c9ba45462f442d861722b1728f19c8)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:24.998613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590ecac-43ad-4efe-987d-41ced43aceb5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:25.000265 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 601/1184] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:27:24 2022] GET /identity/v3/projects/76c9ba45462f442d861722b1728f19c8 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:25.007075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed205e-7833-43cc-9a51-3700571549ec None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:25.114414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed205e-7833-43cc-9a51-3700571549ec None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:25.152370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df26bfa-ed7e-4ae7-8ca1-5982ac775f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:25.153975 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26bfa-ed7e-4ae7-8ca1-5982ac775f75 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:25.154256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26bfa-ed7e-4ae7-8ca1-5982ac775f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:25.154526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26bfa-ed7e-4ae7-8ca1-5982ac775f75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:25.155677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df26bfa-ed7e-4ae7-8ca1-5982ac775f75 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=76c9ba45462f442d861722b1728f19c8, user.id=b179a36ea51f434db70b0f24f8a33854) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:27:25.156009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df26bfa-ed7e-4ae7-8ca1-5982ac775f75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:25.159319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df26bfa-ed7e-4ae7-8ca1-5982ac775f75 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:25.170141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 584/1185] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:27:25 2022] GET /identity/v3/role_assignments?user.id=b179a36ea51f434db70b0f24f8a33854&scope.project.id=76c9ba45462f442d861722b1728f19c8&role.id=60abeefc9ac84e31a0162ac559220669 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:27.209256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0d3e0-1b6c-48ee-82ea-8848d0dd714f None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:27.209828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0d3e0-1b6c-48ee-82ea-8848d0dd714f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:27.209828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0d3e0-1b6c-48ee-82ea-8848d0dd714f None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:27.211145 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 602/1186] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:27:27.216695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdabb2-55f9-4c5b-8790-62e12c8b22b9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:27.217144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdabb2-55f9-4c5b-8790-62e12c8b22b9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:27.217236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdabb2-55f9-4c5b-8790-62e12c8b22b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:27.235847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a2cdabb2-55f9-4c5b-8790-62e12c8b22b9 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:27:27.237047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a2cdabb2-55f9-4c5b-8790-62e12c8b22b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:27:27.272899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:27.305776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 585/1187] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:27:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:27:27.585031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0d3e0-1b6c-48ee-82ea-8848d0dd714f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:27.692440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0d3e0-1b6c-48ee-82ea-8848d0dd714f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:27.720888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:27.727236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95c787-4c6c-466d-b9f3-c0e0f8a7afed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:27.727904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95c787-4c6c-466d-b9f3-c0e0f8a7afed None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:27.728185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95c787-4c6c-466d-b9f3-c0e0f8a7afed None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:27.728454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95c787-4c6c-466d-b9f3-c0e0f8a7afed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:27.738511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95c787-4c6c-466d-b9f3-c0e0f8a7afed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-da95c787-4c6c-466d-b9f3-c0e0f8a7afed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:27:27.743494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:27:27.744537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:27:27.745382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 603/1188] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:27:27.751160 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdabb2-55f9-4c5b-8790-62e12c8b22b9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:27.852277 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdabb2-55f9-4c5b-8790-62e12c8b22b9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:27.887278 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6e352-9f64-4a3b-8684-2c31104b7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:27.887952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6e352-9f64-4a3b-8684-2c31104b7171 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:27.888236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6e352-9f64-4a3b-8684-2c31104b7171 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:27.888510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6e352-9f64-4a3b-8684-2c31104b7171 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:27.889177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6e352-9f64-4a3b-8684-2c31104b7171 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:27:27.889479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6e352-9f64-4a3b-8684-2c31104b7171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:27.890936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6e352-9f64-4a3b-8684-2c31104b7171 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:27.903170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 586/1189] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:27:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:27.909176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95c787-4c6c-466d-b9f3-c0e0f8a7afed None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:28.017045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95c787-4c6c-466d-b9f3-c0e0f8a7afed None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:28.053098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdf8d1-0ebe-48b8-a927-534d597800a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:28.053732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdf8d1-0ebe-48b8-a927-534d597800a2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:28.054015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdf8d1-0ebe-48b8-a927-534d597800a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:28.054289 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdf8d1-0ebe-48b8-a927-534d597800a2 None admin] PATH_INFO: `/v3/users/b179a36ea51f434db70b0f24f8a33854` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:28.055429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdf8d1-0ebe-48b8-a927-534d597800a2 None admin] RBAC: Authorizing `identity:get_user(user_id=b179a36ea51f434db70b0f24f8a33854)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:28.056899 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdf8d1-0ebe-48b8-a927-534d597800a2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:28.058491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 604/1190] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:27:27 2022] GET /identity/v3/users/b179a36ea51f434db70b0f24f8a33854 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:28.064730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6e352-9f64-4a3b-8684-2c31104b7171 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:28.100570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:28.167700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6e352-9f64-4a3b-8684-2c31104b7171 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:28.201862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62722316-9521-4f80-9749-84f9d851e80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:28.202483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62722316-9521-4f80-9749-84f9d851e80d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:28.202760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62722316-9521-4f80-9749-84f9d851e80d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:28.203034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62722316-9521-4f80-9749-84f9d851e80d None admin] PATH_INFO: `/v3/projects/76c9ba45462f442d861722b1728f19c8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:28.204170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62722316-9521-4f80-9749-84f9d851e80d None admin] RBAC: Authorizing `identity:get_project(project_id=76c9ba45462f442d861722b1728f19c8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:28.205599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62722316-9521-4f80-9749-84f9d851e80d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:28.207229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 587/1191] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:27:28 2022] GET /identity/v3/projects/76c9ba45462f442d861722b1728f19c8 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:28.214176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdf8d1-0ebe-48b8-a927-534d597800a2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:28.273582 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:28.314887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdf8d1-0ebe-48b8-a927-534d597800a2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:28.349498 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b62f36-43a2-44ca-918a-21175c6c515b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:28.350128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b62f36-43a2-44ca-918a-21175c6c515b None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:28.350404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b62f36-43a2-44ca-918a-21175c6c515b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:28.350676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b62f36-43a2-44ca-918a-21175c6c515b None admin] PATH_INFO: `/v3/projects/76c9ba45462f442d861722b1728f19c8/users/b179a36ea51f434db70b0f24f8a33854/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:28.352642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b62f36-43a2-44ca-918a-21175c6c515b None admin] RBAC: Authorizing `identity:create_grant(project_id=76c9ba45462f442d861722b1728f19c8, user_id=b179a36ea51f434db70b0f24f8a33854, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:28.354091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b62f36-43a2-44ca-918a-21175c6c515b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:28.435178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 605/1192] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:27:28 2022] PUT /identity/v3/projects/76c9ba45462f442d861722b1728f19c8/users/b179a36ea51f434db70b0f24f8a33854/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:27:30.359645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b71349-e77c-453e-8753-ea5cb6e9763a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:30.360241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b71349-e77c-453e-8753-ea5cb6e9763a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:30.360241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b71349-e77c-453e-8753-ea5cb6e9763a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:30.361564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 588/1193] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:27:30.367578 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37426f-dd1c-4d27-86dd-af5880f03935 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:30.368078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37426f-dd1c-4d27-86dd-af5880f03935 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:30.368168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37426f-dd1c-4d27-86dd-af5880f03935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:30.385904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-cb37426f-dd1c-4d27-86dd-af5880f03935 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:27:30.387140 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cb37426f-dd1c-4d27-86dd-af5880f03935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:27:30.456132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 606/1194] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:27:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:27:30.731967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b71349-e77c-453e-8753-ea5cb6e9763a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:30.837285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b71349-e77c-453e-8753-ea5cb6e9763a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:30.841550 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:30.872746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dc6d1-9f50-4b32-baec-9b4b434268e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:30.873403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dc6d1-9f50-4b32-baec-9b4b434268e4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:30.873674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dc6d1-9f50-4b32-baec-9b4b434268e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:30.873942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dc6d1-9f50-4b32-baec-9b4b434268e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:30.885306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48dc6d1-9f50-4b32-baec-9b4b434268e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b48dc6d1-9f50-4b32-baec-9b4b434268e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:27:30.890146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:27:30.891288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:27:30.892481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 589/1195] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:27:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:27:30.898695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37426f-dd1c-4d27-86dd-af5880f03935 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:30.948256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:30.999941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37426f-dd1c-4d27-86dd-af5880f03935 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:31.035486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca93866-2e74-41a6-be37-06981d0bbc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:31.036148 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca93866-2e74-41a6-be37-06981d0bbc33 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:31.036431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca93866-2e74-41a6-be37-06981d0bbc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:31.036704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca93866-2e74-41a6-be37-06981d0bbc33 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:31.038000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca93866-2e74-41a6-be37-06981d0bbc33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:27:31.038393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca93866-2e74-41a6-be37-06981d0bbc33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:31.039793 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca93866-2e74-41a6-be37-06981d0bbc33 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:31.048314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 607/1196] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:27:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:31.054940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dc6d1-9f50-4b32-baec-9b4b434268e4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:31.155115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dc6d1-9f50-4b32-baec-9b4b434268e4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:31.189355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4010c7b-9c26-4060-9f23-b3101e82cc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:31.189973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4010c7b-9c26-4060-9f23-b3101e82cc41 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:31.190256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4010c7b-9c26-4060-9f23-b3101e82cc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:31.190531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4010c7b-9c26-4060-9f23-b3101e82cc41 None admin] PATH_INFO: `/v3/users/b179a36ea51f434db70b0f24f8a33854` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:31.191691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4010c7b-9c26-4060-9f23-b3101e82cc41 None admin] RBAC: Authorizing `identity:get_user(user_id=b179a36ea51f434db70b0f24f8a33854)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:31.193236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4010c7b-9c26-4060-9f23-b3101e82cc41 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:31.194989 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 590/1197] 10.222.0.91 () {56 vars in 1177 bytes} [Wed Aug 24 10:27:31 2022] GET /identity/v3/users/b179a36ea51f434db70b0f24f8a33854 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:27:31.202227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca93866-2e74-41a6-be37-06981d0bbc33 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:31.304278 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca93866-2e74-41a6-be37-06981d0bbc33 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:31.315011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:31.338370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbac564-bd78-4332-9a82-7c0239fb643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:31.338975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbac564-bd78-4332-9a82-7c0239fb643c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:31.339253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbac564-bd78-4332-9a82-7c0239fb643c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:31.339525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbac564-bd78-4332-9a82-7c0239fb643c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:31.408879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbac564-bd78-4332-9a82-7c0239fb643c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:31.410370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbac564-bd78-4332-9a82-7c0239fb643c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:31.508844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 608/1198] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:27:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:27:31.514828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4010c7b-9c26-4060-9f23-b3101e82cc41 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:31.556333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:31.626018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4010c7b-9c26-4060-9f23-b3101e82cc41 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:31.660189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fa36e-6944-4712-81fc-a65bdf91f2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:31.660811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fa36e-6944-4712-81fc-a65bdf91f2cc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:31.661092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fa36e-6944-4712-81fc-a65bdf91f2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:31.661365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fa36e-6944-4712-81fc-a65bdf91f2cc None admin] PATH_INFO: `/v3/projects/76c9ba45462f442d861722b1728f19c8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:31.662680 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fa36e-6944-4712-81fc-a65bdf91f2cc None admin] RBAC: Authorizing `identity:get_project(project_id=76c9ba45462f442d861722b1728f19c8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:31.664161 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fa36e-6944-4712-81fc-a65bdf91f2cc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:31.665796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 591/1199] 10.222.0.91 () {56 vars in 1186 bytes} [Wed Aug 24 10:27:31 2022] GET /identity/v3/projects/76c9ba45462f442d861722b1728f19c8 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:31.672264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbac564-bd78-4332-9a82-7c0239fb643c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:27:31.683893 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:31.770834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbac564-bd78-4332-9a82-7c0239fb643c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:27:31.807440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554d667-6353-48e5-a5c4-39a4fe1ccc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:27:31.807980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554d667-6353-48e5-a5c4-39a4fe1ccc33 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:27:31.808255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554d667-6353-48e5-a5c4-39a4fe1ccc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:27:31.808519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554d667-6353-48e5-a5c4-39a4fe1ccc33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:27:31.809225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554d667-6353-48e5-a5c4-39a4fe1ccc33 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=76c9ba45462f442d861722b1728f19c8, user.id=b179a36ea51f434db70b0f24f8a33854) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:27:31.809524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554d667-6353-48e5-a5c4-39a4fe1ccc33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:27:31.810946 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554d667-6353-48e5-a5c4-39a4fe1ccc33 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:27:31.816724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 609/1200] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:27:31 2022] GET /identity/v3/role_assignments?user.id=b179a36ea51f434db70b0f24f8a33854&scope.project.id=76c9ba45462f442d861722b1728f19c8&role.id=60abeefc9ac84e31a0162ac559220669 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:27:41.656054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=51 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:41.814077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=63 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:46.575144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130df34-e2f6-4376-9ad8-e2cf6cdbe37b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:46.575744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130df34-e2f6-4376-9ad8-e2cf6cdbe37b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:46.575744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130df34-e2f6-4376-9ad8-e2cf6cdbe37b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:46.577056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 592/1201] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:28:46.582531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3fc1-9c59-4bba-8844-886c760ff2b3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:46.583098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3fc1-9c59-4bba-8844-886c760ff2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:46.583098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3fc1-9c59-4bba-8844-886c760ff2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:46.603594 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7cae3fc1-9c59-4bba-8844-886c760ff2b3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:46.604762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7cae3fc1-9c59-4bba-8844-886c760ff2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:46.676053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 610/1202] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:28:46.954736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130df34-e2f6-4376-9ad8-e2cf6cdbe37b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:47.066850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130df34-e2f6-4376-9ad8-e2cf6cdbe37b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:47.104972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451dc87-6589-4524-a27d-d77c61c2e6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:47.105696 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451dc87-6589-4524-a27d-d77c61c2e6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:47.105977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451dc87-6589-4524-a27d-d77c61c2e6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:47.106250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451dc87-6589-4524-a27d-d77c61c2e6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:47.118676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451dc87-6589-4524-a27d-d77c61c2e6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:47.120269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451dc87-6589-4524-a27d-d77c61c2e6d2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2451dc87-6589-4524-a27d-d77c61c2e6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:28:47.138093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:47.142472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:28:47.143753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:28:47.143753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:47.143753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:28:47.143753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 593/1203] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:28:47.145903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3fc1-9c59-4bba-8844-886c760ff2b3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:47.245320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3fc1-9c59-4bba-8844-886c760ff2b3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:47.274055 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:47.279634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1d5fa-b316-41b9-9a71-559ed80a1aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:47.280286 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1d5fa-b316-41b9-9a71-559ed80a1aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:47.280559 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1d5fa-b316-41b9-9a71-559ed80a1aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:47.280827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1d5fa-b316-41b9-9a71-559ed80a1aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:47.281449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1d5fa-b316-41b9-9a71-559ed80a1aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:47.281746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1d5fa-b316-41b9-9a71-559ed80a1aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:47.283105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1d5fa-b316-41b9-9a71-559ed80a1aa1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:47.295113 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 611/1204] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:47.302554 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451dc87-6589-4524-a27d-d77c61c2e6d2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:47.358258 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:47.405848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451dc87-6589-4524-a27d-d77c61c2e6d2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:47.439958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e96d4-d4a8-4927-81a3-8765620d5522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:47.440676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e96d4-d4a8-4927-81a3-8765620d5522 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:47.440952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e96d4-d4a8-4927-81a3-8765620d5522 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:47.441222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e96d4-d4a8-4927-81a3-8765620d5522 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:47.441857 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e96d4-d4a8-4927-81a3-8765620d5522 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:47.443285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e96d4-d4a8-4927-81a3-8765620d5522 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:47.531010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 594/1205] 10.222.0.91 () {60 vars in 1132 bytes} [Wed Aug 24 10:28:47 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:28:49.544596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d18e5-f71c-4fe9-8bf2-9505c2f2fca5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:49.545150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d18e5-f71c-4fe9-8bf2-9505c2f2fca5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:49.545150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d18e5-f71c-4fe9-8bf2-9505c2f2fca5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:49.546599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 612/1206] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:28:49.552299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba8da-a951-4287-b2fb-87061f4ea6db None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:49.552752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba8da-a951-4287-b2fb-87061f4ea6db None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:49.552864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba8da-a951-4287-b2fb-87061f4ea6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:49.571988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-307ba8da-a951-4287-b2fb-87061f4ea6db None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:49.573346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-307ba8da-a951-4287-b2fb-87061f4ea6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:49.642936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 595/1207] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:28:49.920708 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d18e5-f71c-4fe9-8bf2-9505c2f2fca5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:50.029880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d18e5-f71c-4fe9-8bf2-9505c2f2fca5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:50.065008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f833bb-63fb-4b79-84a5-9730d9acc1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:50.066523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f833bb-63fb-4b79-84a5-9730d9acc1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:50.066812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f833bb-63fb-4b79-84a5-9730d9acc1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:50.067084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f833bb-63fb-4b79-84a5-9730d9acc1d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:50.077835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f833bb-63fb-4b79-84a5-9730d9acc1d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f8f833bb-63fb-4b79-84a5-9730d9acc1d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:28:50.083230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:50.088737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:28:50.089829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 613/1208] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:28:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:28:50.090616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ba8da-a951-4287-b2fb-87061f4ea6db None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:50.131882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:50.197769 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ba8da-a951-4287-b2fb-87061f4ea6db None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:50.235207 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c384e0-ebc2-467a-9656-8378a443d6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:50.235832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c384e0-ebc2-467a-9656-8378a443d6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:50.236110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c384e0-ebc2-467a-9656-8378a443d6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:50.236438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c384e0-ebc2-467a-9656-8378a443d6e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:50.237623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c384e0-ebc2-467a-9656-8378a443d6e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:50.238002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c384e0-ebc2-467a-9656-8378a443d6e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:50.239382 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c384e0-ebc2-467a-9656-8378a443d6e1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:50.247762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 596/1209] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:28:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:50.256192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f833bb-63fb-4b79-84a5-9730d9acc1d2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:50.310483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:50.369658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f833bb-63fb-4b79-84a5-9730d9acc1d2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:50.413313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd47b1-0d49-425a-84a4-73da7d21089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:50.413939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd47b1-0d49-425a-84a4-73da7d21089e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:50.414214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd47b1-0d49-425a-84a4-73da7d21089e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:50.414481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd47b1-0d49-425a-84a4-73da7d21089e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:50.426411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd47b1-0d49-425a-84a4-73da7d21089e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:50.428039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd47b1-0d49-425a-84a4-73da7d21089e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-92bd47b1-0d49-425a-84a4-73da7d21089e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:28:50.443555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:50.450270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:28:50.451481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:28:50.451481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:50.451481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:28:50.451481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 614/1210] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:28:50.453082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c384e0-ebc2-467a-9656-8378a443d6e1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:50.584121 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:50.587143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c384e0-ebc2-467a-9656-8378a443d6e1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:50.624741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f825781-1c82-43ef-be43-6e83ff636a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:50.625404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f825781-1c82-43ef-be43-6e83ff636a6f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:50.625704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f825781-1c82-43ef-be43-6e83ff636a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:50.626018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f825781-1c82-43ef-be43-6e83ff636a6f None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:50.626810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f825781-1c82-43ef-be43-6e83ff636a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:50.627125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f825781-1c82-43ef-be43-6e83ff636a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:50.628691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f825781-1c82-43ef-be43-6e83ff636a6f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:50.641235 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 597/1211] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:50.647929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd47b1-0d49-425a-84a4-73da7d21089e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:50.757029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd47b1-0d49-425a-84a4-73da7d21089e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:50.758733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:50.794175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9612e4-701a-43b6-b856-52ba956b3302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:50.794806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9612e4-701a-43b6-b856-52ba956b3302 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:50.795088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9612e4-701a-43b6-b856-52ba956b3302 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:50.795357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9612e4-701a-43b6-b856-52ba956b3302 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:50.803288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9612e4-701a-43b6-b856-52ba956b3302 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:50.804940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9612e4-701a-43b6-b856-52ba956b3302 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4e9612e4-701a-43b6-b856-52ba956b3302 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:28:50.817816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:50.819687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:50.821409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:50.821409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:50.821409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:28:50.821409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:28:50.821409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:28:50.821409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:28:50.821409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:28:50.821409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:28:50.821409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:28:50.821409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:28:50.821409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 615/1212] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:28:50.824983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f825781-1c82-43ef-be43-6e83ff636a6f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:50.957386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f825781-1c82-43ef-be43-6e83ff636a6f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:51.003821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea75ec-65f7-49c8-a26a-ce7af752e853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:51.004842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea75ec-65f7-49c8-a26a-ce7af752e853 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:51.005270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea75ec-65f7-49c8-a26a-ce7af752e853 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:51.005710 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea75ec-65f7-49c8-a26a-ce7af752e853 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:51.006702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea75ec-65f7-49c8-a26a-ce7af752e853 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:51.007113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea75ec-65f7-49c8-a26a-ce7af752e853 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:51.008628 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea75ec-65f7-49c8-a26a-ce7af752e853 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:51.029754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 598/1213] 10.222.0.91 () {56 vars in 1143 bytes} [Wed Aug 24 10:28:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:51.035926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9612e4-701a-43b6-b856-52ba956b3302 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:51.167997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9612e4-701a-43b6-b856-52ba956b3302 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:51.215035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa9147-111f-44b1-98dd-6b1e9e90ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:51.215664 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa9147-111f-44b1-98dd-6b1e9e90ca13 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:51.215947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa9147-111f-44b1-98dd-6b1e9e90ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:51.216307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa9147-111f-44b1-98dd-6b1e9e90ca13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:51.248678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:51.289065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa9147-111f-44b1-98dd-6b1e9e90ca13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:51.290426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa9147-111f-44b1-98dd-6b1e9e90ca13 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:51.403226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 616/1214] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:28:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:28:51.412389 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea75ec-65f7-49c8-a26a-ce7af752e853 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:51.433998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:51.544824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea75ec-65f7-49c8-a26a-ce7af752e853 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:51.602807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495ff82-2a13-4492-b7d1-c5788154e031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:51.603556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495ff82-2a13-4492-b7d1-c5788154e031 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:51.603705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495ff82-2a13-4492-b7d1-c5788154e031 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:51.604002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495ff82-2a13-4492-b7d1-c5788154e031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:51.620958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495ff82-2a13-4492-b7d1-c5788154e031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:51.622623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495ff82-2a13-4492-b7d1-c5788154e031 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9495ff82-2a13-4492-b7d1-c5788154e031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:28:51.639441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:51.645865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:28:51.646902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:28:51.646902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:51.646902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:28:51.646902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 599/1215] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:28:51.648677 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa9147-111f-44b1-98dd-6b1e9e90ca13 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:51.735093 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:51.796857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa9147-111f-44b1-98dd-6b1e9e90ca13 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:51.834199 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6861d-1848-4ba2-998e-f3f76baad064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:51.834899 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6861d-1848-4ba2-998e-f3f76baad064 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:51.835077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6861d-1848-4ba2-998e-f3f76baad064 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:51.835334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6861d-1848-4ba2-998e-f3f76baad064 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:51.835993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6861d-1848-4ba2-998e-f3f76baad064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:51.836288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6861d-1848-4ba2-998e-f3f76baad064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:51.837743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6861d-1848-4ba2-998e-f3f76baad064 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:51.856561 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 617/1216] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:28:51.859243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495ff82-2a13-4492-b7d1-c5788154e031 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:51.967840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:52.009237 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495ff82-2a13-4492-b7d1-c5788154e031 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:52.060604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055f699-a0d7-4f48-91e1-cfda4d6e2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:52.061161 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055f699-a0d7-4f48-91e1-cfda4d6e2d69 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.061498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055f699-a0d7-4f48-91e1-cfda4d6e2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.061798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055f699-a0d7-4f48-91e1-cfda4d6e2d69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.073769 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055f699-a0d7-4f48-91e1-cfda4d6e2d69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:52.075488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055f699-a0d7-4f48-91e1-cfda4d6e2d69 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9055f699-a0d7-4f48-91e1-cfda4d6e2d69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:28:52.093942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:52.095206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:52.096965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:28:52.096965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:28:52.096965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:28:52.096965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:28:52.096965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:28:52.096965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:28:52.096965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:28:52.096965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:28:52.096965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 600/1217] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:28:52.103776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6861d-1848-4ba2-998e-f3f76baad064 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:52.214789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6861d-1848-4ba2-998e-f3f76baad064 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:52.250562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:52.266763 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6245a8-1659-4a0b-9ba8-d4dd4e433d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:52.267438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6245a8-1659-4a0b-9ba8-d4dd4e433d6a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.267741 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6245a8-1659-4a0b-9ba8-d4dd4e433d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.268114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6245a8-1659-4a0b-9ba8-d4dd4e433d6a None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.269770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6245a8-1659-4a0b-9ba8-d4dd4e433d6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:52.270072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6245a8-1659-4a0b-9ba8-d4dd4e433d6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:52.272034 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6245a8-1659-4a0b-9ba8-d4dd4e433d6a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:52.290802 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 618/1218] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:52.298305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055f699-a0d7-4f48-91e1-cfda4d6e2d69 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:52.449370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055f699-a0d7-4f48-91e1-cfda4d6e2d69 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:52.483133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:52.493005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae581b-4a1b-4290-af70-8de78ef8caea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:52.493433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae581b-4a1b-4290-af70-8de78ef8caea None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.493625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae581b-4a1b-4290-af70-8de78ef8caea None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.493959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae581b-4a1b-4290-af70-8de78ef8caea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.494678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae581b-4a1b-4290-af70-8de78ef8caea None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=8ebfb233b2504463a4ee9202b5a3ab50) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:52.494984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae581b-4a1b-4290-af70-8de78ef8caea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:52.496449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae581b-4a1b-4290-af70-8de78ef8caea None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:52.505755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 601/1219] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:28:52 2022] GET /identity/v3/role_assignments?user.id=8ebfb233b2504463a4ee9202b5a3ab50&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:54.541043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b936bb-0f55-4cb3-b275-2fae830f5a8a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:54.541569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b936bb-0f55-4cb3-b275-2fae830f5a8a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:54.541569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b936bb-0f55-4cb3-b275-2fae830f5a8a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:54.543016 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 619/1220] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:28:54.548365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf8431-22ff-4ca2-a787-e2009c84f6a1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:54.549191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf8431-22ff-4ca2-a787-e2009c84f6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:54.549191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf8431-22ff-4ca2-a787-e2009c84f6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:54.569095 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cbcf8431-22ff-4ca2-a787-e2009c84f6a1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:54.570537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cbcf8431-22ff-4ca2-a787-e2009c84f6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:54.645692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 602/1221] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:28:54.921251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b936bb-0f55-4cb3-b275-2fae830f5a8a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:55.032681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b936bb-0f55-4cb3-b275-2fae830f5a8a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:55.071604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e57254-d849-49e1-8c88-ce13ffb5f0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:55.072260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e57254-d849-49e1-8c88-ce13ffb5f0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:55.072541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e57254-d849-49e1-8c88-ce13ffb5f0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:55.072806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e57254-d849-49e1-8c88-ce13ffb5f0b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:55.083631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e57254-d849-49e1-8c88-ce13ffb5f0b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f6e57254-d849-49e1-8c88-ce13ffb5f0b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:28:55.088521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:55.089787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:28:55.090868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 620/1222] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:28:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:28:55.098071 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf8431-22ff-4ca2-a787-e2009c84f6a1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:55.204822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf8431-22ff-4ca2-a787-e2009c84f6a1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:55.233272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:55.244970 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af892f-32e2-4af3-86bf-8e1a06cf5cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:55.245570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af892f-32e2-4af3-86bf-8e1a06cf5cff None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:55.245844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af892f-32e2-4af3-86bf-8e1a06cf5cff None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:55.246137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af892f-32e2-4af3-86bf-8e1a06cf5cff None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:55.246791 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af892f-32e2-4af3-86bf-8e1a06cf5cff None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:55.247084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af892f-32e2-4af3-86bf-8e1a06cf5cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:55.248459 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af892f-32e2-4af3-86bf-8e1a06cf5cff None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:55.258294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 603/1223] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:28:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:55.264380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e57254-d849-49e1-8c88-ce13ffb5f0b4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:55.312173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:55.371591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e57254-d849-49e1-8c88-ce13ffb5f0b4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:55.410991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a5cf1-f6f9-4b4a-8364-0dd403a2185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:55.411627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a5cf1-f6f9-4b4a-8364-0dd403a2185e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:55.412006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a5cf1-f6f9-4b4a-8364-0dd403a2185e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:55.412277 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a5cf1-f6f9-4b4a-8364-0dd403a2185e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:55.423390 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a5cf1-f6f9-4b4a-8364-0dd403a2185e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:55.424912 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a5cf1-f6f9-4b4a-8364-0dd403a2185e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-de5a5cf1-f6f9-4b4a-8364-0dd403a2185e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:28:55.440299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:55.441415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:28:55.442747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:28:55.442747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:55.442747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:28:55.442747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 621/1224] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:28:55.447635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af892f-32e2-4af3-86bf-8e1a06cf5cff None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:55.564059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af892f-32e2-4af3-86bf-8e1a06cf5cff None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:55.600269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abc2f8-3c4c-4b6d-a954-6a416ee742b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:55.600881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abc2f8-3c4c-4b6d-a954-6a416ee742b8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:55.601146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abc2f8-3c4c-4b6d-a954-6a416ee742b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:55.601409 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abc2f8-3c4c-4b6d-a954-6a416ee742b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:55.602043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abc2f8-3c4c-4b6d-a954-6a416ee742b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:55.602338 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abc2f8-3c4c-4b6d-a954-6a416ee742b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:55.603967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abc2f8-3c4c-4b6d-a954-6a416ee742b8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:55.617128 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 604/1225] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:55.622816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a5cf1-f6f9-4b4a-8364-0dd403a2185e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:55.736264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:55.743413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a5cf1-f6f9-4b4a-8364-0dd403a2185e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:55.778871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be683ea7-85b1-4ea3-be77-c27cb450cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:55.779493 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be683ea7-85b1-4ea3-be77-c27cb450cac0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:55.779797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be683ea7-85b1-4ea3-be77-c27cb450cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:55.780079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be683ea7-85b1-4ea3-be77-c27cb450cac0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:55.788426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be683ea7-85b1-4ea3-be77-c27cb450cac0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:55.789916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be683ea7-85b1-4ea3-be77-c27cb450cac0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-be683ea7-85b1-4ea3-be77-c27cb450cac0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:28:55.801780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:55.802966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:55.804151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:55.804151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:55.804151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:28:55.804151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:28:55.804151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:28:55.804151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:28:55.804151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:28:55.804151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:28:55.804151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:28:55.804151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:28:55.804151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 622/1226] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:28:55.809577 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abc2f8-3c4c-4b6d-a954-6a416ee742b8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:55.865303 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:55.924492 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abc2f8-3c4c-4b6d-a954-6a416ee742b8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:55.978915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1d79f-1081-4f21-86ee-ba76f5e5b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:55.979524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1d79f-1081-4f21-86ee-ba76f5e5b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:55.979825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1d79f-1081-4f21-86ee-ba76f5e5b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:55.980094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1d79f-1081-4f21-86ee-ba76f5e5b1f0 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:55.980806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1d79f-1081-4f21-86ee-ba76f5e5b1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:55.981109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1d79f-1081-4f21-86ee-ba76f5e5b1f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:55.982541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1d79f-1081-4f21-86ee-ba76f5e5b1f0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:56.001125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 605/1227] 10.222.0.91 () {56 vars in 1143 bytes} [Wed Aug 24 10:28:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:56.007510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be683ea7-85b1-4ea3-be77-c27cb450cac0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:56.117484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be683ea7-85b1-4ea3-be77-c27cb450cac0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:56.152020 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96e186-cda1-480d-8872-08a3230e1201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:56.152716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96e186-cda1-480d-8872-08a3230e1201 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:56.153020 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96e186-cda1-480d-8872-08a3230e1201 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:56.153292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96e186-cda1-480d-8872-08a3230e1201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:56.164987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96e186-cda1-480d-8872-08a3230e1201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:56.166471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96e186-cda1-480d-8872-08a3230e1201 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4e96e186-cda1-480d-8872-08a3230e1201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:28:56.181159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:56.182854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:28:56.184067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:28:56.184067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:56.184067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:28:56.184067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 623/1228] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:28:56.188203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1d79f-1081-4f21-86ee-ba76f5e5b1f0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:56.295868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1d79f-1081-4f21-86ee-ba76f5e5b1f0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:56.298223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:56.332646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8169fc8-f32f-4f67-b99c-35024cf8a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:56.333239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8169fc8-f32f-4f67-b99c-35024cf8a378 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:56.333519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8169fc8-f32f-4f67-b99c-35024cf8a378 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:56.333787 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8169fc8-f32f-4f67-b99c-35024cf8a378 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:56.334445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8169fc8-f32f-4f67-b99c-35024cf8a378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:56.334746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8169fc8-f32f-4f67-b99c-35024cf8a378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:56.336184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8169fc8-f32f-4f67-b99c-35024cf8a378 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:56.352050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 606/1229] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:56.353286 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96e186-cda1-480d-8872-08a3230e1201 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:56.362568 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:56.460975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96e186-cda1-480d-8872-08a3230e1201 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:56.495645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cbf87-ab63-4c3c-a7bf-b2ec200497df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:56.496294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cbf87-ab63-4c3c-a7bf-b2ec200497df None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:56.496571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cbf87-ab63-4c3c-a7bf-b2ec200497df None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:56.496838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cbf87-ab63-4c3c-a7bf-b2ec200497df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:56.504208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cbf87-ab63-4c3c-a7bf-b2ec200497df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:56.505685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cbf87-ab63-4c3c-a7bf-b2ec200497df None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b85cbf87-ab63-4c3c-a7bf-b2ec200497df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:28:56.517052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:56.518151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:56.519909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:28:56.519909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:28:56.519909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:28:56.519909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:28:56.519909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:28:56.519909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:28:56.519909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:28:56.519909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:28:56.519909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 624/1230] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:28:56.525108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8169fc8-f32f-4f67-b99c-35024cf8a378 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:56.628183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8169fc8-f32f-4f67-b99c-35024cf8a378 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:56.662747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d752e3-0197-4ca3-8729-781bc3d99e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:56.663338 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d752e3-0197-4ca3-8729-781bc3d99e1f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:56.663609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d752e3-0197-4ca3-8729-781bc3d99e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:56.663944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d752e3-0197-4ca3-8729-781bc3d99e1f None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:56.664627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d752e3-0197-4ca3-8729-781bc3d99e1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:56.664925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d752e3-0197-4ca3-8729-781bc3d99e1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:56.666360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d752e3-0197-4ca3-8729-781bc3d99e1f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:56.679176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 607/1231] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:56.685321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cbf87-ab63-4c3c-a7bf-b2ec200497df None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:56.753419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:56.790447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cbf87-ab63-4c3c-a7bf-b2ec200497df None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:56.824926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff1e11-d3b1-407e-b8c3-ce90d5fd7215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:56.825580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff1e11-d3b1-407e-b8c3-ce90d5fd7215 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:56.825859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff1e11-d3b1-407e-b8c3-ce90d5fd7215 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:56.826151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff1e11-d3b1-407e-b8c3-ce90d5fd7215 None admin] PATH_INFO: `/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/8ebfb233b2504463a4ee9202b5a3ab50/roles/baff7a1fa3b34f2fb1062f71bbb73c7f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:56.843996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff1e11-d3b1-407e-b8c3-ce90d5fd7215 None admin] RBAC: Authorizing `identity:create_grant(project_id=acd807f8a28d43cdac159fa3d606af60, user_id=8ebfb233b2504463a4ee9202b5a3ab50, role_id=baff7a1fa3b34f2fb1062f71bbb73c7f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:56.845493 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff1e11-d3b1-407e-b8c3-ce90d5fd7215 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:56.960520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 625/1232] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:28:56 2022] PUT /identity/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/8ebfb233b2504463a4ee9202b5a3ab50/roles/baff7a1fa3b34f2fb1062f71bbb73c7f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:28:58.911086 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08f0b3-8782-4ba3-a4e8-a9ed1c9b58ba None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:58.911809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08f0b3-8782-4ba3-a4e8-a9ed1c9b58ba None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:58.911809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08f0b3-8782-4ba3-a4e8-a9ed1c9b58ba None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:58.913219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 608/1233] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:28:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:28:58.921026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab8558-e076-4b5b-879e-a4c177b33437 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:58.921541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab8558-e076-4b5b-879e-a4c177b33437 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:58.921663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab8558-e076-4b5b-879e-a4c177b33437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:58.944845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2aab8558-e076-4b5b-879e-a4c177b33437 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:58.946683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2aab8558-e076-4b5b-879e-a4c177b33437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:59.026847 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 626/1234] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:28:59.302687 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08f0b3-8782-4ba3-a4e8-a9ed1c9b58ba None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:59.330698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:59.428103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08f0b3-8782-4ba3-a4e8-a9ed1c9b58ba None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:59.465604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4b5ca-2d38-4473-9289-7313c16825b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:59.466224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b5ca-2d38-4473-9289-7313c16825b7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:59.466499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b5ca-2d38-4473-9289-7313c16825b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:59.466765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b5ca-2d38-4473-9289-7313c16825b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:59.478191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4b5ca-2d38-4473-9289-7313c16825b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2db4b5ca-2d38-4473-9289-7313c16825b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:28:59.482827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:59.483908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:28:59.484814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 609/1235] 10.222.0.91 () {56 vars in 1102 bytes} [Wed Aug 24 10:28:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:28:59.491203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab8558-e076-4b5b-879e-a4c177b33437 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:59.544706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:59.602717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab8558-e076-4b5b-879e-a4c177b33437 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:59.644223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed998781-b852-4b46-9573-151e899ae5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:59.644872 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed998781-b852-4b46-9573-151e899ae5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:59.645205 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed998781-b852-4b46-9573-151e899ae5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:59.645476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed998781-b852-4b46-9573-151e899ae5b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:59.646144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed998781-b852-4b46-9573-151e899ae5b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:59.646444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed998781-b852-4b46-9573-151e899ae5b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:59.647847 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed998781-b852-4b46-9573-151e899ae5b5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:59.656784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 627/1236] 10.222.0.91 () {56 vars in 1103 bytes} [Wed Aug 24 10:28:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:59.663776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4b5ca-2d38-4473-9289-7313c16825b7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:59.770073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:59.788465 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4b5ca-2d38-4473-9289-7313c16825b7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:59.823456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049dbac-b9e4-4a34-a39c-35027d035569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:59.824119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049dbac-b9e4-4a34-a39c-35027d035569 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:59.824392 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049dbac-b9e4-4a34-a39c-35027d035569 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:59.824657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049dbac-b9e4-4a34-a39c-35027d035569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:59.837161 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049dbac-b9e4-4a34-a39c-35027d035569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:59.838665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049dbac-b9e4-4a34-a39c-35027d035569 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0049dbac-b9e4-4a34-a39c-35027d035569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:28:59.854977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:59.856248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:28:59.857506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:28:59.857506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:59.857506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:28:59.857506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 610/1237] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:28:59.862545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed998781-b852-4b46-9573-151e899ae5b5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:59.975990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed998781-b852-4b46-9573-151e899ae5b5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:59.985676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:00.011045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66c81e-40e2-4f2c-9a80-8c7e8f91cc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:00.011647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66c81e-40e2-4f2c-9a80-8c7e8f91cc6c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:00.011955 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66c81e-40e2-4f2c-9a80-8c7e8f91cc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:00.012227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66c81e-40e2-4f2c-9a80-8c7e8f91cc6c None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:00.012856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66c81e-40e2-4f2c-9a80-8c7e8f91cc6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:00.013153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66c81e-40e2-4f2c-9a80-8c7e8f91cc6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:00.014520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66c81e-40e2-4f2c-9a80-8c7e8f91cc6c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:00.028310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 628/1238] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:00.034711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049dbac-b9e4-4a34-a39c-35027d035569 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:00.148487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049dbac-b9e4-4a34-a39c-35027d035569 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:00.185115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24c7e3-7b67-4f37-88d8-dd579f25bb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:00.186291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24c7e3-7b67-4f37-88d8-dd579f25bb8d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:00.186291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24c7e3-7b67-4f37-88d8-dd579f25bb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:00.186291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24c7e3-7b67-4f37-88d8-dd579f25bb8d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:00.189561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:00.196691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24c7e3-7b67-4f37-88d8-dd579f25bb8d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:00.198160 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24c7e3-7b67-4f37-88d8-dd579f25bb8d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-eb24c7e3-7b67-4f37-88d8-dd579f25bb8d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:29:00.210882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:00.212144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:00.213129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:00.213129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:00.213129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:29:00.213129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:29:00.213129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:29:00.213129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:29:00.213129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:29:00.213129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:29:00.213129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:29:00.213129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:29:00.213129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 611/1239] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:00.218107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66c81e-40e2-4f2c-9a80-8c7e8f91cc6c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:00.338904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66c81e-40e2-4f2c-9a80-8c7e8f91cc6c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:00.384597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3f29d-544a-41c9-877e-967e1971c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:00.390299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3f29d-544a-41c9-877e-967e1971c9ce None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:00.390299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3f29d-544a-41c9-877e-967e1971c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:00.390299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3f29d-544a-41c9-877e-967e1971c9ce None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:00.390299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3f29d-544a-41c9-877e-967e1971c9ce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:00.390299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3f29d-544a-41c9-877e-967e1971c9ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:00.390299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3f29d-544a-41c9-877e-967e1971c9ce None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:00.413408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 629/1240] 10.222.0.91 () {56 vars in 1143 bytes} [Wed Aug 24 10:29:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:00.415473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24c7e3-7b67-4f37-88d8-dd579f25bb8d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:00.527138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24c7e3-7b67-4f37-88d8-dd579f25bb8d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:00.563359 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9a06b-9a29-4e20-8ef0-490f0e897a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:00.564094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9a06b-9a29-4e20-8ef0-490f0e897a05 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:00.564406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9a06b-9a29-4e20-8ef0-490f0e897a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:00.564630 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9a06b-9a29-4e20-8ef0-490f0e897a05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:00.639545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:00.648746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9a06b-9a29-4e20-8ef0-490f0e897a05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:00.650650 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9a06b-9a29-4e20-8ef0-490f0e897a05 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:00.761162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 612/1241] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:29:00.769568 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3f29d-544a-41c9-877e-967e1971c9ce None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:00.800460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:00.877396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3f29d-544a-41c9-877e-967e1971c9ce None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:00.918214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69235f87-ccd4-4b9b-9e7e-67205116aa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:00.918870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69235f87-ccd4-4b9b-9e7e-67205116aa0e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:00.919134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69235f87-ccd4-4b9b-9e7e-67205116aa0e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:00.919398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69235f87-ccd4-4b9b-9e7e-67205116aa0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:00.932874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69235f87-ccd4-4b9b-9e7e-67205116aa0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:00.937632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69235f87-ccd4-4b9b-9e7e-67205116aa0e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-69235f87-ccd4-4b9b-9e7e-67205116aa0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:29:00.952080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:00.953295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:29:00.954326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:29:00.954326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:00.954326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:00.954326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 630/1242] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:00.961552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9a06b-9a29-4e20-8ef0-490f0e897a05 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:01.063780 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:01.070699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9a06b-9a29-4e20-8ef0-490f0e897a05 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:01.109712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073de875-7790-436b-8999-775bdbb41522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:01.110314 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073de875-7790-436b-8999-775bdbb41522 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:01.110597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073de875-7790-436b-8999-775bdbb41522 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:01.110863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073de875-7790-436b-8999-775bdbb41522 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:01.111579 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073de875-7790-436b-8999-775bdbb41522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:01.111912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073de875-7790-436b-8999-775bdbb41522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:01.114294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073de875-7790-436b-8999-775bdbb41522 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:01.126611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 613/1243] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:01.134460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69235f87-ccd4-4b9b-9e7e-67205116aa0e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:01.221182 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:01.245731 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69235f87-ccd4-4b9b-9e7e-67205116aa0e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:01.286725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7f4d5-9091-4e95-8726-9af5c7b5304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:01.287367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7f4d5-9091-4e95-8726-9af5c7b5304c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:01.287648 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7f4d5-9091-4e95-8726-9af5c7b5304c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:01.287954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7f4d5-9091-4e95-8726-9af5c7b5304c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:01.295324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7f4d5-9091-4e95-8726-9af5c7b5304c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:01.296832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7f4d5-9091-4e95-8726-9af5c7b5304c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-91b7f4d5-9091-4e95-8726-9af5c7b5304c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:29:01.309406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:01.314636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:01.316043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:29:01.316043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:29:01.316043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:29:01.316043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:29:01.316043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:29:01.316043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:29:01.316043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:29:01.316043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:01.316043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 631/1244] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:01.317506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073de875-7790-436b-8999-775bdbb41522 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:01.434303 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073de875-7790-436b-8999-775bdbb41522 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:01.473468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e459a-16de-408c-8e88-c18064565a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:01.474079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e459a-16de-408c-8e88-c18064565a1f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:01.474354 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e459a-16de-408c-8e88-c18064565a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:01.474620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e459a-16de-408c-8e88-c18064565a1f None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:01.475305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e459a-16de-408c-8e88-c18064565a1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:01.475606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e459a-16de-408c-8e88-c18064565a1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:01.477064 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e459a-16de-408c-8e88-c18064565a1f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:01.490200 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 614/1245] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:29:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:01.498855 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7f4d5-9091-4e95-8726-9af5c7b5304c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:01.611791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7f4d5-9091-4e95-8726-9af5c7b5304c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:01.659921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1b2a1-0765-4395-b58c-8820301050da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:01.660546 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1b2a1-0765-4395-b58c-8820301050da None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:01.660827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1b2a1-0765-4395-b58c-8820301050da None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:01.661135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1b2a1-0765-4395-b58c-8820301050da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:01.661887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1b2a1-0765-4395-b58c-8820301050da None admin] RBAC: Adding query filter params (role.id=baff7a1fa3b34f2fb1062f71bbb73c7f, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=8ebfb233b2504463a4ee9202b5a3ab50) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:01.662180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1b2a1-0765-4395-b58c-8820301050da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:01.663697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1b2a1-0765-4395-b58c-8820301050da None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:01.670547 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 632/1246] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:01 2022] GET /identity/v3/role_assignments?user.id=8ebfb233b2504463a4ee9202b5a3ab50&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=baff7a1fa3b34f2fb1062f71bbb73c7f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:03.758510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90943ca9-aea9-46a5-9680-ba9185f48805 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:03.759039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90943ca9-aea9-46a5-9680-ba9185f48805 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:03.759158 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90943ca9-aea9-46a5-9680-ba9185f48805 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:03.760742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 615/1247] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:03.766523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620a040-71dc-4aa3-a028-a93b80c5c4fe None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:03.766988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620a040-71dc-4aa3-a028-a93b80c5c4fe None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:03.767086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620a040-71dc-4aa3-a028-a93b80c5c4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:03.774292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:03.794335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5620a040-71dc-4aa3-a028-a93b80c5c4fe None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:03.795548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5620a040-71dc-4aa3-a028-a93b80c5c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:03.874058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 633/1248] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:29:04.156038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90943ca9-aea9-46a5-9680-ba9185f48805 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:04.175484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:04.278252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90943ca9-aea9-46a5-9680-ba9185f48805 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:04.319933 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b106d62-fac9-44cf-b2a7-e7d40e26582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:04.320738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b106d62-fac9-44cf-b2a7-e7d40e26582d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:04.321150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b106d62-fac9-44cf-b2a7-e7d40e26582d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:04.321520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b106d62-fac9-44cf-b2a7-e7d40e26582d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:04.338670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b106d62-fac9-44cf-b2a7-e7d40e26582d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9b106d62-fac9-44cf-b2a7-e7d40e26582d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:04.346571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:04.347849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:29:04.350119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 616/1249] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:29:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:04.355776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620a040-71dc-4aa3-a028-a93b80c5c4fe None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:04.479982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620a040-71dc-4aa3-a028-a93b80c5c4fe None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:04.518905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:04.524747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3607c86-6a9e-43ad-96d5-58f2429fc8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:04.525369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3607c86-6a9e-43ad-96d5-58f2429fc8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:04.525669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3607c86-6a9e-43ad-96d5-58f2429fc8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:04.525966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3607c86-6a9e-43ad-96d5-58f2429fc8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:04.526717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3607c86-6a9e-43ad-96d5-58f2429fc8d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:04.527069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3607c86-6a9e-43ad-96d5-58f2429fc8d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:04.528651 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3607c86-6a9e-43ad-96d5-58f2429fc8d7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:04.538612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 634/1250] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:04.545305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b106d62-fac9-44cf-b2a7-e7d40e26582d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:04.640832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:04.669904 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b106d62-fac9-44cf-b2a7-e7d40e26582d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:04.712383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb3cd6-ad84-497d-8039-cf5a8e266f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:04.712383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb3cd6-ad84-497d-8039-cf5a8e266f9a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:04.712383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb3cd6-ad84-497d-8039-cf5a8e266f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:04.713436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb3cd6-ad84-497d-8039-cf5a8e266f9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:04.727332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb3cd6-ad84-497d-8039-cf5a8e266f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:04.730376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb3cd6-ad84-497d-8039-cf5a8e266f9a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c7fb3cd6-ad84-497d-8039-cf5a8e266f9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:29:04.753053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:04.754327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:29:04.755349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:29:04.755349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:04.755349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:29:04.755349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 617/1251] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:04.760537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3607c86-6a9e-43ad-96d5-58f2429fc8d7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:04.869878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3607c86-6a9e-43ad-96d5-58f2429fc8d7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:04.906029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d39b39-786f-44b0-b902-d0b724aadba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:04.906632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d39b39-786f-44b0-b902-d0b724aadba8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:04.906909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d39b39-786f-44b0-b902-d0b724aadba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:04.907236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d39b39-786f-44b0-b902-d0b724aadba8 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:04.907930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d39b39-786f-44b0-b902-d0b724aadba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:04.908410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d39b39-786f-44b0-b902-d0b724aadba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:04.910105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d39b39-786f-44b0-b902-d0b724aadba8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:04.922799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 635/1252] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:04.929988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb3cd6-ad84-497d-8039-cf5a8e266f9a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:05.045822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb3cd6-ad84-497d-8039-cf5a8e266f9a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:05.072390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:05.081441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe9eb5-af73-4c4e-9c3d-a693369817ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:05.082270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe9eb5-af73-4c4e-9c3d-a693369817ba None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:05.082542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe9eb5-af73-4c4e-9c3d-a693369817ba None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:05.082803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe9eb5-af73-4c4e-9c3d-a693369817ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:05.090857 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe9eb5-af73-4c4e-9c3d-a693369817ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:05.092328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe9eb5-af73-4c4e-9c3d-a693369817ba None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-26fe9eb5-af73-4c4e-9c3d-a693369817ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:29:05.106045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:05.107867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:05.108893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:05.108893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:05.108893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:29:05.108893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:29:05.108893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:29:05.108893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:29:05.108893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:29:05.108893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:29:05.108893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:29:05.108893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:29:05.108893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 618/1253] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:05.114580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d39b39-786f-44b0-b902-d0b724aadba8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:05.175517 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:05.226154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d39b39-786f-44b0-b902-d0b724aadba8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:05.262476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e814f7c-fc09-4068-9d6c-af9c561da639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:05.263087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e814f7c-fc09-4068-9d6c-af9c561da639 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:05.263368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e814f7c-fc09-4068-9d6c-af9c561da639 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:05.263641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e814f7c-fc09-4068-9d6c-af9c561da639 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:05.264723 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e814f7c-fc09-4068-9d6c-af9c561da639 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:05.265039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e814f7c-fc09-4068-9d6c-af9c561da639 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:05.266854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e814f7c-fc09-4068-9d6c-af9c561da639 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:05.292277 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 636/1254] 10.222.0.91 () {56 vars in 1143 bytes} [Wed Aug 24 10:29:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:05.299095 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe9eb5-af73-4c4e-9c3d-a693369817ba None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:05.417077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe9eb5-af73-4c4e-9c3d-a693369817ba None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:05.453361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5a7fd-83ca-47de-8a50-8dbc616d9303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:05.453974 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5a7fd-83ca-47de-8a50-8dbc616d9303 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:05.454252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5a7fd-83ca-47de-8a50-8dbc616d9303 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:05.454532 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5a7fd-83ca-47de-8a50-8dbc616d9303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:05.525134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:05.540211 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5a7fd-83ca-47de-8a50-8dbc616d9303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:05.541694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5a7fd-83ca-47de-8a50-8dbc616d9303 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:05.647019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 619/1255] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 10:29:05.652782 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e814f7c-fc09-4068-9d6c-af9c561da639 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:05.760397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e814f7c-fc09-4068-9d6c-af9c561da639 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:05.775483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:05.799700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6a3fa-32cd-4678-b750-ee1b3c5b66bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:05.800473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6a3fa-32cd-4678-b750-ee1b3c5b66bc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:05.800845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6a3fa-32cd-4678-b750-ee1b3c5b66bc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:05.801144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6a3fa-32cd-4678-b750-ee1b3c5b66bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:05.812150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6a3fa-32cd-4678-b750-ee1b3c5b66bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:05.813619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6a3fa-32cd-4678-b750-ee1b3c5b66bc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-10c6a3fa-32cd-4678-b750-ee1b3c5b66bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:29:05.828968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:05.830256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:29:05.832351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:29:05.832351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:05.832351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:05.832351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 637/1256] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:05.836880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5a7fd-83ca-47de-8a50-8dbc616d9303 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:05.935393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:05.947468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5a7fd-83ca-47de-8a50-8dbc616d9303 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:05.993040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d631dd-8812-47c4-914f-94f166a76f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:05.993647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d631dd-8812-47c4-914f-94f166a76f69 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:05.993920 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d631dd-8812-47c4-914f-94f166a76f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:05.994184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d631dd-8812-47c4-914f-94f166a76f69 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:05.994842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d631dd-8812-47c4-914f-94f166a76f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:05.995135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d631dd-8812-47c4-914f-94f166a76f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:05.996577 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d631dd-8812-47c4-914f-94f166a76f69 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:06.010131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 620/1257] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:06.017717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6a3fa-32cd-4678-b750-ee1b3c5b66bc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:06.145241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6a3fa-32cd-4678-b750-ee1b3c5b66bc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:06.204566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc354-90fd-4ad4-9e30-f422030e91bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:06.205214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc354-90fd-4ad4-9e30-f422030e91bb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:06.205496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc354-90fd-4ad4-9e30-f422030e91bb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:06.206563 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc354-90fd-4ad4-9e30-f422030e91bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:06.214067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbc354-90fd-4ad4-9e30-f422030e91bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:06.215565 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbc354-90fd-4ad4-9e30-f422030e91bb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-fdfbc354-90fd-4ad4-9e30-f422030e91bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:29:06.229464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:06.230716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:06.231635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:29:06.231635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:29:06.231635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:29:06.231635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:29:06.231635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:29:06.231635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:29:06.231635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:29:06.231635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:06.231635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 638/1258] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:06.236648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d631dd-8812-47c4-914f-94f166a76f69 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:06.353947 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d631dd-8812-47c4-914f-94f166a76f69 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:06.390910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6b1fc-42bd-4048-b05f-ac77abda74da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:06.391859 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b1fc-42bd-4048-b05f-ac77abda74da None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:06.392136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b1fc-42bd-4048-b05f-ac77abda74da None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:06.392402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b1fc-42bd-4048-b05f-ac77abda74da None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:06.393126 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6b1fc-42bd-4048-b05f-ac77abda74da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:06.393977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6b1fc-42bd-4048-b05f-ac77abda74da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:06.395411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6b1fc-42bd-4048-b05f-ac77abda74da None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:06.408717 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 621/1259] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:29:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:06.415308 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc354-90fd-4ad4-9e30-f422030e91bb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:06.443248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:06.525007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc354-90fd-4ad4-9e30-f422030e91bb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:06.560955 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee1cb4-edfd-44ef-b66c-a2412f95d661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:06.561588 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee1cb4-edfd-44ef-b66c-a2412f95d661 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:06.561898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee1cb4-edfd-44ef-b66c-a2412f95d661 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:06.562165 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee1cb4-edfd-44ef-b66c-a2412f95d661 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:06.562921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee1cb4-edfd-44ef-b66c-a2412f95d661 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=8ebfb233b2504463a4ee9202b5a3ab50) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:06.563230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee1cb4-edfd-44ef-b66c-a2412f95d661 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:06.564716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee1cb4-edfd-44ef-b66c-a2412f95d661 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:06.578659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 639/1260] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:06 2022] GET /identity/v3/role_assignments?user.id=8ebfb233b2504463a4ee9202b5a3ab50&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=60abeefc9ac84e31a0162ac559220669 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:08.540408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247e129-7df9-41a9-9e3d-8089f4d9d1f3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:08.540983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247e129-7df9-41a9-9e3d-8089f4d9d1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:08.540983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247e129-7df9-41a9-9e3d-8089f4d9d1f3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:08.542259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 622/1261] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:08.547510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032abbb-d684-4db7-a010-36bc1d6d714e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:08.547913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032abbb-d684-4db7-a010-36bc1d6d714e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:08.548107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032abbb-d684-4db7-a010-36bc1d6d714e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:08.568231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6032abbb-d684-4db7-a010-36bc1d6d714e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:08.569473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6032abbb-d684-4db7-a010-36bc1d6d714e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:08.639305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 640/1262] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:29:08.920078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247e129-7df9-41a9-9e3d-8089f4d9d1f3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:08.933185 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.033002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247e129-7df9-41a9-9e3d-8089f4d9d1f3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.070939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08fe84-9452-4128-9e16-a8b3adbbabda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.071562 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08fe84-9452-4128-9e16-a8b3adbbabda None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.071871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08fe84-9452-4128-9e16-a8b3adbbabda None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.072190 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08fe84-9452-4128-9e16-a8b3adbbabda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.083744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08fe84-9452-4128-9e16-a8b3adbbabda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6b08fe84-9452-4128-9e16-a8b3adbbabda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:09.088637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:09.089584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:29:09.090443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 623/1263] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:29:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:09.096138 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032abbb-d684-4db7-a010-36bc1d6d714e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.115697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.200968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032abbb-d684-4db7-a010-36bc1d6d714e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.236031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d0429-51e0-42a0-a524-cafdce2a04d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.236673 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d0429-51e0-42a0-a524-cafdce2a04d7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.237042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d0429-51e0-42a0-a524-cafdce2a04d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.237326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d0429-51e0-42a0-a524-cafdce2a04d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.237993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d0429-51e0-42a0-a524-cafdce2a04d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:09.238288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d0429-51e0-42a0-a524-cafdce2a04d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.239757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d0429-51e0-42a0-a524-cafdce2a04d7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.248276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 641/1264] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:09.255043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08fe84-9452-4128-9e16-a8b3adbbabda None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.326422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.360799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08fe84-9452-4128-9e16-a8b3adbbabda None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.395893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d29d4-dd79-4555-aca4-cc5b274668b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.396515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d29d4-dd79-4555-aca4-cc5b274668b9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.396790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d29d4-dd79-4555-aca4-cc5b274668b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.397055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d29d4-dd79-4555-aca4-cc5b274668b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.406957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d29d4-dd79-4555-aca4-cc5b274668b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.408457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d29d4-dd79-4555-aca4-cc5b274668b9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2b7d29d4-dd79-4555-aca4-cc5b274668b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:29:09.423944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:09.428900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:29:09.430147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:29:09.430147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:09.430147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:29:09.430147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 624/1265] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:09.432058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d0429-51e0-42a0-a524-cafdce2a04d7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.521719 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.542795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d0429-51e0-42a0-a524-cafdce2a04d7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.578025 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ee6d1-758c-4e9b-9e1d-2a020075a358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.578724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ee6d1-758c-4e9b-9e1d-2a020075a358 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.578918 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ee6d1-758c-4e9b-9e1d-2a020075a358 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.579201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ee6d1-758c-4e9b-9e1d-2a020075a358 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.579924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ee6d1-758c-4e9b-9e1d-2a020075a358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:09.580303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ee6d1-758c-4e9b-9e1d-2a020075a358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.582559 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ee6d1-758c-4e9b-9e1d-2a020075a358 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.595362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 642/1266] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:09.602396 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d29d4-dd79-4555-aca4-cc5b274668b9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.710456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d29d4-dd79-4555-aca4-cc5b274668b9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.733779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.748117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba9b8a-f525-4de6-adaa-52536c04c747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.748755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba9b8a-f525-4de6-adaa-52536c04c747 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.749025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba9b8a-f525-4de6-adaa-52536c04c747 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.749291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba9b8a-f525-4de6-adaa-52536c04c747 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.758634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba9b8a-f525-4de6-adaa-52536c04c747 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.760141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba9b8a-f525-4de6-adaa-52536c04c747 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2aba9b8a-f525-4de6-adaa-52536c04c747 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:29:09.772877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:09.776924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:09.778110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:09.778110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:09.778110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:29:09.778110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:29:09.778110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:29:09.778110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:29:09.778110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:29:09.778110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:29:09.778110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:29:09.778110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:29:09.778110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 625/1267] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:09.780040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ee6d1-758c-4e9b-9e1d-2a020075a358 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.887238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ee6d1-758c-4e9b-9e1d-2a020075a358 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.929302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4370ae-5d02-403e-bd9b-bc21b316bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.929909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4370ae-5d02-403e-bd9b-bc21b316bc53 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.930243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4370ae-5d02-403e-bd9b-bc21b316bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.930511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4370ae-5d02-403e-bd9b-bc21b316bc53 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.931288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4370ae-5d02-403e-bd9b-bc21b316bc53 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:09.931540 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4370ae-5d02-403e-bd9b-bc21b316bc53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.933019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4370ae-5d02-403e-bd9b-bc21b316bc53 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.942900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.951693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 643/1268] 10.222.0.91 () {56 vars in 1143 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:09.958264 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba9b8a-f525-4de6-adaa-52536c04c747 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:10.065189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba9b8a-f525-4de6-adaa-52536c04c747 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:10.100229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeff770-e9fb-4122-9124-9914934d55a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:10.100831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeff770-e9fb-4122-9124-9914934d55a2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.101110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeff770-e9fb-4122-9124-9914934d55a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.101383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeff770-e9fb-4122-9124-9914934d55a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.112908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeff770-e9fb-4122-9124-9914934d55a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:10.114348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeff770-e9fb-4122-9124-9914934d55a2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3eeff770-e9fb-4122-9124-9914934d55a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:29:10.129242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:10.130265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:29:10.131347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:29:10.131347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:10.131347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:29:10.131347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 626/1269] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:10.136648 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4370ae-5d02-403e-bd9b-bc21b316bc53 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:10.238956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4370ae-5d02-403e-bd9b-bc21b316bc53 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:10.278304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ca29e-59f1-41d5-ad82-6ae3f3468233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:10.278906 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ca29e-59f1-41d5-ad82-6ae3f3468233 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.279180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ca29e-59f1-41d5-ad82-6ae3f3468233 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.279448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ca29e-59f1-41d5-ad82-6ae3f3468233 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.280153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ca29e-59f1-41d5-ad82-6ae3f3468233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:10.280450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ca29e-59f1-41d5-ad82-6ae3f3468233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:10.281816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ca29e-59f1-41d5-ad82-6ae3f3468233 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:10.295991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 644/1270] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:10.301421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeff770-e9fb-4122-9124-9914934d55a2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:10.334539 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:10.406545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeff770-e9fb-4122-9124-9914934d55a2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:10.443456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11922548-281e-442a-94a4-e5bc61aefcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:10.444119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11922548-281e-442a-94a4-e5bc61aefcfa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.444399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11922548-281e-442a-94a4-e5bc61aefcfa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.444670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11922548-281e-442a-94a4-e5bc61aefcfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.451406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11922548-281e-442a-94a4-e5bc61aefcfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:10.452879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11922548-281e-442a-94a4-e5bc61aefcfa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-11922548-281e-442a-94a4-e5bc61aefcfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:29:10.464666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:10.469403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:10.470537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:29:10.470537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:29:10.470537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:29:10.470537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:29:10.470537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:29:10.470537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:29:10.470537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:29:10.470537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:29:10.470537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 627/1271] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:29:10.471932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ca29e-59f1-41d5-ad82-6ae3f3468233 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:10.534887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:10.576927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ca29e-59f1-41d5-ad82-6ae3f3468233 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:10.611641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999595ef-a374-4ae0-8145-b589830d83e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:10.612537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999595ef-a374-4ae0-8145-b589830d83e2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.612711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999595ef-a374-4ae0-8145-b589830d83e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.612853 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999595ef-a374-4ae0-8145-b589830d83e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.613536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999595ef-a374-4ae0-8145-b589830d83e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:10.613924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999595ef-a374-4ae0-8145-b589830d83e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:10.615321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999595ef-a374-4ae0-8145-b589830d83e2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:10.627976 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 645/1272] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:10.634554 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11922548-281e-442a-94a4-e5bc61aefcfa None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:10.733238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:10.742027 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11922548-281e-442a-94a4-e5bc61aefcfa None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:10.780123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f69555-985e-41cd-99b6-7c153e834248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:10.780773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f69555-985e-41cd-99b6-7c153e834248 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.781053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f69555-985e-41cd-99b6-7c153e834248 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.781327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f69555-985e-41cd-99b6-7c153e834248 None admin] PATH_INFO: `/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/8ebfb233b2504463a4ee9202b5a3ab50/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.783235 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f69555-985e-41cd-99b6-7c153e834248 None admin] RBAC: Authorizing `identity:create_grant(project_id=acd807f8a28d43cdac159fa3d606af60, user_id=8ebfb233b2504463a4ee9202b5a3ab50, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:10.784748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f69555-985e-41cd-99b6-7c153e834248 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:10.999340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 628/1273] 10.222.0.91 () {58 vars in 1439 bytes} [Wed Aug 24 10:29:10 2022] PUT /identity/v3/projects/acd807f8a28d43cdac159fa3d606af60/users/8ebfb233b2504463a4ee9202b5a3ab50/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:29:12.922778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7526-385a-48a1-b7cc-4195421c3448 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:12.923338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7526-385a-48a1-b7cc-4195421c3448 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:12.923338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7526-385a-48a1-b7cc-4195421c3448 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:12.925323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 646/1274] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:12.930943 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122304e7-8609-43af-bcba-e55b61eea8c4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:12.931389 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122304e7-8609-43af-bcba-e55b61eea8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:12.931496 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122304e7-8609-43af-bcba-e55b61eea8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:12.950546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-122304e7-8609-43af-bcba-e55b61eea8c4 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:12.951813 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-122304e7-8609-43af-bcba-e55b61eea8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:13.023236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 629/1275] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:29:13.301114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c7526-385a-48a1-b7cc-4195421c3448 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:13.413713 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c7526-385a-48a1-b7cc-4195421c3448 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:13.437708 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:13.457493 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6488c5-ec24-4c63-90a7-d435dcdb0019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:13.458120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6488c5-ec24-4c63-90a7-d435dcdb0019 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:13.458400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6488c5-ec24-4c63-90a7-d435dcdb0019 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:13.458673 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6488c5-ec24-4c63-90a7-d435dcdb0019 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.469147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6488c5-ec24-4c63-90a7-d435dcdb0019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ad6488c5-ec24-4c63-90a7-d435dcdb0019 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:13.473935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:13.475107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:13.476040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 647/1276] 10.222.0.91 () {56 vars in 1096 bytes} [Wed Aug 24 10:29:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:13.481401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122304e7-8609-43af-bcba-e55b61eea8c4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:13.566564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:13.584998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122304e7-8609-43af-bcba-e55b61eea8c4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:13.620806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686fa58-53b7-4388-8b48-6b423b74f695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:13.621411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686fa58-53b7-4388-8b48-6b423b74f695 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:13.621689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686fa58-53b7-4388-8b48-6b423b74f695 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:13.621958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686fa58-53b7-4388-8b48-6b423b74f695 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.622621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686fa58-53b7-4388-8b48-6b423b74f695 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:13.622925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686fa58-53b7-4388-8b48-6b423b74f695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:13.624378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686fa58-53b7-4388-8b48-6b423b74f695 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:13.632605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 630/1277] 10.222.0.91 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:13.638402 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6488c5-ec24-4c63-90a7-d435dcdb0019 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:13.746032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6488c5-ec24-4c63-90a7-d435dcdb0019 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:13.781128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99982f90-acae-4f56-83ba-754ffd3c32ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:13.781756 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99982f90-acae-4f56-83ba-754ffd3c32ed None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:13.782033 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99982f90-acae-4f56-83ba-754ffd3c32ed None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:13.782302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99982f90-acae-4f56-83ba-754ffd3c32ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.793390 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99982f90-acae-4f56-83ba-754ffd3c32ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:13.801456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99982f90-acae-4f56-83ba-754ffd3c32ed None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-99982f90-acae-4f56-83ba-754ffd3c32ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:29:13.810554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:13.811765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:29:13.812966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:29:13.812966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:13.812966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:13.815917 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 648/1278] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:13.818196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686fa58-53b7-4388-8b48-6b423b74f695 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:13.926002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686fa58-53b7-4388-8b48-6b423b74f695 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:13.961257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39cd53-ee3a-4bcc-b19e-f89b34338738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:13.961994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39cd53-ee3a-4bcc-b19e-f89b34338738 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:13.962111 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39cd53-ee3a-4bcc-b19e-f89b34338738 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:13.962381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39cd53-ee3a-4bcc-b19e-f89b34338738 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.963017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39cd53-ee3a-4bcc-b19e-f89b34338738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:13.963320 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39cd53-ee3a-4bcc-b19e-f89b34338738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:13.964774 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39cd53-ee3a-4bcc-b19e-f89b34338738 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:13.978362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 631/1279] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:13.984201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99982f90-acae-4f56-83ba-754ffd3c32ed None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:14.015536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:14.091877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99982f90-acae-4f56-83ba-754ffd3c32ed None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:14.127413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43315f-73f5-42bb-af10-d3073c48f4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:14.128595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43315f-73f5-42bb-af10-d3073c48f4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:14.128595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43315f-73f5-42bb-af10-d3073c48f4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:14.128869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43315f-73f5-42bb-af10-d3073c48f4d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:14.136533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43315f-73f5-42bb-af10-d3073c48f4d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:14.137948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43315f-73f5-42bb-af10-d3073c48f4d5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4d43315f-73f5-42bb-af10-d3073c48f4d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:29:14.156457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:14.163514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:14.171973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:14.171973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:14.171973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:29:14.171973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:29:14.171973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:29:14.171973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:29:14.171973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:29:14.171973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:29:14.171973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:29:14.171973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:14.171973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 649/1280] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:14.172743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39cd53-ee3a-4bcc-b19e-f89b34338738 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:14.172743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:14.266490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39cd53-ee3a-4bcc-b19e-f89b34338738 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:14.304206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8e79d-cea7-4d9c-91b8-e540263c6a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:14.304833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8e79d-cea7-4d9c-91b8-e540263c6a67 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:14.305109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8e79d-cea7-4d9c-91b8-e540263c6a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:14.305376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8e79d-cea7-4d9c-91b8-e540263c6a67 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:14.306147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8e79d-cea7-4d9c-91b8-e540263c6a67 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:14.306446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8e79d-cea7-4d9c-91b8-e540263c6a67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:14.307915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8e79d-cea7-4d9c-91b8-e540263c6a67 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:14.334168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 632/1281] 10.222.0.91 () {56 vars in 1143 bytes} [Wed Aug 24 10:29:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:14.340150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43315f-73f5-42bb-af10-d3073c48f4d5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:14.440719 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:14.450373 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43315f-73f5-42bb-af10-d3073c48f4d5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:14.485703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0287254-26d5-4569-9bb3-305aeb10d1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:14.486290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0287254-26d5-4569-9bb3-305aeb10d1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:14.486571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0287254-26d5-4569-9bb3-305aeb10d1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:14.487587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0287254-26d5-4569-9bb3-305aeb10d1a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:14.557543 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0287254-26d5-4569-9bb3-305aeb10d1a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:14.558984 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0287254-26d5-4569-9bb3-305aeb10d1a3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:14.653194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:14.664334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 650/1282] 10.222.0.91 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:29:14.670231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8e79d-cea7-4d9c-91b8-e540263c6a67 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:14.734224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:14.776952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8e79d-cea7-4d9c-91b8-e540263c6a67 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:14.812106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b1635-91a6-4e53-bd83-cd007e6243c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:14.812779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b1635-91a6-4e53-bd83-cd007e6243c4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:14.813056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b1635-91a6-4e53-bd83-cd007e6243c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:14.813325 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b1635-91a6-4e53-bd83-cd007e6243c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:14.824308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b1635-91a6-4e53-bd83-cd007e6243c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:14.825831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b1635-91a6-4e53-bd83-cd007e6243c4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-cd1b1635-91a6-4e53-bd83-cd007e6243c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:29:14.840667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:14.841923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:29:14.842957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:29:14.842957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:14.842957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:29:14.842957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 633/1283] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:14.848795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0287254-26d5-4569-9bb3-305aeb10d1a3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:14.952094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0287254-26d5-4569-9bb3-305aeb10d1a3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:14.991631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076cfa-3107-4264-8d1c-9206bd877eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:14.992337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076cfa-3107-4264-8d1c-9206bd877eaa None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:14.992524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076cfa-3107-4264-8d1c-9206bd877eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:14.992804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076cfa-3107-4264-8d1c-9206bd877eaa None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:14.993431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88076cfa-3107-4264-8d1c-9206bd877eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:14.993732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88076cfa-3107-4264-8d1c-9206bd877eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:14.995111 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88076cfa-3107-4264-8d1c-9206bd877eaa None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:15.007018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 651/1284] 10.222.0.91 () {56 vars in 1109 bytes} [Wed Aug 24 10:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:15.012948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b1635-91a6-4e53-bd83-cd007e6243c4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:15.118417 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b1635-91a6-4e53-bd83-cd007e6243c4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:15.132377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:15.154520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743cfff-63ff-4455-8dbc-73a95df03755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:15.155143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743cfff-63ff-4455-8dbc-73a95df03755 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:15.155416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743cfff-63ff-4455-8dbc-73a95df03755 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:15.155681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743cfff-63ff-4455-8dbc-73a95df03755 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:15.163283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743cfff-63ff-4455-8dbc-73a95df03755 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:15.164740 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743cfff-63ff-4455-8dbc-73a95df03755 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6743cfff-63ff-4455-8dbc-73a95df03755 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:29:15.176758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:15.177911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:15.178871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:29:15.178871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:29:15.178871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:29:15.178871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:29:15.178871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:29:15.178871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:29:15.178871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:29:15.178871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 24 10:29:15.178871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 634/1285] 10.222.0.91 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:29:15.184000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076cfa-3107-4264-8d1c-9206bd877eaa None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:15.235105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:15.288935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076cfa-3107-4264-8d1c-9206bd877eaa None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:15.323023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655f37c-c2aa-4b80-988c-652ef06ba59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:15.323623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655f37c-c2aa-4b80-988c-652ef06ba59b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:15.323929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655f37c-c2aa-4b80-988c-652ef06ba59b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:15.324204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655f37c-c2aa-4b80-988c-652ef06ba59b None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:15.324886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655f37c-c2aa-4b80-988c-652ef06ba59b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:15.325190 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655f37c-c2aa-4b80-988c-652ef06ba59b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:15.326633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655f37c-c2aa-4b80-988c-652ef06ba59b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:15.339437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 652/1286] 10.222.0.91 () {56 vars in 1148 bytes} [Wed Aug 24 10:29:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:15.346562 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743cfff-63ff-4455-8dbc-73a95df03755 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:15.454767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743cfff-63ff-4455-8dbc-73a95df03755 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:15.490038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63451604-d0c7-4686-a856-a494925123a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:15.490564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63451604-d0c7-4686-a856-a494925123a0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:15.490840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63451604-d0c7-4686-a856-a494925123a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:15.491108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63451604-d0c7-4686-a856-a494925123a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:15.491910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63451604-d0c7-4686-a856-a494925123a0 None admin] RBAC: Adding query filter params (role.id=60abeefc9ac84e31a0162ac559220669, scope.project.id=acd807f8a28d43cdac159fa3d606af60, user.id=8ebfb233b2504463a4ee9202b5a3ab50) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:15.499170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63451604-d0c7-4686-a856-a494925123a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:15.499170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63451604-d0c7-4686-a856-a494925123a0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:15.503516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 635/1287] 10.222.0.91 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:15 2022] GET /identity/v3/role_assignments?user.id=8ebfb233b2504463a4ee9202b5a3ab50&scope.project.id=acd807f8a28d43cdac159fa3d606af60&role.id=60abeefc9ac84e31a0162ac559220669 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:17.475196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ade0-1336-44ba-a84d-68875b5e3ba6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.475766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ade0-1336-44ba-a84d-68875b5e3ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.475766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ade0-1336-44ba-a84d-68875b5e3ba6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.477115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 653/1288] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:17.482619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2fa25-d3e9-4984-bc92-fdcb5a8fcd16 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.483066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2fa25-d3e9-4984-bc92-fdcb5a8fcd16 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.483867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2fa25-d3e9-4984-bc92-fdcb5a8fcd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.501876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c7d2fa25-d3e9-4984-bc92-fdcb5a8fcd16 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:17.503647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c7d2fa25-d3e9-4984-bc92-fdcb5a8fcd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:17.535607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:17.574922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 636/1289] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:29:17.853754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1ade0-1336-44ba-a84d-68875b5e3ba6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:17.965492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1ade0-1336-44ba-a84d-68875b5e3ba6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:17.979638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:18.005147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfe49e-ec98-4a01-a775-e9b5f1587c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:18.005778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe49e-ec98-4a01-a775-e9b5f1587c35 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:18.006056 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe49e-ec98-4a01-a775-e9b5f1587c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:18.006325 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe49e-ec98-4a01-a775-e9b5f1587c35 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:18.006931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfe49e-ec98-4a01-a775-e9b5f1587c35 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:18.008604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfe49e-ec98-4a01-a775-e9b5f1587c35 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-cdbfe49e-ec98-4a01-a775-e9b5f1587c35 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:18.019084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:18.020431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:18.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 654/1290] 10.222.0.91 () {56 vars in 1117 bytes} [Wed Aug 24 10:29:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:18.026321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2fa25-d3e9-4984-bc92-fdcb5a8fcd16 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:18.129350 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2fa25-d3e9-4984-bc92-fdcb5a8fcd16 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:18.165828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b0231-1433-45b2-ba4a-5759c0b8e150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:18.166432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0231-1433-45b2-ba4a-5759c0b8e150 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:18.166709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0231-1433-45b2-ba4a-5759c0b8e150 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:18.166980 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0231-1433-45b2-ba4a-5759c0b8e150 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:18.167602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b0231-1433-45b2-ba4a-5759c0b8e150 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:18.167931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b0231-1433-45b2-ba4a-5759c0b8e150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:18.169435 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b0231-1433-45b2-ba4a-5759c0b8e150 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:18.175564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 637/1291] 10.222.0.91 () {56 vars in 1116 bytes} [Wed Aug 24 10:29:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:18.181637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfe49e-ec98-4a01-a775-e9b5f1587c35 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:18.288940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfe49e-ec98-4a01-a775-e9b5f1587c35 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:18.332112 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800266fc-65c2-4781-a842-78ed042ef69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:18.332786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800266fc-65c2-4781-a842-78ed042ef69e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:18.333060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800266fc-65c2-4781-a842-78ed042ef69e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:18.333326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800266fc-65c2-4781-a842-78ed042ef69e None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:18.333997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800266fc-65c2-4781-a842-78ed042ef69e None admin] RBAC: Adding query filter params (type=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:18.334291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800266fc-65c2-4781-a842-78ed042ef69e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:18.335651 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800266fc-65c2-4781-a842-78ed042ef69e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:18.340387 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 655/1292] 10.222.0.91 () {56 vars in 1116 bytes} [Wed Aug 24 10:29:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:20.304968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b17a6-9fbd-4a15-a409-26f6a76a4e3e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:20.305688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b17a6-9fbd-4a15-a409-26f6a76a4e3e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:20.305688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b17a6-9fbd-4a15-a409-26f6a76a4e3e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:20.307549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 638/1293] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:20.314465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325ca56-dec0-4da3-ae4d-16f161d3877f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:20.315887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325ca56-dec0-4da3-ae4d-16f161d3877f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:20.315887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325ca56-dec0-4da3-ae4d-16f161d3877f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:20.334346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7325ca56-dec0-4da3-ae4d-16f161d3877f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:20.335555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7325ca56-dec0-4da3-ae4d-16f161d3877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:20.369644 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:20.412091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 656/1294] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:29:20.692984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b17a6-9fbd-4a15-a409-26f6a76a4e3e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:20.724169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:20.796825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b17a6-9fbd-4a15-a409-26f6a76a4e3e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:20.834784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997c2b9-9aa0-4d7f-b23c-2ba61f75df77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:20.835386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997c2b9-9aa0-4d7f-b23c-2ba61f75df77 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:20.835657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997c2b9-9aa0-4d7f-b23c-2ba61f75df77 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:20.835967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997c2b9-9aa0-4d7f-b23c-2ba61f75df77 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:20.836694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997c2b9-9aa0-4d7f-b23c-2ba61f75df77 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:20.838000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997c2b9-9aa0-4d7f-b23c-2ba61f75df77 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:20.943380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 639/1295] 10.222.0.91 () {60 vars in 1141 bytes} [Wed Aug 24 10:29:20 2022] POST /identity/v3/services => generated 246 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:29:22.931579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e5547-a957-488b-8cf8-c919ac52a1f5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.932137 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e5547-a957-488b-8cf8-c919ac52a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.932233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e5547-a957-488b-8cf8-c919ac52a1f5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.933521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 657/1296] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:22.939224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fd7a3-bb4f-471f-bb8b-fee085c0d0d3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.943290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fd7a3-bb4f-471f-bb8b-fee085c0d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.943290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fd7a3-bb4f-471f-bb8b-fee085c0d0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.959636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-966fd7a3-bb4f-471f-bb8b-fee085c0d0d3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:22.964360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-966fd7a3-bb4f-471f-bb8b-fee085c0d0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:23.047183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 640/1297] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:29:23.361255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e5547-a957-488b-8cf8-c919ac52a1f5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:23.486357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e5547-a957-488b-8cf8-c919ac52a1f5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:23.527166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2a2c6-c3f1-4d9f-b642-413e9354af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:23.527827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2a2c6-c3f1-4d9f-b642-413e9354af9e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:23.528104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2a2c6-c3f1-4d9f-b642-413e9354af9e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:23.528425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2a2c6-c3f1-4d9f-b642-413e9354af9e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:23.528952 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2a2c6-c3f1-4d9f-b642-413e9354af9e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:23.530320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2a2c6-c3f1-4d9f-b642-413e9354af9e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4cb2a2c6-c3f1-4d9f-b642-413e9354af9e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:23.540869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:23.549174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:23.551298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 658/1298] 10.222.0.91 () {56 vars in 1117 bytes} [Wed Aug 24 10:29:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:23.552886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fd7a3-bb4f-471f-bb8b-fee085c0d0d3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:23.568971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:23.666979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fd7a3-bb4f-471f-bb8b-fee085c0d0d3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:23.704703 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f8a5a-603f-4818-99ba-adf86ca06654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:23.705922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f8a5a-603f-4818-99ba-adf86ca06654 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:23.706588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f8a5a-603f-4818-99ba-adf86ca06654 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:23.706588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f8a5a-603f-4818-99ba-adf86ca06654 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:23.707214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f8a5a-603f-4818-99ba-adf86ca06654 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:23.707512 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f8a5a-603f-4818-99ba-adf86ca06654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:23.708926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f8a5a-603f-4818-99ba-adf86ca06654 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:23.714220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 641/1299] 10.222.0.91 () {56 vars in 1116 bytes} [Wed Aug 24 10:29:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:23.720931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2a2c6-c3f1-4d9f-b642-413e9354af9e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:23.763941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:23.872529 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2a2c6-c3f1-4d9f-b642-413e9354af9e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:23.926228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52833124-320c-4b4d-9409-a172df0ed6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:23.926774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52833124-320c-4b4d-9409-a172df0ed6ab None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:23.927049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52833124-320c-4b4d-9409-a172df0ed6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:23.927316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52833124-320c-4b4d-9409-a172df0ed6ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:23.928073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52833124-320c-4b4d-9409-a172df0ed6ab None admin] RBAC: Adding query filter params (interface=public, service_id=e8e4fa6b78164610b1d90a9de6aeb424, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:23.928379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52833124-320c-4b4d-9409-a172df0ed6ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:23.930239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52833124-320c-4b4d-9409-a172df0ed6ab None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:23.935797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 659/1300] 10.222.0.91 () {56 vars in 1251 bytes} [Wed Aug 24 10:29:23 2022] GET /identity/v3/endpoints?service_id=e8e4fa6b78164610b1d90a9de6aeb424&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:23.943889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f8a5a-603f-4818-99ba-adf86ca06654 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:24.060262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:24.085824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f8a5a-603f-4818-99ba-adf86ca06654 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:24.131029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87691b0d-9593-48ce-be85-560409ead3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:24.131637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87691b0d-9593-48ce-be85-560409ead3ae None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:24.131943 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87691b0d-9593-48ce-be85-560409ead3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:24.132211 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87691b0d-9593-48ce-be85-560409ead3ae None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:24.132844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87691b0d-9593-48ce-be85-560409ead3ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:24.134363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87691b0d-9593-48ce-be85-560409ead3ae None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:24.142236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 642/1301] 10.222.0.91 () {56 vars in 1087 bytes} [Wed Aug 24 10:29:23 2022] GET /identity/v3/services => generated 2191 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:29:26.137574 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43752fdb-f040-468b-aed9-d5bc29f9be5e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:26.138140 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43752fdb-f040-468b-aed9-d5bc29f9be5e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:26.138140 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43752fdb-f040-468b-aed9-d5bc29f9be5e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:26.139537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 660/1302] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:26.147572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07926b47-c95f-42ef-a689-6d05a1ca065c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:26.148339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07926b47-c95f-42ef-a689-6d05a1ca065c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:26.148674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07926b47-c95f-42ef-a689-6d05a1ca065c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:26.180500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-07926b47-c95f-42ef-a689-6d05a1ca065c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:26.181869 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-07926b47-c95f-42ef-a689-6d05a1ca065c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:26.281990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 643/1303] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:29:26.578483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43752fdb-f040-468b-aed9-d5bc29f9be5e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:26.717603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:26.726510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43752fdb-f040-468b-aed9-d5bc29f9be5e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:26.776024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9453dc1-e509-41a5-88ae-653fa3d140b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:26.776983 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9453dc1-e509-41a5-88ae-653fa3d140b1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:26.777389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9453dc1-e509-41a5-88ae-653fa3d140b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:26.777669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9453dc1-e509-41a5-88ae-653fa3d140b1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:26.778500 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9453dc1-e509-41a5-88ae-653fa3d140b1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:26.780701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9453dc1-e509-41a5-88ae-653fa3d140b1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c9453dc1-e509-41a5-88ae-653fa3d140b1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:26.795080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:26.796931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 24 10:29:26.798203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 661/1304] 10.222.0.91 () {56 vars in 1117 bytes} [Wed Aug 24 10:29:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:26.805685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07926b47-c95f-42ef-a689-6d05a1ca065c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:26.928557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:26.966618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07926b47-c95f-42ef-a689-6d05a1ca065c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:27.013594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6df527-8b42-4d38-a07c-b82370e8bf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:27.014284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6df527-8b42-4d38-a07c-b82370e8bf07 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:27.014622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6df527-8b42-4d38-a07c-b82370e8bf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:27.014939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6df527-8b42-4d38-a07c-b82370e8bf07 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:27.015948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6df527-8b42-4d38-a07c-b82370e8bf07 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:27.016312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6df527-8b42-4d38-a07c-b82370e8bf07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:27.018500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6df527-8b42-4d38-a07c-b82370e8bf07 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:27.024438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 644/1305] 10.222.0.91 () {56 vars in 1116 bytes} [Wed Aug 24 10:29:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:27.030865 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9453dc1-e509-41a5-88ae-653fa3d140b1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:27.150374 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9453dc1-e509-41a5-88ae-653fa3d140b1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:27.196896 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb938ab-98d6-4e3c-9f0a-f9c3d7a444bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:27.197635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb938ab-98d6-4e3c-9f0a-f9c3d7a444bb None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:27.197977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb938ab-98d6-4e3c-9f0a-f9c3d7a444bb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:27.198307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb938ab-98d6-4e3c-9f0a-f9c3d7a444bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:27.199019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb938ab-98d6-4e3c-9f0a-f9c3d7a444bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:27.202628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb938ab-98d6-4e3c-9f0a-f9c3d7a444bb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:27.314208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 662/1306] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:29:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:29:37.034632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=30 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:37.309043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:28.212667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a657c-b44c-4418-b009-4652c7428741 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:28.213238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a657c-b44c-4418-b009-4652c7428741 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:28.213238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a657c-b44c-4418-b009-4652c7428741 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:28.214621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 645/1307] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:36:28.220969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e306a6-574e-444f-8229-f10b1d2c3dca None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:28.221760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e306a6-574e-444f-8229-f10b1d2c3dca None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:28.222769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e306a6-574e-444f-8229-f10b1d2c3dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:28.328357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-34e306a6-574e-444f-8229-f10b1d2c3dca None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:28.328357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-34e306a6-574e-444f-8229-f10b1d2c3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:28.467776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 663/1308] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:28.838109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad260ca-497f-4799-9ed2-4078124c6578 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:28.838696 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad260ca-497f-4799-9ed2-4078124c6578 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:28.839098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad260ca-497f-4799-9ed2-4078124c6578 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:28.840636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 646/1309] 10.222.0.91 () {54 vars in 965 bytes} [Wed Aug 24 10:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:28.847251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318537-6205-4005-b15f-d4fe46f2e588 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:28.847530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318537-6205-4005-b15f-d4fe46f2e588 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:28.848077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318537-6205-4005-b15f-d4fe46f2e588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:28.945025 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-63318537-6205-4005-b15f-d4fe46f2e588 None None] MFA Rules not processed for user `8956453f963242a087d2f90d70ed8f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:28.947016 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-63318537-6205-4005-b15f-d4fe46f2e588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:28.977610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:29.066316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 664/1310] 10.222.0.91 () {58 vars in 1062 bytes} [Wed Aug 24 10:36:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:36:29.078889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad260ca-497f-4799-9ed2-4078124c6578 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:29.081173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fad260ca-497f-4799-9ed2-4078124c6578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:29.238664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad260ca-497f-4799-9ed2-4078124c6578 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:29.335497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365211b-b10a-4ae9-8b06-e7c72a74cb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:29.336214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365211b-b10a-4ae9-8b06-e7c72a74cb0e service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:29.336606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365211b-b10a-4ae9-8b06-e7c72a74cb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:29.336985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365211b-b10a-4ae9-8b06-e7c72a74cb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:29.338744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4365211b-b10a-4ae9-8b06-e7c72a74cb0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:29.404561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:29.485266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365211b-b10a-4ae9-8b06-e7c72a74cb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:29.486325 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365211b-b10a-4ae9-8b06-e7c72a74cb0e service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:29.509127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 647/1311] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:32.018275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0991c61-c8f6-40fa-8fbe-9330ccf3b95f None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:32.018786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0991c61-c8f6-40fa-8fbe-9330ccf3b95f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:32.018786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0991c61-c8f6-40fa-8fbe-9330ccf3b95f None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:32.020090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 665/1312] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:32.026620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e982778-6cd5-4ca8-bef1-6db3d75b2ea8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:32.027120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e982778-6cd5-4ca8-bef1-6db3d75b2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:32.027216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e982778-6cd5-4ca8-bef1-6db3d75b2ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:32.114406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9e982778-6cd5-4ca8-bef1-6db3d75b2ea8 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:32.115873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9e982778-6cd5-4ca8-bef1-6db3d75b2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:32.239198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 648/1313] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:32.529548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0991c61-c8f6-40fa-8fbe-9330ccf3b95f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:32.531126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e0991c61-c8f6-40fa-8fbe-9330ccf3b95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:32.647875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0991c61-c8f6-40fa-8fbe-9330ccf3b95f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:32.733707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:32.736586 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5c362-b51c-4db0-8778-0e8f2995e31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:32.737237 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5c362-b51c-4db0-8778-0e8f2995e31c service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:32.737554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5c362-b51c-4db0-8778-0e8f2995e31c service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:32.737867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5c362-b51c-4db0-8778-0e8f2995e31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:32.739588 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4ab5c362-b51c-4db0-8778-0e8f2995e31c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:32.874299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5c362-b51c-4db0-8778-0e8f2995e31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:32.875776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5c362-b51c-4db0-8778-0e8f2995e31c service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:32.895871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 666/1314] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:35.554420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84d9ea-b0fd-4810-8e65-75d7eef0756d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:35.554971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84d9ea-b0fd-4810-8e65-75d7eef0756d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:35.554971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84d9ea-b0fd-4810-8e65-75d7eef0756d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:35.556424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 649/1315] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:36:35.563357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4231d6b-36f5-4b8b-88da-e3ea457baae2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:35.564176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4231d6b-36f5-4b8b-88da-e3ea457baae2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:35.564176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4231d6b-36f5-4b8b-88da-e3ea457baae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:35.647056 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a4231d6b-36f5-4b8b-88da-e3ea457baae2 None None] MFA Rules not processed for user `1c055d472f134e8781758d53d4d6ec52`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:35.648241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a4231d6b-36f5-4b8b-88da-e3ea457baae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:35.718014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:35.770664 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 667/1316] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:35 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:36.069671 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84d9ea-b0fd-4810-8e65-75d7eef0756d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:36.071246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7d84d9ea-b0fd-4810-8e65-75d7eef0756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:36.081407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:36.190976 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84d9ea-b0fd-4810-8e65-75d7eef0756d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:36.273572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abf3dc-6a36-44db-9066-cc857b067688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:36.274190 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abf3dc-6a36-44db-9066-cc857b067688 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:36.274468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abf3dc-6a36-44db-9066-cc857b067688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:36.274740 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abf3dc-6a36-44db-9066-cc857b067688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:36.276420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c7abf3dc-6a36-44db-9066-cc857b067688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:36.349007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:36.403422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abf3dc-6a36-44db-9066-cc857b067688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:36.405120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abf3dc-6a36-44db-9066-cc857b067688 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:36.427066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 650/1317] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:39.244411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0d28-b5fc-4e3f-9d50-0c285f76b28d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:39.244947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0d28-b5fc-4e3f-9d50-0c285f76b28d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:39.245045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0d28-b5fc-4e3f-9d50-0c285f76b28d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:39.246450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 668/1318] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:39.252073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09693b-4b79-46ee-b6ed-e401eccc53bc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:39.252511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09693b-4b79-46ee-b6ed-e401eccc53bc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:39.252628 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09693b-4b79-46ee-b6ed-e401eccc53bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:39.323344 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ba09693b-4b79-46ee-b6ed-e401eccc53bc None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:39.324563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ba09693b-4b79-46ee-b6ed-e401eccc53bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:39.425561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 651/1319] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:39.733288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ddb2e-1e81-4f38-9fdd-6f70c9c0ca05 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:39.733736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ddb2e-1e81-4f38-9fdd-6f70c9c0ca05 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:39.733736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ddb2e-1e81-4f38-9fdd-6f70c9c0ca05 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:39.735334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 669/1320] 10.222.0.91 () {54 vars in 965 bytes} [Wed Aug 24 10:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:39.741380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815569c1-4efe-4135-baa2-5d96c685d293 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:39.741692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815569c1-4efe-4135-baa2-5d96c685d293 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:39.741980 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815569c1-4efe-4135-baa2-5d96c685d293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:39.765675 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:39.837015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-815569c1-4efe-4135-baa2-5d96c685d293 None None] MFA Rules not processed for user `8956453f963242a087d2f90d70ed8f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:39.838943 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-815569c1-4efe-4135-baa2-5d96c685d293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:39.925231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 652/1321] 10.222.0.91 () {58 vars in 1062 bytes} [Wed Aug 24 10:36:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:39.935771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ddb2e-1e81-4f38-9fdd-6f70c9c0ca05 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:39.937349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-672ddb2e-1e81-4f38-9fdd-6f70c9c0ca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:40.043279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ddb2e-1e81-4f38-9fdd-6f70c9c0ca05 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:40.120036 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522a978-f52a-4dcc-bb9c-4b38e2ecce09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:40.120635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522a978-f52a-4dcc-bb9c-4b38e2ecce09 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:40.120910 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522a978-f52a-4dcc-bb9c-4b38e2ecce09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:40.121179 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522a978-f52a-4dcc-bb9c-4b38e2ecce09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:40.122787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7522a978-f52a-4dcc-bb9c-4b38e2ecce09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:40.130857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:40.243102 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522a978-f52a-4dcc-bb9c-4b38e2ecce09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:40.244559 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522a978-f52a-4dcc-bb9c-4b38e2ecce09 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:40.264604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 670/1322] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:43.781471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7d3d-4883-4c29-9520-01ead5a8f805 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:43.782030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7d3d-4883-4c29-9520-01ead5a8f805 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:43.782030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7d3d-4883-4c29-9520-01ead5a8f805 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:43.783347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 653/1323] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:43.790035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3547d-97a0-4d3a-8d23-af251c8c668e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:43.790826 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3547d-97a0-4d3a-8d23-af251c8c668e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:43.790826 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3547d-97a0-4d3a-8d23-af251c8c668e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:43.877782 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-23d3547d-97a0-4d3a-8d23-af251c8c668e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:43.879610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-23d3547d-97a0-4d3a-8d23-af251c8c668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:43.944566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:43.988748 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 671/1324] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:44.281644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff7d3d-4883-4c29-9520-01ead5a8f805 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:44.283493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f5ff7d3d-4883-4c29-9520-01ead5a8f805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:44.414950 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff7d3d-4883-4c29-9520-01ead5a8f805 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:44.428593 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:44.516448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3b077-9a30-4a8d-b4fa-915c54e8aab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:44.517058 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3b077-9a30-4a8d-b4fa-915c54e8aab4 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:44.517336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3b077-9a30-4a8d-b4fa-915c54e8aab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:44.517609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3b077-9a30-4a8d-b4fa-915c54e8aab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:44.519218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2fb3b077-9a30-4a8d-b4fa-915c54e8aab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:44.642712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3b077-9a30-4a8d-b4fa-915c54e8aab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:44.644114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3b077-9a30-4a8d-b4fa-915c54e8aab4 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:44.665300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 654/1325] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:46.690154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f28311-8fef-4b65-bd9c-f220431d478a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:46.690689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f28311-8fef-4b65-bd9c-f220431d478a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:46.690689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f28311-8fef-4b65-bd9c-f220431d478a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:46.692127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 672/1326] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:46.698978 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503c86-c293-41b9-9e5a-a0b83f2fbd29 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:46.699444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503c86-c293-41b9-9e5a-a0b83f2fbd29 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:46.699533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503c86-c293-41b9-9e5a-a0b83f2fbd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:46.757505 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:46.777813 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-47503c86-c293-41b9-9e5a-a0b83f2fbd29 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:46.779294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-47503c86-c293-41b9-9e5a-a0b83f2fbd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:46.888508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 655/1327] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:47.183710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f28311-8fef-4b65-bd9c-f220431d478a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:47.185589 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-64f28311-8fef-4b65-bd9c-f220431d478a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:47.308543 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f28311-8fef-4b65-bd9c-f220431d478a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:47.394220 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f6821-4674-4473-a3f3-f0b6f6355e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:47.394833 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f6821-4674-4473-a3f3-f0b6f6355e38 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:47.395111 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f6821-4674-4473-a3f3-f0b6f6355e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:47.395386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f6821-4674-4473-a3f3-f0b6f6355e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:47.397196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c39f6821-4674-4473-a3f3-f0b6f6355e38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:47.416707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:47.534848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f6821-4674-4473-a3f3-f0b6f6355e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:47.536847 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f6821-4674-4473-a3f3-f0b6f6355e38 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:47.556950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 673/1328] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:49.610392 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d9101-9f0b-4f1d-be51-e20e28397b65 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:49.611438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d9101-9f0b-4f1d-be51-e20e28397b65 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:49.611438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d9101-9f0b-4f1d-be51-e20e28397b65 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:49.612969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 656/1329] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:49.620281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250d047-54d6-41ab-b6f5-0843fe6fae99 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:49.620786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250d047-54d6-41ab-b6f5-0843fe6fae99 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:49.620968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250d047-54d6-41ab-b6f5-0843fe6fae99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:49.699992 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2250d047-54d6-41ab-b6f5-0843fe6fae99 None None] MFA Rules not processed for user `1c055d472f134e8781758d53d4d6ec52`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:49.702208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2250d047-54d6-41ab-b6f5-0843fe6fae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:49.784131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:49.835995 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 674/1330] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:50.132108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d9101-9f0b-4f1d-be51-e20e28397b65 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:50.133994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b87d9101-9f0b-4f1d-be51-e20e28397b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:50.280192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d9101-9f0b-4f1d-be51-e20e28397b65 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:50.307528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:50.371070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11dc1a-c575-4f84-8246-d2444223d23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:50.371685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11dc1a-c575-4f84-8246-d2444223d23e service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:50.372052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11dc1a-c575-4f84-8246-d2444223d23e service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:50.372331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11dc1a-c575-4f84-8246-d2444223d23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:50.373969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5b11dc1a-c575-4f84-8246-d2444223d23e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:50.497080 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11dc1a-c575-4f84-8246-d2444223d23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:50.498408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11dc1a-c575-4f84-8246-d2444223d23e service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:50.516862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 657/1331] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:53.108600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc0088-8d0d-4621-9f46-ffc6cfd2206d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:53.109127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc0088-8d0d-4621-9f46-ffc6cfd2206d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:53.109127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc0088-8d0d-4621-9f46-ffc6cfd2206d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:53.110664 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 675/1332] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:53.116131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec18ee3-837c-4036-bed7-788c8207a53f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:53.116617 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec18ee3-837c-4036-bed7-788c8207a53f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:53.116708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec18ee3-837c-4036-bed7-788c8207a53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:53.184853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:53.187534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-eec18ee3-837c-4036-bed7-788c8207a53f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:53.188773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eec18ee3-837c-4036-bed7-788c8207a53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:53.294746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 658/1333] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:36:53.581636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc0088-8d0d-4621-9f46-ffc6cfd2206d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:53.583709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-52dc0088-8d0d-4621-9f46-ffc6cfd2206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:53.696058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc0088-8d0d-4621-9f46-ffc6cfd2206d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:53.779291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba2c24-eb3a-4bf8-8790-4dd7a0380df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:53.779939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba2c24-eb3a-4bf8-8790-4dd7a0380df9 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:53.780214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba2c24-eb3a-4bf8-8790-4dd7a0380df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:53.780489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba2c24-eb3a-4bf8-8790-4dd7a0380df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:53.782106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-caba2c24-eb3a-4bf8-8790-4dd7a0380df9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:53.813848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:53.917280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba2c24-eb3a-4bf8-8790-4dd7a0380df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:53.918986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba2c24-eb3a-4bf8-8790-4dd7a0380df9 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:53.940127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 676/1334] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:55.991968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a923e-c258-4e2d-b19a-069c751e3d2e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:55.992599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a923e-c258-4e2d-b19a-069c751e3d2e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:55.992599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a923e-c258-4e2d-b19a-069c751e3d2e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:55.993858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 659/1335] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:55.999302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a5300-654a-4a92-b3f2-60bf17d47155 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:55.999789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a5300-654a-4a92-b3f2-60bf17d47155 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:55.999898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a5300-654a-4a92-b3f2-60bf17d47155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:56.069930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a44a5300-654a-4a92-b3f2-60bf17d47155 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:56.071157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a44a5300-654a-4a92-b3f2-60bf17d47155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:56.155066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:56.178453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 677/1336] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:56.477693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a923e-c258-4e2d-b19a-069c751e3d2e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:56.485977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f64a923e-c258-4e2d-b19a-069c751e3d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:56.600148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a923e-c258-4e2d-b19a-069c751e3d2e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:56.631779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:56.684697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c01f2-d336-41ec-921c-8214316a65f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:56.685308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c01f2-d336-41ec-921c-8214316a65f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:56.685584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c01f2-d336-41ec-921c-8214316a65f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:56.685852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c01f2-d336-41ec-921c-8214316a65f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:56.687487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5f1c01f2-d336-41ec-921c-8214316a65f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:56.804953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c01f2-d336-41ec-921c-8214316a65f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:56.806378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c01f2-d336-41ec-921c-8214316a65f2 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:56.824214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 660/1337] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:59.454065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc0618-f729-4572-9747-4f867aeb74c8 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:59.454620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc0618-f729-4572-9747-4f867aeb74c8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:59.454620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc0618-f729-4572-9747-4f867aeb74c8 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:59.455981 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 678/1338] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:59.461984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8113c-69c6-4019-86a8-c79213a9890d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:59.462466 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8113c-69c6-4019-86a8-c79213a9890d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:59.462596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8113c-69c6-4019-86a8-c79213a9890d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:59.532741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7bf8113c-69c6-4019-86a8-c79213a9890d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:59.533961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7bf8113c-69c6-4019-86a8-c79213a9890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:59.542733 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:59.635558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 661/1339] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:59.928496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc0618-f729-4572-9747-4f867aeb74c8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:59.930729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a7bc0618-f729-4572-9747-4f867aeb74c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:00.039204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc0618-f729-4572-9747-4f867aeb74c8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:00.118174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f274c-9c47-4b64-8693-fa0ccc5e6caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:00.118776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f274c-9c47-4b64-8693-fa0ccc5e6caa service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:00.119051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f274c-9c47-4b64-8693-fa0ccc5e6caa service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:00.119349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f274c-9c47-4b64-8693-fa0ccc5e6caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:00.121019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e89f274c-9c47-4b64-8693-fa0ccc5e6caa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:00.158025 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:00.235299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f274c-9c47-4b64-8693-fa0ccc5e6caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:00.236777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f274c-9c47-4b64-8693-fa0ccc5e6caa service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:00.258040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 679/1340] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:04.508019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9936d-cd9a-4284-8505-e3f237821325 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:04.508533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9936d-cd9a-4284-8505-e3f237821325 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:04.508533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9936d-cd9a-4284-8505-e3f237821325 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:04.510122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 662/1341] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:04.516029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6db36-fb59-44a9-a10d-a5eb042fb58b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:04.516527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6db36-fb59-44a9-a10d-a5eb042fb58b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:04.516640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6db36-fb59-44a9-a10d-a5eb042fb58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:04.589764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e0e6db36-fb59-44a9-a10d-a5eb042fb58b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:04.591028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e0e6db36-fb59-44a9-a10d-a5eb042fb58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:04.685410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:04.697355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 680/1342] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:04.986052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9936d-cd9a-4284-8505-e3f237821325 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:04.987594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-33b9936d-cd9a-4284-8505-e3f237821325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:05.108285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9936d-cd9a-4284-8505-e3f237821325 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:05.140503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:05.177924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf5781-fed9-419c-a014-8f4d92768920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:05.178552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf5781-fed9-419c-a014-8f4d92768920 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:05.178998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf5781-fed9-419c-a014-8f4d92768920 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:05.179646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf5781-fed9-419c-a014-8f4d92768920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:05.181756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-77cf5781-fed9-419c-a014-8f4d92768920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:05.296702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf5781-fed9-419c-a014-8f4d92768920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:05.298219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf5781-fed9-419c-a014-8f4d92768920 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:05.318740 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 663/1343] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:08.252925 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33744d-cf79-4b0a-851d-11ef00cbff6e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:08.253578 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33744d-cf79-4b0a-851d-11ef00cbff6e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:08.253578 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33744d-cf79-4b0a-851d-11ef00cbff6e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:08.255102 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 681/1344] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:08.260940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c3dd6-01ca-420d-9cc9-7eed94d3ab86 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:08.261386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c3dd6-01ca-420d-9cc9-7eed94d3ab86 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:08.261502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c3dd6-01ca-420d-9cc9-7eed94d3ab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:08.333589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4d5c3dd6-01ca-420d-9cc9-7eed94d3ab86 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:08.334798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4d5c3dd6-01ca-420d-9cc9-7eed94d3ab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:08.353983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:08.436251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 664/1345] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:08.723233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33744d-cf79-4b0a-851d-11ef00cbff6e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:08.724944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5f33744d-cf79-4b0a-851d-11ef00cbff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:08.837908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33744d-cf79-4b0a-851d-11ef00cbff6e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:08.920186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb447f0e-ccf4-4fef-a8d7-b2e11cafb16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:08.920807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb447f0e-ccf4-4fef-a8d7-b2e11cafb16b service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:08.921228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb447f0e-ccf4-4fef-a8d7-b2e11cafb16b service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:08.921607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb447f0e-ccf4-4fef-a8d7-b2e11cafb16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:08.923255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cb447f0e-ccf4-4fef-a8d7-b2e11cafb16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:08.970812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:09.052668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb447f0e-ccf4-4fef-a8d7-b2e11cafb16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:09.053732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb447f0e-ccf4-4fef-a8d7-b2e11cafb16b service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:09.073089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 682/1346] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:13.878394 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140de15-43d5-470a-ae86-0a6aa920d22f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:13.879404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140de15-43d5-470a-ae86-0a6aa920d22f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:13.879979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140de15-43d5-470a-ae86-0a6aa920d22f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:13.881483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 665/1347] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:13.887486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c7ec4-f754-4fac-9a9a-cc003eabf76b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:13.888041 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c7ec4-f754-4fac-9a9a-cc003eabf76b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:13.888131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c7ec4-f754-4fac-9a9a-cc003eabf76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:13.966444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-fc6c7ec4-f754-4fac-9a9a-cc003eabf76b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:13.967669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fc6c7ec4-f754-4fac-9a9a-cc003eabf76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:14.075152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:14.077834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 683/1348] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:14.373413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140de15-43d5-470a-ae86-0a6aa920d22f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:14.375131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a140de15-43d5-470a-ae86-0a6aa920d22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:14.520009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140de15-43d5-470a-ae86-0a6aa920d22f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:14.578571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:14.617045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca33253-34b5-4d37-825d-6570dc5e17d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:14.617567 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca33253-34b5-4d37-825d-6570dc5e17d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:14.617847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca33253-34b5-4d37-825d-6570dc5e17d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:14.618118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca33253-34b5-4d37-825d-6570dc5e17d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:14.619786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dca33253-34b5-4d37-825d-6570dc5e17d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:14.736353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca33253-34b5-4d37-825d-6570dc5e17d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:14.737796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca33253-34b5-4d37-825d-6570dc5e17d0 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:14.759050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 666/1349] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:19.921551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242728e-cd8e-4ea8-9f27-e2bc423e5d3a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:19.931804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242728e-cd8e-4ea8-9f27-e2bc423e5d3a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:19.932319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242728e-cd8e-4ea8-9f27-e2bc423e5d3a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:19.934278 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 684/1350] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:37:19 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:19.944068 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c5a11-de38-4443-a120-0a6c40ca0f87 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:19.944556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c5a11-de38-4443-a120-0a6c40ca0f87 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:19.947740 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c5a11-de38-4443-a120-0a6c40ca0f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:20.060775 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e66c5a11-de38-4443-a120-0a6c40ca0f87 None None] MFA Rules not processed for user `8ebfb233b2504463a4ee9202b5a3ab50`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:20.062060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e66c5a11-de38-4443-a120-0a6c40ca0f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:20.084123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:20.200474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 667/1351] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:37:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:24.328932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3a71-dd2d-4bf3-90a7-4d87cd304458 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:24.328932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3a71-dd2d-4bf3-90a7-4d87cd304458 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:24.328932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3a71-dd2d-4bf3-90a7-4d87cd304458 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:24.330525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 685/1352] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:24.336401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975487-d7f6-42e3-96b7-c12bc54928e4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:24.337150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975487-d7f6-42e3-96b7-c12bc54928e4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:24.337150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975487-d7f6-42e3-96b7-c12bc54928e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:24.428899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7c975487-d7f6-42e3-96b7-c12bc54928e4 None None] MFA Rules not processed for user `8ebfb233b2504463a4ee9202b5a3ab50`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:24.430129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7c975487-d7f6-42e3-96b7-c12bc54928e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:24.530818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:24.571611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 668/1353] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:37:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:26.078637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e42754-2521-4976-8cb2-54fda34babf3 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:26.079146 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e42754-2521-4976-8cb2-54fda34babf3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:26.079146 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e42754-2521-4976-8cb2-54fda34babf3 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:26.080472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 686/1354] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:26.086274 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e8d38-fb1c-4568-809c-42915c1fac56 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:26.086822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e8d38-fb1c-4568-809c-42915c1fac56 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:26.086822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e8d38-fb1c-4568-809c-42915c1fac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:26.174846 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-202e8d38-fb1c-4568-809c-42915c1fac56 None None] MFA Rules not processed for user `8ebfb233b2504463a4ee9202b5a3ab50`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:26.176215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-202e8d38-fb1c-4568-809c-42915c1fac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:26.294905 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 669/1355] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:37:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:29.748318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a75c-1653-4ec9-b599-73bd84d38b8d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:29.751468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a75c-1653-4ec9-b599-73bd84d38b8d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:29.751468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a75c-1653-4ec9-b599-73bd84d38b8d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:29.751468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 687/1356] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:29.755816 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a7abd-d3e7-4d7f-bf54-4b66f459f1ff None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:29.756280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a7abd-d3e7-4d7f-bf54-4b66f459f1ff None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:29.756444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a7abd-d3e7-4d7f-bf54-4b66f459f1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:29.796613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:29.843963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c74a7abd-d3e7-4d7f-bf54-4b66f459f1ff None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:29.845335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c74a7abd-d3e7-4d7f-bf54-4b66f459f1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:29.985655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 670/1357] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:30.328620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a802c-7b6b-46b0-b0ac-3a5b2d69101a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:30.329154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a802c-7b6b-46b0-b0ac-3a5b2d69101a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:30.329622 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a802c-7b6b-46b0-b0ac-3a5b2d69101a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:30.332911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 688/1358] 10.222.0.91 () {54 vars in 962 bytes} [Wed Aug 24 10:37:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:30.341521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c8d5d-876a-43b1-b020-e8ae57a8f1e8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:30.342966 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c8d5d-876a-43b1-b020-e8ae57a8f1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:30.343398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c8d5d-876a-43b1-b020-e8ae57a8f1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:30.440173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8c1c8d5d-876a-43b1-b020-e8ae57a8f1e8 None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:30.441999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8c1c8d5d-876a-43b1-b020-e8ae57a8f1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:30.514865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:30.586062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 671/1359] 10.222.0.91 () {58 vars in 1059 bytes} [Wed Aug 24 10:37:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:37:30.593771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a802c-7b6b-46b0-b0ac-3a5b2d69101a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:30.595287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-913a802c-7b6b-46b0-b0ac-3a5b2d69101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:30.759736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a802c-7b6b-46b0-b0ac-3a5b2d69101a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:30.839575 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:30.887569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fb170-4068-4c5e-8cf3-14e4688b77f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:30.888802 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fb170-4068-4c5e-8cf3-14e4688b77f9 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:30.889197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fb170-4068-4c5e-8cf3-14e4688b77f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:30.890064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fb170-4068-4c5e-8cf3-14e4688b77f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:30.891858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3b8fb170-4068-4c5e-8cf3-14e4688b77f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:30.997366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fb170-4068-4c5e-8cf3-14e4688b77f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:30.999387 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fb170-4068-4c5e-8cf3-14e4688b77f9 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:31.024584 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 689/1360] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:33.201284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd9d6-407a-4f1a-b5a7-c7ad5a57dd47 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:33.202197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd9d6-407a-4f1a-b5a7-c7ad5a57dd47 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:33.202197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd9d6-407a-4f1a-b5a7-c7ad5a57dd47 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:33.203890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 672/1361] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:37:33.209714 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da279-da58-414c-940f-bde1420361db None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:33.210570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da279-da58-414c-940f-bde1420361db None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:33.210570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da279-da58-414c-940f-bde1420361db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:33.305470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c59da279-da58-414c-940f-bde1420361db None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:33.306888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c59da279-da58-414c-940f-bde1420361db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:33.352596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:33.432432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 690/1362] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:33.730346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dd9d6-407a-4f1a-b5a7-c7ad5a57dd47 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:33.732718 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fd8dd9d6-407a-4f1a-b5a7-c7ad5a57dd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:33.915578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dd9d6-407a-4f1a-b5a7-c7ad5a57dd47 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:33.927278 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:34.042632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63b84b-ac65-441d-9e8f-bb449b7063dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:34.043247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63b84b-ac65-441d-9e8f-bb449b7063dc service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:34.043670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63b84b-ac65-441d-9e8f-bb449b7063dc service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:34.043973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63b84b-ac65-441d-9e8f-bb449b7063dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:34.045615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7c63b84b-ac65-441d-9e8f-bb449b7063dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:34.149473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63b84b-ac65-441d-9e8f-bb449b7063dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:34.151087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63b84b-ac65-441d-9e8f-bb449b7063dc service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:34.172383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 673/1363] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:36.798022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51bdb0-90ad-4f58-ba4e-f66961538231 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:36.798545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51bdb0-90ad-4f58-ba4e-f66961538231 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:36.798545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51bdb0-90ad-4f58-ba4e-f66961538231 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:36.799858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 691/1364] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:36.806166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad671d92-cb5c-4f26-bbae-d2c30a15634c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:36.806984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad671d92-cb5c-4f26-bbae-d2c30a15634c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:36.807260 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad671d92-cb5c-4f26-bbae-d2c30a15634c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:36.824837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:36.883111 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ad671d92-cb5c-4f26-bbae-d2c30a15634c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:36.884397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ad671d92-cb5c-4f26-bbae-d2c30a15634c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:37.060180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 674/1365] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:37.423559 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679c218-9983-4adb-bbfd-dd99bfdd081a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:37.423884 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679c218-9983-4adb-bbfd-dd99bfdd081a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:37.424163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679c218-9983-4adb-bbfd-dd99bfdd081a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:37.426860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 692/1366] 10.222.0.91 () {54 vars in 962 bytes} [Wed Aug 24 10:37:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:37.432840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20574eaf-9021-4c37-ad2d-fe2fd6f5fd48 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:37.433358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20574eaf-9021-4c37-ad2d-fe2fd6f5fd48 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:37.433699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20574eaf-9021-4c37-ad2d-fe2fd6f5fd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:37.516551 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-20574eaf-9021-4c37-ad2d-fe2fd6f5fd48 None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:37.517755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-20574eaf-9021-4c37-ad2d-fe2fd6f5fd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:37.556937 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:37.653893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 675/1367] 10.222.0.91 () {58 vars in 1059 bytes} [Wed Aug 24 10:37:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:37.662653 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679c218-9983-4adb-bbfd-dd99bfdd081a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:37.664215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a679c218-9983-4adb-bbfd-dd99bfdd081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:37.825169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679c218-9983-4adb-bbfd-dd99bfdd081a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:37.847569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:37.947005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596d7a6-4035-48dc-beff-3e91138a5640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:37.947618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596d7a6-4035-48dc-beff-3e91138a5640 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:37.947926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596d7a6-4035-48dc-beff-3e91138a5640 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:37.948203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596d7a6-4035-48dc-beff-3e91138a5640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:37.949817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c596d7a6-4035-48dc-beff-3e91138a5640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:38.046456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596d7a6-4035-48dc-beff-3e91138a5640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:38.048112 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596d7a6-4035-48dc-beff-3e91138a5640 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:38.067668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 693/1368] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:38.385576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fccbc-49d9-4903-b9f3-baf05beab277 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:38.385576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fccbc-49d9-4903-b9f3-baf05beab277 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:38.385576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fccbc-49d9-4903-b9f3-baf05beab277 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:38.386273 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 676/1369] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:38.391975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee0193-3622-40c5-9598-8131c5e2c1d1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:38.392265 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee0193-3622-40c5-9598-8131c5e2c1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:38.392532 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee0193-3622-40c5-9598-8131c5e2c1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:38.446104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:38.510858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1dee0193-3622-40c5-9598-8131c5e2c1d1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:38.512880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1dee0193-3622-40c5-9598-8131c5e2c1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:38.664544 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 694/1370] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:39.233953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d06589-921a-4d1b-bd80-11b4d1c13c3a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:39.234248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d06589-921a-4d1b-bd80-11b4d1c13c3a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:39.234589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d06589-921a-4d1b-bd80-11b4d1c13c3a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:39.236153 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 677/1371] 10.222.0.91 () {54 vars in 964 bytes} [Wed Aug 24 10:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:39.242588 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfe412-3c3d-48ce-851e-981ab50f740c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:39.243385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfe412-3c3d-48ce-851e-981ab50f740c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:39.244051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfe412-3c3d-48ce-851e-981ab50f740c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:39.348102 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-27dfe412-3c3d-48ce-851e-981ab50f740c None None] MFA Rules not processed for user `dc05a509ea1c4aa582380541cfc37989`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:39.349727 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-27dfe412-3c3d-48ce-851e-981ab50f740c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:39.418621 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:39.461281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 695/1372] 10.222.0.91 () {58 vars in 1061 bytes} [Wed Aug 24 10:37:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:39.468951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d06589-921a-4d1b-bd80-11b4d1c13c3a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:39.470467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-96d06589-921a-4d1b-bd80-11b4d1c13c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:39.589937 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d06589-921a-4d1b-bd80-11b4d1c13c3a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:39.635382 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:39.683624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30179b1-0cfe-4714-b1e7-08af6935aa4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:39.684461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30179b1-0cfe-4714-b1e7-08af6935aa4e service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:39.685016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30179b1-0cfe-4714-b1e7-08af6935aa4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:39.685683 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30179b1-0cfe-4714-b1e7-08af6935aa4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:39.687244 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a30179b1-0cfe-4714-b1e7-08af6935aa4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:39.824588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30179b1-0cfe-4714-b1e7-08af6935aa4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:39.826323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30179b1-0cfe-4714-b1e7-08af6935aa4e service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:39.856127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 678/1373] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:40.401887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f7cc5-4b1d-45a9-95fb-085ed8e58841 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:40.402438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f7cc5-4b1d-45a9-95fb-085ed8e58841 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:40.402438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f7cc5-4b1d-45a9-95fb-085ed8e58841 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:40.403840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 696/1374] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:40.409638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae7792-8914-4019-97c9-5849698018a5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:40.410005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae7792-8914-4019-97c9-5849698018a5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:40.410547 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae7792-8914-4019-97c9-5849698018a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:40.484839 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-97ae7792-8914-4019-97c9-5849698018a5 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:40.486037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-97ae7792-8914-4019-97c9-5849698018a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:40.508347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:40.585610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 679/1375] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:40.882780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f7cc5-4b1d-45a9-95fb-085ed8e58841 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:40.884331 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cd8f7cc5-4b1d-45a9-95fb-085ed8e58841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:41.042150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f7cc5-4b1d-45a9-95fb-085ed8e58841 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:41.112609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:41.179469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44824686-9caf-4dcd-bf3d-5ca5c104ba78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:41.180100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44824686-9caf-4dcd-bf3d-5ca5c104ba78 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:41.180377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44824686-9caf-4dcd-bf3d-5ca5c104ba78 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:41.180649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44824686-9caf-4dcd-bf3d-5ca5c104ba78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:41.182321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-44824686-9caf-4dcd-bf3d-5ca5c104ba78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:41.279432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44824686-9caf-4dcd-bf3d-5ca5c104ba78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:41.281071 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44824686-9caf-4dcd-bf3d-5ca5c104ba78 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:41.300388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 697/1376] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:43.431785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50427550-27f9-4d58-a536-3ceeb93fa5a8 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:43.432304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50427550-27f9-4d58-a536-3ceeb93fa5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:43.432445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50427550-27f9-4d58-a536-3ceeb93fa5a8 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:43.433736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 680/1377] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:43.439757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af5e25-9146-4e70-8ad2-87d1a12b8520 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:43.441373 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af5e25-9146-4e70-8ad2-87d1a12b8520 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:43.441373 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af5e25-9146-4e70-8ad2-87d1a12b8520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:43.514824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-45af5e25-9146-4e70-8ad2-87d1a12b8520 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:43.516079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-45af5e25-9146-4e70-8ad2-87d1a12b8520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:43.523615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:43.647179 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 698/1378] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:43.954809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50427550-27f9-4d58-a536-3ceeb93fa5a8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:43.956868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-50427550-27f9-4d58-a536-3ceeb93fa5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:44.129467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50427550-27f9-4d58-a536-3ceeb93fa5a8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:44.134854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:44.278501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cf950-03c0-4943-b20a-9182dbc1225c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:44.279063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cf950-03c0-4943-b20a-9182dbc1225c service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:44.279351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cf950-03c0-4943-b20a-9182dbc1225c service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:44.279612 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cf950-03c0-4943-b20a-9182dbc1225c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:44.281306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-633cf950-03c0-4943-b20a-9182dbc1225c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:44.405125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cf950-03c0-4943-b20a-9182dbc1225c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:44.406781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cf950-03c0-4943-b20a-9182dbc1225c service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:44.433542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 681/1379] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:46.619710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765452-79c2-4372-b272-0607672f74be None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:46.620255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765452-79c2-4372-b272-0607672f74be None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:46.620255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765452-79c2-4372-b272-0607672f74be None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:46.625801 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 699/1380] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:46.627591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7b8a9-22c1-4880-ac0e-ba2028c08f70 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:46.628967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7b8a9-22c1-4880-ac0e-ba2028c08f70 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:46.629577 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7b8a9-22c1-4880-ac0e-ba2028c08f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:46.645665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:46.722820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-62f7b8a9-22c1-4880-ac0e-ba2028c08f70 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:46.724065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-62f7b8a9-22c1-4880-ac0e-ba2028c08f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:46.839396 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 682/1381] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:47.137354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765452-79c2-4372-b272-0607672f74be None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:47.140639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9e765452-79c2-4372-b272-0607672f74be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:47.309749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:47.323029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765452-79c2-4372-b272-0607672f74be None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:47.472413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35664ce0-a62a-4930-aaf2-1d5676c657c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:47.473091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35664ce0-a62a-4930-aaf2-1d5676c657c5 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:47.473377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35664ce0-a62a-4930-aaf2-1d5676c657c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:47.473651 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35664ce0-a62a-4930-aaf2-1d5676c657c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:47.475316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-35664ce0-a62a-4930-aaf2-1d5676c657c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:47.586971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35664ce0-a62a-4930-aaf2-1d5676c657c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:47.588621 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35664ce0-a62a-4930-aaf2-1d5676c657c5 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:47.599661 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:47.607916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 700/1382] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:49.877208 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77082c26-6420-4e19-88d9-acb2efe08b6d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:49.877781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77082c26-6420-4e19-88d9-acb2efe08b6d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:49.877906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77082c26-6420-4e19-88d9-acb2efe08b6d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:49.879223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 683/1383] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:49.886569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6b93-d418-453b-a9e5-33532a4cd2b3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:49.887087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6b93-d418-453b-a9e5-33532a4cd2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:49.887216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6b93-d418-453b-a9e5-33532a4cd2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:49.969361 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5eca6b93-d418-453b-a9e5-33532a4cd2b3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:49.970628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5eca6b93-d418-453b-a9e5-33532a4cd2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:50.079644 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 701/1384] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:50.379053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77082c26-6420-4e19-88d9-acb2efe08b6d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:50.381240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-77082c26-6420-4e19-88d9-acb2efe08b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:50.482257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:50.553333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77082c26-6420-4e19-88d9-acb2efe08b6d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:50.689730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d0591-091a-40a1-a501-0df9295daa18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:50.690626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d0591-091a-40a1-a501-0df9295daa18 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:50.690912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d0591-091a-40a1-a501-0df9295daa18 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:50.691183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d0591-091a-40a1-a501-0df9295daa18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:50.692877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-272d0591-091a-40a1-a501-0df9295daa18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:50.762227 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:50.813013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d0591-091a-40a1-a501-0df9295daa18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:50.814726 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d0591-091a-40a1-a501-0df9295daa18 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:50.839486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 684/1385] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:52.947232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275dcca-2bef-4980-91fd-128fb0480425 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:52.947805 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275dcca-2bef-4980-91fd-128fb0480425 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:52.948212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275dcca-2bef-4980-91fd-128fb0480425 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:52.950491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 702/1386] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:52.958599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a099af-544c-4cc1-9aef-163d9976c683 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:52.959123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a099af-544c-4cc1-9aef-163d9976c683 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:52.959289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a099af-544c-4cc1-9aef-163d9976c683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:53.044203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-05a099af-544c-4cc1-9aef-163d9976c683 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:53.046365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05a099af-544c-4cc1-9aef-163d9976c683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:53.164167 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 685/1387] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:37:53.469812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275dcca-2bef-4980-91fd-128fb0480425 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:53.472486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5275dcca-2bef-4980-91fd-128fb0480425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:53.582973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:53.675709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275dcca-2bef-4980-91fd-128fb0480425 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:53.834192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151bcf3-b4ee-47a2-af76-9ea0c0b27f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:53.834959 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151bcf3-b4ee-47a2-af76-9ea0c0b27f3c service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:53.835328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151bcf3-b4ee-47a2-af76-9ea0c0b27f3c service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:53.835617 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151bcf3-b4ee-47a2-af76-9ea0c0b27f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:53.837692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0151bcf3-b4ee-47a2-af76-9ea0c0b27f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:53.887771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:53.959077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151bcf3-b4ee-47a2-af76-9ea0c0b27f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:53.961242 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151bcf3-b4ee-47a2-af76-9ea0c0b27f3c service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:53.986557 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 703/1388] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:56.244470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a0944-2cf4-45f9-9250-04a1528e3f41 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:56.245016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a0944-2cf4-45f9-9250-04a1528e3f41 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:56.245016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a0944-2cf4-45f9-9250-04a1528e3f41 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:56.246421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 686/1389] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:56.252104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c649be4-82a0-4ec9-b88d-39824681c910 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:56.252579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c649be4-82a0-4ec9-b88d-39824681c910 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:56.252872 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c649be4-82a0-4ec9-b88d-39824681c910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:56.322104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2c649be4-82a0-4ec9-b88d-39824681c910 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:56.323314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2c649be4-82a0-4ec9-b88d-39824681c910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:56.446176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 704/1390] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:56.738289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a0944-2cf4-45f9-9250-04a1528e3f41 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:56.739923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5b6a0944-2cf4-45f9-9250-04a1528e3f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:56.774575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:56.897639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a0944-2cf4-45f9-9250-04a1528e3f41 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:57.011315 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:57.024092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4e1d1-dc37-4308-9769-d573333ea7b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:57.024708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e1d1-dc37-4308-9769-d573333ea7b1 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:57.024986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e1d1-dc37-4308-9769-d573333ea7b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:57.025259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e1d1-dc37-4308-9769-d573333ea7b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:57.026880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cde4e1d1-dc37-4308-9769-d573333ea7b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:57.137796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4e1d1-dc37-4308-9769-d573333ea7b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:57.139438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4e1d1-dc37-4308-9769-d573333ea7b1 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:57.162090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 687/1391] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:57.454127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525dcfe-8c27-4148-b287-d172c44181c6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:57.454891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525dcfe-8c27-4148-b287-d172c44181c6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:57.454891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525dcfe-8c27-4148-b287-d172c44181c6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:57.456820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 705/1392] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:37:57.466022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554a589-2245-4f90-8659-c8f074b7fa46 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:57.467017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554a589-2245-4f90-8659-c8f074b7fa46 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:57.467017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554a589-2245-4f90-8659-c8f074b7fa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:57.567298 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0554a589-2245-4f90-8659-c8f074b7fa46 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:57.568487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0554a589-2245-4f90-8659-c8f074b7fa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:57.638112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:57.680654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 688/1393] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:57.986369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09c74-5393-40fe-b73a-203a368ba5e3 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:57.986715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09c74-5393-40fe-b73a-203a368ba5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:57.987488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09c74-5393-40fe-b73a-203a368ba5e3 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:57.989243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 706/1394] 10.222.0.91 () {54 vars in 967 bytes} [Wed Aug 24 10:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:57.994808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4eabf-b083-48c6-a9f9-d6b27415a311 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:57.995095 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4eabf-b083-48c6-a9f9-d6b27415a311 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:57.995369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4eabf-b083-48c6-a9f9-d6b27415a311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:58.079103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-30a4eabf-b083-48c6-a9f9-d6b27415a311 None None] MFA Rules not processed for user `75138f08ea2b4813b095635d920599d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:58.080368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-30a4eabf-b083-48c6-a9f9-d6b27415a311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:58.165657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 689/1395] 10.222.0.91 () {58 vars in 1064 bytes} [Wed Aug 24 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:58.173297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d09c74-5393-40fe-b73a-203a368ba5e3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:58.175418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-01d09c74-5393-40fe-b73a-203a368ba5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:58.194104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:58.291025 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d09c74-5393-40fe-b73a-203a368ba5e3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:58.372682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b83e2b-4cad-4dc2-af56-4669bf37ffba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75138f08ea2b4813b095635d920599d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:58.373292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b83e2b-4cad-4dc2-af56-4669bf37ffba service glance] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:58.373570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b83e2b-4cad-4dc2-af56-4669bf37ffba service glance] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:58.373839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b83e2b-4cad-4dc2-af56-4669bf37ffba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:58.375491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-64b83e2b-4cad-4dc2-af56-4669bf37ffba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:58.454151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:58.508467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b83e2b-4cad-4dc2-af56-4669bf37ffba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:58.509914 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b83e2b-4cad-4dc2-af56-4669bf37ffba service glance] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:58.529383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 707/1396] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:59.358501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3c58f-4541-414a-8026-59fce4096882 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:59.359085 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3c58f-4541-414a-8026-59fce4096882 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:59.359085 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3c58f-4541-414a-8026-59fce4096882 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:59.360447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 690/1397] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:59.368022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1f527-51cf-4054-baf6-2e30b1db7014 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:59.372595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1f527-51cf-4054-baf6-2e30b1db7014 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:59.372595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1f527-51cf-4054-baf6-2e30b1db7014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:59.438230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a26e9b-6531-418d-9c1c-73d7e4563f90 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:59.438510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a26e9b-6531-418d-9c1c-73d7e4563f90 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:59.438781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a26e9b-6531-418d-9c1c-73d7e4563f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:59.446954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-81f1f527-51cf-4054-baf6-2e30b1db7014 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:59.448366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-81f1f527-51cf-4054-baf6-2e30b1db7014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:59.514542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b1a26e9b-6531-418d-9c1c-73d7e4563f90 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:59.515794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b1a26e9b-6531-418d-9c1c-73d7e4563f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:59.527846 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:59.557943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 708/1398] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:59.614141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 691/1399] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:37:59.663409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698a85-bdbb-4633-8f5a-8e7a3b072cd4 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:59.663693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698a85-bdbb-4633-8f5a-8e7a3b072cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:59.664169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698a85-bdbb-4633-8f5a-8e7a3b072cd4 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:59.665787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 709/1400] 10.222.0.91 () {54 vars in 943 bytes} [Wed Aug 24 10:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:59.672725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ecff0-f8f7-414a-9d37-337864481957 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:59.673075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ecff0-f8f7-414a-9d37-337864481957 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:59.673437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ecff0-f8f7-414a-9d37-337864481957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:59.757363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3d8ecff0-f8f7-414a-9d37-337864481957 None None] MFA Rules not processed for user `4671efa1526643cdb32f56d44903db1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:59.758662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3d8ecff0-f8f7-414a-9d37-337864481957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:59.852084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:59.870679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38698a85-bdbb-4633-8f5a-8e7a3b072cd4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:59.872157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-38698a85-bdbb-4633-8f5a-8e7a3b072cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:59.878040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 692/1401] 10.222.0.91 () {58 vars in 1040 bytes} [Wed Aug 24 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:59.889149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ecff0-f8f7-414a-9d37-337864481957 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:59.900405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:59.901449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ecff0-f8f7-414a-9d37-337864481957 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:00.019577 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe32a-a288-42f0-97cc-5e88f563fa51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:00.020218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe32a-a288-42f0-97cc-5e88f563fa51 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:00.020494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe32a-a288-42f0-97cc-5e88f563fa51 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:00.020762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe32a-a288-42f0-97cc-5e88f563fa51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:00.022416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9f9fe32a-a288-42f0-97cc-5e88f563fa51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:00.041948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38698a85-bdbb-4633-8f5a-8e7a3b072cd4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:00.115241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fe32a-a288-42f0-97cc-5e88f563fa51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:00.116966 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fe32a-a288-42f0-97cc-5e88f563fa51 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:00.126083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 693/1402] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:37:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 10:38:00.157426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:00.181481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed75ee0-889e-4934-a18a-ea889fa7d6cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:00.182102 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed75ee0-889e-4934-a18a-ea889fa7d6cf service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:00.182464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed75ee0-889e-4934-a18a-ea889fa7d6cf service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:00.182734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed75ee0-889e-4934-a18a-ea889fa7d6cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:00.184445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3ed75ee0-889e-4934-a18a-ea889fa7d6cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:00.287622 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed75ee0-889e-4934-a18a-ea889fa7d6cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:00.289322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed75ee0-889e-4934-a18a-ea889fa7d6cf service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:00.308890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 710/1403] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:02.527513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41fb9-5807-4c56-a083-be53c936904e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:02.528075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41fb9-5807-4c56-a083-be53c936904e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:02.528772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41fb9-5807-4c56-a083-be53c936904e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:02.531364 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 694/1404] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:38:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:02.541466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276e50-bdee-44f7-b898-576876f9d1ee None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:02.542273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276e50-bdee-44f7-b898-576876f9d1ee None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:02.543168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276e50-bdee-44f7-b898-576876f9d1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:02.651456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-40276e50-bdee-44f7-b898-576876f9d1ee None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:02.652772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-40276e50-bdee-44f7-b898-576876f9d1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:02.731304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:02.781820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 711/1405] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:03.116447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe41fb9-5807-4c56-a083-be53c936904e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:03.149744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3fe41fb9-5807-4c56-a083-be53c936904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:03.149744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:03.324654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe41fb9-5807-4c56-a083-be53c936904e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:03.495474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641c0ef-58b3-4dc8-8980-230d0423b857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:03.496120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641c0ef-58b3-4dc8-8980-230d0423b857 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:03.496393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641c0ef-58b3-4dc8-8980-230d0423b857 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:03.496671 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641c0ef-58b3-4dc8-8980-230d0423b857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:03.498293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3641c0ef-58b3-4dc8-8980-230d0423b857 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:03.617642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641c0ef-58b3-4dc8-8980-230d0423b857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:03.619169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641c0ef-58b3-4dc8-8980-230d0423b857 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:03.644137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 695/1406] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:03.789780 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:05.876503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619c0fb-6ceb-4e35-a816-dc6a833b0945 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:05.879633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619c0fb-6ceb-4e35-a816-dc6a833b0945 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:05.879633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619c0fb-6ceb-4e35-a816-dc6a833b0945 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:05.879633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 712/1407] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:05.885518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63052f02-06ee-4c39-a99c-f481c3ce77f2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:05.885990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63052f02-06ee-4c39-a99c-f481c3ce77f2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:05.886089 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63052f02-06ee-4c39-a99c-f481c3ce77f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:05.981729 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-63052f02-06ee-4c39-a99c-f481c3ce77f2 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:05.983379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-63052f02-06ee-4c39-a99c-f481c3ce77f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:06.047385 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:06.111131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 696/1408] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:06.416643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619c0fb-6ceb-4e35-a816-dc6a833b0945 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:06.418168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6619c0fb-6ceb-4e35-a816-dc6a833b0945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:06.608874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619c0fb-6ceb-4e35-a816-dc6a833b0945 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:06.658881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:06.736206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d4e34-e532-4abc-b274-baf538e7795f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:06.737686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d4e34-e532-4abc-b274-baf538e7795f service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:06.738060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d4e34-e532-4abc-b274-baf538e7795f service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:06.738261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d4e34-e532-4abc-b274-baf538e7795f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:06.740082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-722d4e34-e532-4abc-b274-baf538e7795f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:06.847806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d4e34-e532-4abc-b274-baf538e7795f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:06.849774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d4e34-e532-4abc-b274-baf538e7795f service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:06.869323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 713/1409] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:16.108513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=23 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:16.866745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=79 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:23.988551 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9823b-f57a-417b-9b37-2508799b283c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:23.989092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9823b-f57a-417b-9b37-2508799b283c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:23.989206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9823b-f57a-417b-9b37-2508799b283c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:23.990485 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 697/1410] 10.222.0.91 () {54 vars in 918 bytes} [Wed Aug 24 10:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:23.996021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ad32c-882f-4123-8fe1-9f7b5fe90212 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:23.996485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ad32c-882f-4123-8fe1-9f7b5fe90212 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:23.996593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ad32c-882f-4123-8fe1-9f7b5fe90212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:24.081785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-939ad32c-882f-4123-8fe1-9f7b5fe90212 None None] MFA Rules not processed for user `8ebfb233b2504463a4ee9202b5a3ab50`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:24.082926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-939ad32c-882f-4123-8fe1-9f7b5fe90212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:24.214134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 714/1411] 10.222.0.91 () {58 vars in 1015 bytes} [Wed Aug 24 10:38:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:24.229151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7bfa5-3b9d-4f4d-b2d6-d410a868e319 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:24.229432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7bfa5-3b9d-4f4d-b2d6-d410a868e319 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:24.229702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7bfa5-3b9d-4f4d-b2d6-d410a868e319 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:24.231079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 698/1412] 10.222.0.91 () {54 vars in 918 bytes} [Wed Aug 24 10:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:38:24.237199 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da1833-3edd-4510-b84a-d0848d0a22b8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:24.237530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da1833-3edd-4510-b84a-d0848d0a22b8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:24.237895 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da1833-3edd-4510-b84a-d0848d0a22b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:24.319909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:24.323381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b6da1833-3edd-4510-b84a-d0848d0a22b8 None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:24.324701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b6da1833-3edd-4510-b84a-d0848d0a22b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:24.449760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 715/1413] 10.222.0.91 () {58 vars in 1015 bytes} [Wed Aug 24 10:38:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:26.950002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a3373-c6af-4780-a56b-de11ff3cbb9a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:26.950585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a3373-c6af-4780-a56b-de11ff3cbb9a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:26.950585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a3373-c6af-4780-a56b-de11ff3cbb9a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:26.951919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:26.957509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e239123-6f2c-4c3f-bcf6-173e08dbf6ba None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:26.958017 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e239123-6f2c-4c3f-bcf6-173e08dbf6ba None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:26.958125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e239123-6f2c-4c3f-bcf6-173e08dbf6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:27.026725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8e239123-6f2c-4c3f-bcf6-173e08dbf6ba None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:27.027902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8e239123-6f2c-4c3f-bcf6-173e08dbf6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:27.084796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:27.130399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:27.431110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a3373-c6af-4780-a56b-de11ff3cbb9a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:27.432727 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c08a3373-c6af-4780-a56b-de11ff3cbb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:27.592932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a3373-c6af-4780-a56b-de11ff3cbb9a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:27.670271 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:27.835999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d66a1-a768-4b40-868f-e01a38e1f31b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:27.836612 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d66a1-a768-4b40-868f-e01a38e1f31b service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:27.836889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d66a1-a768-4b40-868f-e01a38e1f31b service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:27.837162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d66a1-a768-4b40-868f-e01a38e1f31b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:27.838781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-890d66a1-a768-4b40-868f-e01a38e1f31b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:27.932726 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d66a1-a768-4b40-868f-e01a38e1f31b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:27.934221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d66a1-a768-4b40-868f-e01a38e1f31b service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:27.955767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 700/1416] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:28.897173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c020b0-bb7f-4dfa-a7d8-17a055521b09 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:28.897787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c020b0-bb7f-4dfa-a7d8-17a055521b09 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:28.897787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c020b0-bb7f-4dfa-a7d8-17a055521b09 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:28.899132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:28.904623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283d17-ac5d-4ae5-91bf-18c4e871095e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:28.904903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283d17-ac5d-4ae5-91bf-18c4e871095e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:28.905203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283d17-ac5d-4ae5-91bf-18c4e871095e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:28.989109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c7283d17-ac5d-4ae5-91bf-18c4e871095e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:28.990315 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c7283d17-ac5d-4ae5-91bf-18c4e871095e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:29.021118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:29.096632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:29.255422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c020b0-bb7f-4dfa-a7d8-17a055521b09 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:29.257246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e2c020b0-bb7f-4dfa-a7d8-17a055521b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:29.410506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c020b0-bb7f-4dfa-a7d8-17a055521b09 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:29.453537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:29.529157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fc873-d2cb-4ad5-b0a8-ec46fb06fa14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:29.529769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fc873-d2cb-4ad5-b0a8-ec46fb06fa14 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:29.530052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fc873-d2cb-4ad5-b0a8-ec46fb06fa14 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:29.530320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fc873-d2cb-4ad5-b0a8-ec46fb06fa14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:29.531968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-348fc873-d2cb-4ad5-b0a8-ec46fb06fa14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:29.627751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fc873-d2cb-4ad5-b0a8-ec46fb06fa14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:29.629302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fc873-d2cb-4ad5-b0a8-ec46fb06fa14 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:29.648633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 718/1419] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:30.564130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecab41-aeac-4412-98b1-dc5a71011907 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:30.564723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecab41-aeac-4412-98b1-dc5a71011907 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:30.564723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecab41-aeac-4412-98b1-dc5a71011907 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:30.566102 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:30.571470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49d948-7955-4007-bd19-3254ac18f624 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:30.571983 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49d948-7955-4007-bd19-3254ac18f624 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:30.572080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49d948-7955-4007-bd19-3254ac18f624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:30.631480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:30.654425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0b49d948-7955-4007-bd19-3254ac18f624 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:30.655652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0b49d948-7955-4007-bd19-3254ac18f624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:30.757562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:30.911194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecab41-aeac-4412-98b1-dc5a71011907 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:30.912641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-00ecab41-aeac-4412-98b1-dc5a71011907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:31.062931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecab41-aeac-4412-98b1-dc5a71011907 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:31.076047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:31.192740 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff6c06-872d-4f17-be45-938e785c43aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:31.193352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff6c06-872d-4f17-be45-938e785c43aa service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:31.193626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff6c06-872d-4f17-be45-938e785c43aa service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:31.193895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff6c06-872d-4f17-be45-938e785c43aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:31.195521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dbff6c06-872d-4f17-be45-938e785c43aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:31.291028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff6c06-872d-4f17-be45-938e785c43aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:31.292746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff6c06-872d-4f17-be45-938e785c43aa service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:31.311501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 703/1422] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:32.207536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3199e5c-b528-40f1-aee7-ef4655767faf None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:32.208132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3199e5c-b528-40f1-aee7-ef4655767faf None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:32.208132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3199e5c-b528-40f1-aee7-ef4655767faf None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:32.209560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:32.214786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11478be-c0f4-4f70-ad1e-dbdca94bca3a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:32.215246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11478be-c0f4-4f70-ad1e-dbdca94bca3a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:32.215362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11478be-c0f4-4f70-ad1e-dbdca94bca3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:32.236800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:32.295311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d11478be-c0f4-4f70-ad1e-dbdca94bca3a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:32.296553 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d11478be-c0f4-4f70-ad1e-dbdca94bca3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:32.405242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:38:32.559549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3199e5c-b528-40f1-aee7-ef4655767faf None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:32.561107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d3199e5c-b528-40f1-aee7-ef4655767faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:32.678045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:32.716832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3199e5c-b528-40f1-aee7-ef4655767faf None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:32.840113 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080925c-869e-474a-89be-3027f054530b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:32.840712 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080925c-869e-474a-89be-3027f054530b service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:32.840988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080925c-869e-474a-89be-3027f054530b service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:32.841257 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080925c-869e-474a-89be-3027f054530b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:32.842880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d080925c-869e-474a-89be-3027f054530b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:32.927329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:32.941821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080925c-869e-474a-89be-3027f054530b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:32.943433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080925c-869e-474a-89be-3027f054530b service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:32.962560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 721/1425] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:33.840321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a94da5-1638-48d9-8fed-efbea43d2465 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:33.840862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a94da5-1638-48d9-8fed-efbea43d2465 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:33.840957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a94da5-1638-48d9-8fed-efbea43d2465 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:33.842270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:33.848625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc18dc-dc64-409f-88a3-fb533822b442 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:33.849150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc18dc-dc64-409f-88a3-fb533822b442 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:33.849150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc18dc-dc64-409f-88a3-fb533822b442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:33.931541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c5fc18dc-dc64-409f-88a3-fb533822b442 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:33.932791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c5fc18dc-dc64-409f-88a3-fb533822b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:34.033564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:34.188762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a94da5-1638-48d9-8fed-efbea43d2465 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:34.190321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-94a94da5-1638-48d9-8fed-efbea43d2465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:34.279153 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:34.343478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a94da5-1638-48d9-8fed-efbea43d2465 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:34.467170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b101c8-2ab1-4e1b-bf9b-3297789b9c7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:34.467693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b101c8-2ab1-4e1b-bf9b-3297789b9c7f service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:34.468002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b101c8-2ab1-4e1b-bf9b-3297789b9c7f service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:34.468303 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b101c8-2ab1-4e1b-bf9b-3297789b9c7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:34.470563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-97b101c8-2ab1-4e1b-bf9b-3297789b9c7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:34.522415 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:34.565249 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b101c8-2ab1-4e1b-bf9b-3297789b9c7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:34.566855 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b101c8-2ab1-4e1b-bf9b-3297789b9c7f service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:34.585900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 706/1428] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:35.531893 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23415a4-e820-4102-b95a-bbe5b7213baa None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:35.533573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23415a4-e820-4102-b95a-bbe5b7213baa None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:35.533573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23415a4-e820-4102-b95a-bbe5b7213baa None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:35.535710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:38:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:35.542332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408aaec-ca59-4222-bf70-ba25ba65b6ed None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:35.542896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408aaec-ca59-4222-bf70-ba25ba65b6ed None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:35.542896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408aaec-ca59-4222-bf70-ba25ba65b6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:35.637603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3408aaec-ca59-4222-bf70-ba25ba65b6ed None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:35.638734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3408aaec-ca59-4222-bf70-ba25ba65b6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:35.753913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:35.919990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23415a4-e820-4102-b95a-bbe5b7213baa None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:35.921533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d23415a4-e820-4102-b95a-bbe5b7213baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:35.973672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:36.079320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23415a4-e820-4102-b95a-bbe5b7213baa None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:36.204708 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5010b-9477-4bbd-92ca-7f86e84968f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:36.205337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5010b-9477-4bbd-92ca-7f86e84968f2 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:36.205614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5010b-9477-4bbd-92ca-7f86e84968f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:36.205884 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5010b-9477-4bbd-92ca-7f86e84968f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:36.207547 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a8f5010b-9477-4bbd-92ca-7f86e84968f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:36.215167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:36.305940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5010b-9477-4bbd-92ca-7f86e84968f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:36.307554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5010b-9477-4bbd-92ca-7f86e84968f2 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:36.327836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 724/1431] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:37.215634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a8428-6564-4a56-881f-84fbf2187a9c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:37.216326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a8428-6564-4a56-881f-84fbf2187a9c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:37.216326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a8428-6564-4a56-881f-84fbf2187a9c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:37.217548 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:37.223612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079e86f-76f0-465a-a001-c71f3ed611ee None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:37.224132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079e86f-76f0-465a-a001-c71f3ed611ee None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:37.224244 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079e86f-76f0-465a-a001-c71f3ed611ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:37.306250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1079e86f-76f0-465a-a001-c71f3ed611ee None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:37.307802 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1079e86f-76f0-465a-a001-c71f3ed611ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:37.380288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:37.412581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:37.564635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a8428-6564-4a56-881f-84fbf2187a9c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:37.566732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cd8a8428-6564-4a56-881f-84fbf2187a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:37.596302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:37.733794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a8428-6564-4a56-881f-84fbf2187a9c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:37.826066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:37.854422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531802b-5527-48ab-8aa9-ca7c20f3816e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:37.855019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531802b-5527-48ab-8aa9-ca7c20f3816e service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:37.855291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531802b-5527-48ab-8aa9-ca7c20f3816e service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:37.855557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531802b-5527-48ab-8aa9-ca7c20f3816e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:37.857196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a531802b-5527-48ab-8aa9-ca7c20f3816e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:37.952160 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531802b-5527-48ab-8aa9-ca7c20f3816e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:37.953752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531802b-5527-48ab-8aa9-ca7c20f3816e service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:37.973063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 709/1434] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:38.878821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487061a-7886-414d-826f-b0a3d79df9c7 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:38.879394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487061a-7886-414d-826f-b0a3d79df9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:38.879394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487061a-7886-414d-826f-b0a3d79df9c7 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:38.881013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:38.886160 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92117e8-6133-4b67-bf1b-dd37d0c1d13d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:38.886704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92117e8-6133-4b67-bf1b-dd37d0c1d13d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:38.886704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92117e8-6133-4b67-bf1b-dd37d0c1d13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:38.967835 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a92117e8-6133-4b67-bf1b-dd37d0c1d13d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:38.969059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a92117e8-6133-4b67-bf1b-dd37d0c1d13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:39.013738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:39.071655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:39.232582 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487061a-7886-414d-826f-b0a3d79df9c7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:39.234090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f487061a-7886-414d-826f-b0a3d79df9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:39.398794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487061a-7886-414d-826f-b0a3d79df9c7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:39.459875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:39.522013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a9da6-d352-458b-be4c-b12669628c36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:39.522530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a9da6-d352-458b-be4c-b12669628c36 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:39.522803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a9da6-d352-458b-be4c-b12669628c36 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:39.523068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a9da6-d352-458b-be4c-b12669628c36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:39.524737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cb8a9da6-d352-458b-be4c-b12669628c36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:39.619328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a9da6-d352-458b-be4c-b12669628c36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:39.620981 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a9da6-d352-458b-be4c-b12669628c36 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:39.644001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 727/1437] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:40.583958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fcfff-499e-4c65-8ae8-62ede02045d4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:40.584529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fcfff-499e-4c65-8ae8-62ede02045d4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:40.584529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fcfff-499e-4c65-8ae8-62ede02045d4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:40.588074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:40.591103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa393aff-4363-4487-941a-ba1b61e2ca6b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:40.591556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa393aff-4363-4487-941a-ba1b61e2ca6b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:40.591652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa393aff-4363-4487-941a-ba1b61e2ca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:40.672402 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-aa393aff-4363-4487-941a-ba1b61e2ca6b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:40.674320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-aa393aff-4363-4487-941a-ba1b61e2ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:40.676519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:40.777704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:40.930280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fcfff-499e-4c65-8ae8-62ede02045d4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:40.931882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d69fcfff-499e-4c65-8ae8-62ede02045d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:41.083825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fcfff-499e-4c65-8ae8-62ede02045d4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:41.113205 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:41.205010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df1c10-de6f-48fc-951a-6ebe08c71f79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:41.205618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1c10-de6f-48fc-951a-6ebe08c71f79 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:41.205896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1c10-de6f-48fc-951a-6ebe08c71f79 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:41.206213 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1c10-de6f-48fc-951a-6ebe08c71f79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:41.207908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-56df1c10-de6f-48fc-951a-6ebe08c71f79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:41.305392 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df1c10-de6f-48fc-951a-6ebe08c71f79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:41.307072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df1c10-de6f-48fc-951a-6ebe08c71f79 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:41.327942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 712/1440] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:43.191085 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f69ef-f9ab-4118-b10a-9dd1f35b0ed3 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:43.191684 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f69ef-f9ab-4118-b10a-9dd1f35b0ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:43.191684 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f69ef-f9ab-4118-b10a-9dd1f35b0ed3 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:43.193133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:43.198967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341af1c-804b-4dcb-8f46-f0419b1691f2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:43.199477 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341af1c-804b-4dcb-8f46-f0419b1691f2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:43.199477 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341af1c-804b-4dcb-8f46-f0419b1691f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:43.248366 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:43.278840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b341af1c-804b-4dcb-8f46-f0419b1691f2 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:43.280511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b341af1c-804b-4dcb-8f46-f0419b1691f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:43.382761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:43.664777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f69ef-f9ab-4118-b10a-9dd1f35b0ed3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:43.666303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ae7f69ef-f9ab-4118-b10a-9dd1f35b0ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:43.776872 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f69ef-f9ab-4118-b10a-9dd1f35b0ed3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:43.810681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:43.857446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fd83a-7595-4ef7-bc2d-df8cb0dcb0c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:43.858050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fd83a-7595-4ef7-bc2d-df8cb0dcb0c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:43.858324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fd83a-7595-4ef7-bc2d-df8cb0dcb0c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:43.858591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fd83a-7595-4ef7-bc2d-df8cb0dcb0c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:43.860377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-898fd83a-7595-4ef7-bc2d-df8cb0dcb0c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:43.980857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fd83a-7595-4ef7-bc2d-df8cb0dcb0c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:43.982305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fd83a-7595-4ef7-bc2d-df8cb0dcb0c7 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:44.002263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 730/1443] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:46.140786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb8273-4999-4fdd-8353-e72d4eac45e7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:46.141380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb8273-4999-4fdd-8353-e72d4eac45e7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:46.141380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb8273-4999-4fdd-8353-e72d4eac45e7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:46.142617 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:46.148233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b8591-5a1a-4a39-b099-e2f2d6c74af0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:46.155814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b8591-5a1a-4a39-b099-e2f2d6c74af0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:46.155814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b8591-5a1a-4a39-b099-e2f2d6c74af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:46.217581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ef3b8591-5a1a-4a39-b099-e2f2d6c74af0 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:46.218878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ef3b8591-5a1a-4a39-b099-e2f2d6c74af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:46.232221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:46.323905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:46.616168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb8273-4999-4fdd-8353-e72d4eac45e7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:46.617724 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-50fb8273-4999-4fdd-8353-e72d4eac45e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:46.738435 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb8273-4999-4fdd-8353-e72d4eac45e7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:46.751263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:46.816847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07247d-2bdd-46c1-8f52-e275a1c26696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:46.817451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07247d-2bdd-46c1-8f52-e275a1c26696 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:46.817721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07247d-2bdd-46c1-8f52-e275a1c26696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:46.817986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07247d-2bdd-46c1-8f52-e275a1c26696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:46.819580 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3f07247d-2bdd-46c1-8f52-e275a1c26696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:46.933429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07247d-2bdd-46c1-8f52-e275a1c26696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:46.934764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07247d-2bdd-46c1-8f52-e275a1c26696 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:46.953263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 715/1446] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:49.309798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bae08d-f5ef-4d03-9707-9ba6219bd569 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:49.309798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bae08d-f5ef-4d03-9707-9ba6219bd569 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:49.309798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bae08d-f5ef-4d03-9707-9ba6219bd569 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:49.311158 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:49.316951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415c145-41d4-4530-b516-e7515d89bf06 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:49.317474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415c145-41d4-4530-b516-e7515d89bf06 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:49.317474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415c145-41d4-4530-b516-e7515d89bf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:49.371008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:49.390949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e415c145-41d4-4530-b516-e7515d89bf06 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:49.392795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e415c145-41d4-4530-b516-e7515d89bf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:49.495461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:49.781560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bae08d-f5ef-4d03-9707-9ba6219bd569 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:49.784067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-98bae08d-f5ef-4d03-9707-9ba6219bd569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:49.893987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bae08d-f5ef-4d03-9707-9ba6219bd569 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:49.935968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:49.975459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f7615-f2ee-4eec-b914-c688d496cfd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:49.976098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f7615-f2ee-4eec-b914-c688d496cfd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:49.976372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f7615-f2ee-4eec-b914-c688d496cfd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:49.976640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f7615-f2ee-4eec-b914-c688d496cfd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:49.978261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9f0f7615-f2ee-4eec-b914-c688d496cfd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:50.091499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f7615-f2ee-4eec-b914-c688d496cfd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:50.092908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f7615-f2ee-4eec-b914-c688d496cfd2 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:50.115157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 733/1449] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:52.301382 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a216ad-68a3-4157-8617-87f2f302a795 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:52.301958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a216ad-68a3-4157-8617-87f2f302a795 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:52.301958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a216ad-68a3-4157-8617-87f2f302a795 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:52.303299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:52.309125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1e3fd-3996-4bc3-9387-aeb68e37dbe0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:52.309562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1e3fd-3996-4bc3-9387-aeb68e37dbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:52.309656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1e3fd-3996-4bc3-9387-aeb68e37dbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:52.383486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-14a1e3fd-3996-4bc3-9387-aeb68e37dbe0 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:52.384727 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-14a1e3fd-3996-4bc3-9387-aeb68e37dbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:52.407763 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:52.490783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:52.781016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a216ad-68a3-4157-8617-87f2f302a795 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:52.782655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-91a216ad-68a3-4157-8617-87f2f302a795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:52.890468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a216ad-68a3-4157-8617-87f2f302a795 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:52.913184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:52.978135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84292e2-b932-466c-b112-414f0c5b6eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:52.978744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84292e2-b932-466c-b112-414f0c5b6eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:52.979022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84292e2-b932-466c-b112-414f0c5b6eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:52.979287 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84292e2-b932-466c-b112-414f0c5b6eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:52.980949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c84292e2-b932-466c-b112-414f0c5b6eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:53.098578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84292e2-b932-466c-b112-414f0c5b6eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:53.099962 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84292e2-b932-466c-b112-414f0c5b6eb3 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:53.119655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 718/1452] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:55.157354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880868b-1eed-4fdc-9e84-8ce8f8931983 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:55.158245 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880868b-1eed-4fdc-9e84-8ce8f8931983 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:55.158422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880868b-1eed-4fdc-9e84-8ce8f8931983 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:55.160579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:55.166573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814430-a382-4424-8747-06edcdf5cd0c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:55.167087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814430-a382-4424-8747-06edcdf5cd0c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:55.167087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814430-a382-4424-8747-06edcdf5cd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:55.233943 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:55.236988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-98814430-a382-4424-8747-06edcdf5cd0c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:55.238213 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-98814430-a382-4424-8747-06edcdf5cd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:55.344976 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:55.637446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880868b-1eed-4fdc-9e84-8ce8f8931983 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:55.638983 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5880868b-1eed-4fdc-9e84-8ce8f8931983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:55.747930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880868b-1eed-4fdc-9e84-8ce8f8931983 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:55.800351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:55.827066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01176c3f-d93f-4820-98dc-1fff886ab8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:55.827805 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01176c3f-d93f-4820-98dc-1fff886ab8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:55.828088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01176c3f-d93f-4820-98dc-1fff886ab8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:55.828468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01176c3f-d93f-4820-98dc-1fff886ab8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:55.829970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-01176c3f-d93f-4820-98dc-1fff886ab8f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:55.956099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01176c3f-d93f-4820-98dc-1fff886ab8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:55.957555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01176c3f-d93f-4820-98dc-1fff886ab8f8 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:55.976439 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 736/1455] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:58.009981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf824-2183-4920-bf7c-8330919593c7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:58.010545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf824-2183-4920-bf7c-8330919593c7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:58.010545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf824-2183-4920-bf7c-8330919593c7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:58.011965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:58.018354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544798a6-3bf5-4bc7-9efd-72ecb8b72217 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:58.018836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544798a6-3bf5-4bc7-9efd-72ecb8b72217 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:58.018932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544798a6-3bf5-4bc7-9efd-72ecb8b72217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:58.089690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-544798a6-3bf5-4bc7-9efd-72ecb8b72217 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:58.090840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-544798a6-3bf5-4bc7-9efd-72ecb8b72217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:58.121659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:58.197310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:58.494149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdf824-2183-4920-bf7c-8330919593c7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:58.495682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-52bdf824-2183-4920-bf7c-8330919593c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:58.605042 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdf824-2183-4920-bf7c-8330919593c7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:58.635332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:58.683892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b3f51-c63e-4946-9c8a-ae5076ebfa2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:58.684500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b3f51-c63e-4946-9c8a-ae5076ebfa2e service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:58.684780 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b3f51-c63e-4946-9c8a-ae5076ebfa2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:58.685052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b3f51-c63e-4946-9c8a-ae5076ebfa2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:58.686659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-934b3f51-c63e-4946-9c8a-ae5076ebfa2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:58.807355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b3f51-c63e-4946-9c8a-ae5076ebfa2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:58.809002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b3f51-c63e-4946-9c8a-ae5076ebfa2e service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:58.829095 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 721/1458] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:00.842590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac612c6b-c537-4ad3-bdec-160c2714ab00 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:00.843161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac612c6b-c537-4ad3-bdec-160c2714ab00 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:00.843161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac612c6b-c537-4ad3-bdec-160c2714ab00 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:00.844708 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:00.850426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa18b75-a1e5-45b7-a74f-b5ae620c3193 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:00.850897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa18b75-a1e5-45b7-a74f-b5ae620c3193 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:00.850999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa18b75-a1e5-45b7-a74f-b5ae620c3193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:00.920965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3aa18b75-a1e5-45b7-a74f-b5ae620c3193 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:00.922931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3aa18b75-a1e5-45b7-a74f-b5ae620c3193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:00.931027 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:01.020821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:01.309239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac612c6b-c537-4ad3-bdec-160c2714ab00 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:01.310837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ac612c6b-c537-4ad3-bdec-160c2714ab00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:01.421581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac612c6b-c537-4ad3-bdec-160c2714ab00 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:01.480482 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:01.501221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ca9da-6f1c-4e2d-850c-61fbfdddf6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:01.501843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ca9da-6f1c-4e2d-850c-61fbfdddf6ef service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:01.502118 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ca9da-6f1c-4e2d-850c-61fbfdddf6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:01.502386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ca9da-6f1c-4e2d-850c-61fbfdddf6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:01.504125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-779ca9da-6f1c-4e2d-850c-61fbfdddf6ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:01.620725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ca9da-6f1c-4e2d-850c-61fbfdddf6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:01.622063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ca9da-6f1c-4e2d-850c-61fbfdddf6ef service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:01.642200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 739/1461] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:03.657921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe08ff-3028-40de-9693-af490060bf4f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:03.658667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe08ff-3028-40de-9693-af490060bf4f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:03.658667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe08ff-3028-40de-9693-af490060bf4f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:03.659771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:03.667483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7459ed3-5e7f-4e07-8f2f-ed760b9f16a7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:03.668006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7459ed3-5e7f-4e07-8f2f-ed760b9f16a7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:03.668123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7459ed3-5e7f-4e07-8f2f-ed760b9f16a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:03.738213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e7459ed3-5e7f-4e07-8f2f-ed760b9f16a7 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:03.739414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e7459ed3-5e7f-4e07-8f2f-ed760b9f16a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:03.778881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:03.842191 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:04.129541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe08ff-3028-40de-9693-af490060bf4f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:04.131369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-72fe08ff-3028-40de-9693-af490060bf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:04.245029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe08ff-3028-40de-9693-af490060bf4f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:04.284324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:04.320875 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e497fd-2955-418e-9a6a-986e6e542c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:04.321461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e497fd-2955-418e-9a6a-986e6e542c3f service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:04.321740 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e497fd-2955-418e-9a6a-986e6e542c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:04.322009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e497fd-2955-418e-9a6a-986e6e542c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:04.323623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e1e497fd-2955-418e-9a6a-986e6e542c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:04.443575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e497fd-2955-418e-9a6a-986e6e542c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:04.445082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e497fd-2955-418e-9a6a-986e6e542c3f service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:04.465842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 724/1464] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:06.487942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e8489-4fc4-49e7-a60f-74939d4fcb4d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:06.488529 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e8489-4fc4-49e7-a60f-74939d4fcb4d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:06.488529 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e8489-4fc4-49e7-a60f-74939d4fcb4d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:06.489873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:06.495280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9fb07-592b-4833-b764-71df5730074b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:06.495907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9fb07-592b-4833-b764-71df5730074b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:06.495907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9fb07-592b-4833-b764-71df5730074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:06.564416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f2e9fb07-592b-4833-b764-71df5730074b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:06.565779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f2e9fb07-592b-4833-b764-71df5730074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:06.584641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:06.670861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:06.954396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e8489-4fc4-49e7-a60f-74939d4fcb4d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:06.955958 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-056e8489-4fc4-49e7-a60f-74939d4fcb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:07.063394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e8489-4fc4-49e7-a60f-74939d4fcb4d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:07.131987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:07.138984 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef81f68-a4cc-416f-a34b-08b06c01d6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:07.146921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef81f68-a4cc-416f-a34b-08b06c01d6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:07.146921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef81f68-a4cc-416f-a34b-08b06c01d6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:07.146921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef81f68-a4cc-416f-a34b-08b06c01d6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:07.146921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0ef81f68-a4cc-416f-a34b-08b06c01d6b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:07.257206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef81f68-a4cc-416f-a34b-08b06c01d6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:07.258570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef81f68-a4cc-416f-a34b-08b06c01d6b9 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:07.277266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 742/1467] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:09.244811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9114b-475b-4bd8-80fb-02052a05813b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:09.245345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9114b-475b-4bd8-80fb-02052a05813b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:09.245345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9114b-475b-4bd8-80fb-02052a05813b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:09.246702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:09.256512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4f79-cd3d-4ce3-a9a0-a159b82d247c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:09.257084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4f79-cd3d-4ce3-a9a0-a159b82d247c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:09.257084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4f79-cd3d-4ce3-a9a0-a159b82d247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:09.326891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3bee4f79-cd3d-4ce3-a9a0-a159b82d247c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:09.328217 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3bee4f79-cd3d-4ce3-a9a0-a159b82d247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:09.385827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:09.436821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:09.722286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9114b-475b-4bd8-80fb-02052a05813b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:09.724035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bdf9114b-475b-4bd8-80fb-02052a05813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:09.832000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9114b-475b-4bd8-80fb-02052a05813b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:09.887401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:09.915595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbaf317-4677-43ad-83fd-2c87c5e7acb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:09.916234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaf317-4677-43ad-83fd-2c87c5e7acb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:09.916514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaf317-4677-43ad-83fd-2c87c5e7acb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:09.916788 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaf317-4677-43ad-83fd-2c87c5e7acb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:09.918410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1fbaf317-4677-43ad-83fd-2c87c5e7acb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:10.034082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbaf317-4677-43ad-83fd-2c87c5e7acb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:10.035424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbaf317-4677-43ad-83fd-2c87c5e7acb7 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:10.054750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 727/1470] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:19.434986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=22 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:20.052433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=66 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:30.162340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1a5fd-b992-4042-8cc2-eeb3624ecb03 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:30.162862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1a5fd-b992-4042-8cc2-eeb3624ecb03 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:30.162862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1a5fd-b992-4042-8cc2-eeb3624ecb03 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:30.164216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 744/1471] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:30.170103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ba290-c406-4f29-bd90-66baa900f19b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:30.176367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ba290-c406-4f29-bd90-66baa900f19b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:30.176367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ba290-c406-4f29-bd90-66baa900f19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:30.244089 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9b0ba290-c406-4f29-bd90-66baa900f19b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:30.245362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9b0ba290-c406-4f29-bd90-66baa900f19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:30.351692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 728/1472] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:30.652420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc8db-0995-458c-8426-f5fcac5aa5ef None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:30.652700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc8db-0995-458c-8426-f5fcac5aa5ef None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:30.652999 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc8db-0995-458c-8426-f5fcac5aa5ef None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:30.654340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 745/1473] 10.222.0.91 () {54 vars in 967 bytes} [Wed Aug 24 10:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:30.660210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124ed6f-1835-49b2-9df7-ac4abf5faacc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:30.663630 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124ed6f-1835-49b2-9df7-ac4abf5faacc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:30.663630 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124ed6f-1835-49b2-9df7-ac4abf5faacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:30.744256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2124ed6f-1835-49b2-9df7-ac4abf5faacc None None] MFA Rules not processed for user `75138f08ea2b4813b095635d920599d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:30.745379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2124ed6f-1835-49b2-9df7-ac4abf5faacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:30.768002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:30.836108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 729/1474] 10.222.0.91 () {58 vars in 1064 bytes} [Wed Aug 24 10:39:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:30.844848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cc8db-0995-458c-8426-f5fcac5aa5ef None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:30.846469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-681cc8db-0995-458c-8426-f5fcac5aa5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:30.962870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cc8db-0995-458c-8426-f5fcac5aa5ef None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:31.041499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6c32-e1cb-4a15-866d-db8513566c1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75138f08ea2b4813b095635d920599d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:31.042011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6c32-e1cb-4a15-866d-db8513566c1d service glance] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:31.042289 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6c32-e1cb-4a15-866d-db8513566c1d service glance] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:31.042560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6c32-e1cb-4a15-866d-db8513566c1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:31.044219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8a1d6c32-e1cb-4a15-866d-db8513566c1d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:31.102277 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:31.161670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d6c32-e1cb-4a15-866d-db8513566c1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:31.163219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d6c32-e1cb-4a15-866d-db8513566c1d service glance] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:31.182767 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 746/1475] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:33.253692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5fd8f-482b-45d4-9dae-da7d0c744f60 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:33.254519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5fd8f-482b-45d4-9dae-da7d0c744f60 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:33.254519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5fd8f-482b-45d4-9dae-da7d0c744f60 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:33.255879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 730/1476] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:33.261289 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcd94a-dd83-4897-b4f4-ecc9716c8ef5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:33.261761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcd94a-dd83-4897-b4f4-ecc9716c8ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:33.261861 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcd94a-dd83-4897-b4f4-ecc9716c8ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:33.332602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-26dcd94a-dd83-4897-b4f4-ecc9716c8ef5 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:33.333823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-26dcd94a-dd83-4897-b4f4-ecc9716c8ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:33.435159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 747/1477] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:39:33.713629 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5fd8f-482b-45d4-9dae-da7d0c744f60 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:33.715165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2ef5fd8f-482b-45d4-9dae-da7d0c744f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:33.852965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5fd8f-482b-45d4-9dae-da7d0c744f60 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:33.904713 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:33.956205 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe05ba4-8b06-4741-944b-163ceb373691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:33.956815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05ba4-8b06-4741-944b-163ceb373691 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:33.957097 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05ba4-8b06-4741-944b-163ceb373691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:33.957364 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05ba4-8b06-4741-944b-163ceb373691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:33.957999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe05ba4-8b06-4741-944b-163ceb373691 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:33.959785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-abe05ba4-8b06-4741-944b-163ceb373691 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:39:33.959785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 24 10:39:33.959785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: Aug 24 10:39:33.960932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe05ba4-8b06-4741-944b-163ceb373691 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:33.980250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 731/1478] 10.222.0.91 () {56 vars in 1108 bytes} [Wed Aug 24 10:39:33 2022] GET /identity/v3/projects => generated 2553 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:39:35.980659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1326-22df-4637-aaaf-2a318ec987e6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:35.981218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1326-22df-4637-aaaf-2a318ec987e6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:35.981218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1326-22df-4637-aaaf-2a318ec987e6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:35.982531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 748/1479] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:35.988113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1bd11-96bf-440b-9146-1f36eda1cdb8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:35.988528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1bd11-96bf-440b-9146-1f36eda1cdb8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:35.988635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1bd11-96bf-440b-9146-1f36eda1cdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:36.055074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-12f1bd11-96bf-440b-9146-1f36eda1cdb8 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:36.056282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-12f1bd11-96bf-440b-9146-1f36eda1cdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:36.153597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 732/1480] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:36.458840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e1326-22df-4637-aaaf-2a318ec987e6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:36.460411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a98e1326-22df-4637-aaaf-2a318ec987e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:36.471227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:36.619247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e1326-22df-4637-aaaf-2a318ec987e6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:36.705664 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:36.741363 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b8985-e5cc-4596-b625-cb2139986374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:36.741972 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b8985-e5cc-4596-b625-cb2139986374 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:36.742249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b8985-e5cc-4596-b625-cb2139986374 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:36.742527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b8985-e5cc-4596-b625-cb2139986374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:36.744232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4c3b8985-e5cc-4596-b625-cb2139986374 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:36.841078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b8985-e5cc-4596-b625-cb2139986374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:36.842698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b8985-e5cc-4596-b625-cb2139986374 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:36.862533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 749/1481] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:39.059330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5cdcc-909e-440f-9ff5-3d9b751e4d68 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:39.060243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5cdcc-909e-440f-9ff5-3d9b751e4d68 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:39.060243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5cdcc-909e-440f-9ff5-3d9b751e4d68 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:39.061470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 733/1482] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:39.067029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73562b94-f5d5-4ee1-9336-c3f6dd26bc31 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:39.067492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73562b94-f5d5-4ee1-9336-c3f6dd26bc31 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:39.067710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73562b94-f5d5-4ee1-9336-c3f6dd26bc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:39.135393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-73562b94-f5d5-4ee1-9336-c3f6dd26bc31 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:39.136653 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-73562b94-f5d5-4ee1-9336-c3f6dd26bc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:39.185299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:39.238417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 750/1483] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:39.541904 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5cdcc-909e-440f-9ff5-3d9b751e4d68 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:39.543691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c6e5cdcc-909e-440f-9ff5-3d9b751e4d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:39.568372 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:39.656036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5cdcc-909e-440f-9ff5-3d9b751e4d68 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:39.733986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba44897-4b29-4824-b053-1a614bdecf54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:39.734589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba44897-4b29-4824-b053-1a614bdecf54 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:39.734867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba44897-4b29-4824-b053-1a614bdecf54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:39.735137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba44897-4b29-4824-b053-1a614bdecf54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:39.736806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dba44897-4b29-4824-b053-1a614bdecf54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:39.814594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:39.856521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba44897-4b29-4824-b053-1a614bdecf54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:39.858143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba44897-4b29-4824-b053-1a614bdecf54 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:39.877624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 734/1484] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:39:41.925624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe9c8-31d3-43b8-96ae-4391acb06692 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:41.926179 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe9c8-31d3-43b8-96ae-4391acb06692 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:41.926179 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe9c8-31d3-43b8-96ae-4391acb06692 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:41.927553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 751/1485] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:41.933221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e67a8c-b187-4c70-9a00-5949ced43080 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:41.933679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e67a8c-b187-4c70-9a00-5949ced43080 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:41.933783 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e67a8c-b187-4c70-9a00-5949ced43080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:42.003234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-67e67a8c-b187-4c70-9a00-5949ced43080 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:42.004716 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-67e67a8c-b187-4c70-9a00-5949ced43080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:42.105668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 735/1486] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:42.397001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fe9c8-31d3-43b8-96ae-4391acb06692 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:42.398518 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a17fe9c8-31d3-43b8-96ae-4391acb06692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:42.512772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fe9c8-31d3-43b8-96ae-4391acb06692 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:42.710538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:42.712354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3460e-234b-4e72-8496-d38505281253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:42.712963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3460e-234b-4e72-8496-d38505281253 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:42.713242 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3460e-234b-4e72-8496-d38505281253 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:42.713514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3460e-234b-4e72-8496-d38505281253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:42.715130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-46f3460e-234b-4e72-8496-d38505281253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:42.829721 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3460e-234b-4e72-8496-d38505281253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:42.831437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3460e-234b-4e72-8496-d38505281253 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:42.849885 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 752/1487] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:44.878509 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2c0b-5a04-4fa0-9596-e415476d1205 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:44.879397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2c0b-5a04-4fa0-9596-e415476d1205 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:44.879397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2c0b-5a04-4fa0-9596-e415476d1205 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:44.880700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 736/1488] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:44.886252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f0ca7-a11c-4dcb-8f4a-75377e31b575 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:44.886734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f0ca7-a11c-4dcb-8f4a-75377e31b575 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:44.886845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f0ca7-a11c-4dcb-8f4a-75377e31b575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:44.959295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-991f0ca7-a11c-4dcb-8f4a-75377e31b575 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:44.960552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-991f0ca7-a11c-4dcb-8f4a-75377e31b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:45.017298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:45.070205 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 753/1489] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:45.364995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b2c0b-5a04-4fa0-9596-e415476d1205 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:45.366537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-898b2c0b-5a04-4fa0-9596-e415476d1205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:45.407657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:45.476903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b2c0b-5a04-4fa0-9596-e415476d1205 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:45.553717 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781655-bbd3-4e47-99e5-f1c3299db47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:45.554317 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781655-bbd3-4e47-99e5-f1c3299db47e service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:45.554594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781655-bbd3-4e47-99e5-f1c3299db47e service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:45.554863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781655-bbd3-4e47-99e5-f1c3299db47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:45.556505 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0d781655-bbd3-4e47-99e5-f1c3299db47e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:45.643656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:45.673786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781655-bbd3-4e47-99e5-f1c3299db47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:45.675209 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781655-bbd3-4e47-99e5-f1c3299db47e service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:45.694460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 737/1490] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:48.153732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d9dde-5fd7-4798-ae66-c12052f7e31f None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:48.154241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d9dde-5fd7-4798-ae66-c12052f7e31f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:48.154563 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d9dde-5fd7-4798-ae66-c12052f7e31f None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:48.156488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 754/1491] 10.222.0.91 () {54 vars in 927 bytes} [Wed Aug 24 10:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:39:48.162146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b54f38-71c4-4be2-a32f-d128e536fe79 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:48.165601 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b54f38-71c4-4be2-a32f-d128e536fe79 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:48.165601 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b54f38-71c4-4be2-a32f-d128e536fe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:48.231864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a3b54f38-71c4-4be2-a32f-d128e536fe79 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:48.233509 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a3b54f38-71c4-4be2-a32f-d128e536fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:48.337174 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 738/1492] 10.222.0.91 () {58 vars in 1024 bytes} [Wed Aug 24 10:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:48.635252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d9dde-5fd7-4798-ae66-c12052f7e31f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:48.636890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-153d9dde-5fd7-4798-ae66-c12052f7e31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:48.744374 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d9dde-5fd7-4798-ae66-c12052f7e31f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:48.817323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddaa22-864f-4593-a61d-0014b991064b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:48.817931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddaa22-864f-4593-a61d-0014b991064b service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:48.818207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddaa22-864f-4593-a61d-0014b991064b service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:48.818494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddaa22-864f-4593-a61d-0014b991064b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:48.820098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9dddaa22-864f-4593-a61d-0014b991064b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:48.829549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:48.934966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddaa22-864f-4593-a61d-0014b991064b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:48.937305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddaa22-864f-4593-a61d-0014b991064b service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:48.956449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 755/1493] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:58.335386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=82 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:58.953565 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=50 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:14.240351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda523fb-dab5-4f04-ae1a-69635a4f5d8f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:14.240938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda523fb-dab5-4f04-ae1a-69635a4f5d8f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:14.240938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda523fb-dab5-4f04-ae1a-69635a4f5d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:14.324560 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fda523fb-dab5-4f04-ae1a-69635a4f5d8f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:14.326516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fda523fb-dab5-4f04-ae1a-69635a4f5d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:14.423047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 739/1494] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:14.431122 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370d8b5-ddc5-42c8-8fca-279c3a5c8400 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:14.431689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370d8b5-ddc5-42c8-8fca-279c3a5c8400 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:14.431689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370d8b5-ddc5-42c8-8fca-279c3a5c8400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:14.510109 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d370d8b5-ddc5-42c8-8fca-279c3a5c8400 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:14.511229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d370d8b5-ddc5-42c8-8fca-279c3a5c8400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:14.608508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 756/1495] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:14.613336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda523fb-dab5-4f04-ae1a-69635a4f5d8f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:14.614598 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fda523fb-dab5-4f04-ae1a-69635a4f5d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:14.626003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda523fb-dab5-4f04-ae1a-69635a4f5d8f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:14.688559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:14.724828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6864d-f82b-43e8-a279-f9f4c94fcfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:14.725424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6864d-f82b-43e8-a279-f9f4c94fcfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:14.725698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6864d-f82b-43e8-a279-f9f4c94fcfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:14.725966 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6864d-f82b-43e8-a279-f9f4c94fcfd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:14.727080 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6864d-f82b-43e8-a279-f9f4c94fcfd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:14.727618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6864d-f82b-43e8-a279-f9f4c94fcfd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:14.729513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-6ca6864d-f82b-43e8-a279-f9f4c94fcfd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:41:14.729513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 24 10:41:14.729513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: Aug 24 10:41:14.731232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6864d-f82b-43e8-a279-f9f4c94fcfd8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:14.743963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 740/1496] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:14.752553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370d8b5-ddc5-42c8-8fca-279c3a5c8400 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:14.761530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370d8b5-ddc5-42c8-8fca-279c3a5c8400 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:14.823119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:14.857549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea440f-87db-40fb-a94b-1b721b4b13b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:14.858153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea440f-87db-40fb-a94b-1b721b4b13b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:14.858430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea440f-87db-40fb-a94b-1b721b4b13b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:14.858698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea440f-87db-40fb-a94b-1b721b4b13b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:14.859310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea440f-87db-40fb-a94b-1b721b4b13b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:14.861063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-e9ea440f-87db-40fb-a94b-1b721b4b13b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:41:14.861063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 24 10:41:14.861063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: Aug 24 10:41:14.862257 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea440f-87db-40fb-a94b-1b721b4b13b5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:15.003703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 757/1497] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:14 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:15.008084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6864d-f82b-43e8-a279-f9f4c94fcfd8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:15.009598 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6ca6864d-f82b-43e8-a279-f9f4c94fcfd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:15.044947 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6864d-f82b-43e8-a279-f9f4c94fcfd8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:15.139105 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876174-3ed6-495a-ae4e-4bb01f9959a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:15.139703 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876174-3ed6-495a-ae4e-4bb01f9959a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:15.140012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876174-3ed6-495a-ae4e-4bb01f9959a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:15.140286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876174-3ed6-495a-ae4e-4bb01f9959a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:15.140916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39876174-3ed6-495a-ae4e-4bb01f9959a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:15.141928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-39876174-3ed6-495a-ae4e-4bb01f9959a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:41:15.141928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 24 10:41:15.141928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: Aug 24 10:41:15.143166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39876174-3ed6-495a-ae4e-4bb01f9959a0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:15.232361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 741/1498] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:15 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:15.236916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea440f-87db-40fb-a94b-1b721b4b13b5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:15.238560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e9ea440f-87db-40fb-a94b-1b721b4b13b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:15.303863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea440f-87db-40fb-a94b-1b721b4b13b5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:15.388902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:15.399103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc699d-86d2-43be-b303-f0b294c9cb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:15.399700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc699d-86d2-43be-b303-f0b294c9cb97 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:15.400004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc699d-86d2-43be-b303-f0b294c9cb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:15.400272 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc699d-86d2-43be-b303-f0b294c9cb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:15.400906 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc699d-86d2-43be-b303-f0b294c9cb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:15.401907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-e9dc699d-86d2-43be-b303-f0b294c9cb97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:41:15.401907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 24 10:41:15.401907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: Aug 24 10:41:15.402794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc699d-86d2-43be-b303-f0b294c9cb97 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:15.416400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 758/1499] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:15.421979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876174-3ed6-495a-ae4e-4bb01f9959a0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:15.423576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-39876174-3ed6-495a-ae4e-4bb01f9959a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:15.434879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876174-3ed6-495a-ae4e-4bb01f9959a0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:15.461193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:15.532778 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59348f12-7ec9-4a18-9afb-21d0bc7b16ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:15.533388 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59348f12-7ec9-4a18-9afb-21d0bc7b16ce admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:15.533664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59348f12-7ec9-4a18-9afb-21d0bc7b16ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:15.533936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59348f12-7ec9-4a18-9afb-21d0bc7b16ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:15.534573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59348f12-7ec9-4a18-9afb-21d0bc7b16ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:15.535584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-59348f12-7ec9-4a18-9afb-21d0bc7b16ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:41:15.535584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 24 10:41:15.535584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: Aug 24 10:41:15.536508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59348f12-7ec9-4a18-9afb-21d0bc7b16ce admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:15.549288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 742/1500] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:15.553477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc699d-86d2-43be-b303-f0b294c9cb97 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:15.555088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e9dc699d-86d2-43be-b303-f0b294c9cb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:15.588254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc699d-86d2-43be-b303-f0b294c9cb97 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:15.682586 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef76f45-a0a0-4f22-aacf-832cc9f84c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:15.683236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef76f45-a0a0-4f22-aacf-832cc9f84c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:15.683517 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef76f45-a0a0-4f22-aacf-832cc9f84c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:15.683825 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef76f45-a0a0-4f22-aacf-832cc9f84c15 admin admin] PATH_INFO: `/v3/projects/bc8a3e8bb87645bda0350e929ecb7553/users/ab2f43924c8844f1878d687a2a246d1b/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:15.706008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef76f45-a0a0-4f22-aacf-832cc9f84c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8a3e8bb87645bda0350e929ecb7553, user_id=ab2f43924c8844f1878d687a2a246d1b, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:15.707031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-4ef76f45-a0a0-4f22-aacf-832cc9f84c15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:41:15.707031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 24 10:41:15.707031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: Aug 24 10:41:15.709021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef76f45-a0a0-4f22-aacf-832cc9f84c15 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:15.806270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 759/1501] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:15 2022] PUT /identity/v3/projects/bc8a3e8bb87645bda0350e929ecb7553/users/ab2f43924c8844f1878d687a2a246d1b/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:15.819090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d5ab6-6b6c-4840-af73-b8afbc78cac8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:15.819368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d5ab6-6b6c-4840-af73-b8afbc78cac8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:15.819640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d5ab6-6b6c-4840-af73-b8afbc78cac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:15.876925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-863d5ab6-6b6c-4840-af73-b8afbc78cac8 None None] MFA Rules not processed for user `ab2f43924c8844f1878d687a2a246d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:15.878412 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-863d5ab6-6b6c-4840-af73-b8afbc78cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:15.957500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 743/1502] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:41:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:15.971812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71831123-8a10-482f-9dcd-098e722c4dfd None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:15.972103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71831123-8a10-482f-9dcd-098e722c4dfd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:15.972382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71831123-8a10-482f-9dcd-098e722c4dfd None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:15.973723 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 760/1503] 10.222.0.91 () {54 vars in 964 bytes} [Wed Aug 24 10:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:41:15.978583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1242d27-b9c8-47c0-ad68-77db134b5e11 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:15.978871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1242d27-b9c8-47c0-ad68-77db134b5e11 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:15.979149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1242d27-b9c8-47c0-ad68-77db134b5e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:16.011019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:16.057705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c1242d27-b9c8-47c0-ad68-77db134b5e11 None None] MFA Rules not processed for user `dc05a509ea1c4aa582380541cfc37989`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:16.058823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c1242d27-b9c8-47c0-ad68-77db134b5e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:16.134406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 744/1504] 10.222.0.91 () {58 vars in 1061 bytes} [Wed Aug 24 10:41:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:16.142349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71831123-8a10-482f-9dcd-098e722c4dfd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:16.144012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-71831123-8a10-482f-9dcd-098e722c4dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:16.195190 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:16.254280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71831123-8a10-482f-9dcd-098e722c4dfd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:16.331447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25475ca2-f27f-467f-9dc4-deacf6c04236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:16.331984 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25475ca2-f27f-467f-9dc4-deacf6c04236 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:16.332263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25475ca2-f27f-467f-9dc4-deacf6c04236 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:16.332535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25475ca2-f27f-467f-9dc4-deacf6c04236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:16.334117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-25475ca2-f27f-467f-9dc4-deacf6c04236 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:16.434553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25475ca2-f27f-467f-9dc4-deacf6c04236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:16.436313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25475ca2-f27f-467f-9dc4-deacf6c04236 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:16.439674 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:16.455185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 761/1505] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:16.500785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc666aa-6355-4be5-9115-2f0ec85cca15 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:16.501461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc666aa-6355-4be5-9115-2f0ec85cca15 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:16.501686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc666aa-6355-4be5-9115-2f0ec85cca15 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:16.503300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 745/1506] 10.222.0.91 () {52 vars in 830 bytes} [Wed Aug 24 10:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:41:16.506959 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25475ca2-f27f-467f-9dc4-deacf6c04236 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:16.508260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-25475ca2-f27f-467f-9dc4-deacf6c04236 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:16.609291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25475ca2-f27f-467f-9dc4-deacf6c04236 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:16.716430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:16.717293 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:16.717634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:16.718008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] PATH_INFO: `/v3/users/ab2f43924c8844f1878d687a2a246d1b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:16.732147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2f43924c8844f1878d687a2a246d1b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:16.733196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:41:16.733196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 24 10:41:16.733196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: Aug 24 10:41:16.734526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:16.745832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:16.948101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2f43924c8844f1878d687a2a246d1b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:16.972231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2f43924c8844f1878d687a2a246d1b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.029852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2f43924c8844f1878d687a2a246d1b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.030347 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2f43924c8844f1878d687a2a246d1b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.030869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2f43924c8844f1878d687a2a246d1b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.053039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 762/1507] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:16 2022] DELETE /identity/v3/users/ab2f43924c8844f1878d687a2a246d1b => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:17.057607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55fc8f-117e-492a-b843-ad1aa1a8a5d7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:17.057887 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55fc8f-117e-492a-b843-ad1aa1a8a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:17.058157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55fc8f-117e-492a-b843-ad1aa1a8a5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:17.115648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2e55fc8f-117e-492a-b843-ad1aa1a8a5d7 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:17.116867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2e55fc8f-117e-492a-b843-ad1aa1a8a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:17.199475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:17.214739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 746/1508] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:17.224765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:17.226000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:17.326534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5f421-aa86-44d8-a55f-6d41fff3f9ce admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:17.382310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:17.401400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252274b4-0bea-4087-86e3-b189d2b1a28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:17.402005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252274b4-0bea-4087-86e3-b189d2b1a28c service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:17.402279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252274b4-0bea-4087-86e3-b189d2b1a28c service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:17.402546 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252274b4-0bea-4087-86e3-b189d2b1a28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:17.404220 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-252274b4-0bea-4087-86e3-b189d2b1a28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:17.516683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252274b4-0bea-4087-86e3-b189d2b1a28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:17.518035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252274b4-0bea-4087-86e3-b189d2b1a28c service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:17.536918 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 763/1509] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:18.003873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55fc8f-117e-492a-b843-ad1aa1a8a5d7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:18.005103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2e55fc8f-117e-492a-b843-ad1aa1a8a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:18.017480 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55fc8f-117e-492a-b843-ad1aa1a8a5d7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:18.114651 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:18.115275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:18.115553 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:18.115856 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] PATH_INFO: `/v3/projects/bc8a3e8bb87645bda0350e929ecb7553` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:18.126344 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc8a3e8bb87645bda0350e929ecb7553)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:18.127619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:41:18.127619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 24 10:41:18.127619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: Aug 24 10:41:18.129010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:18.293208 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc8a3e8bb87645bda0350e929ecb7553', 'request_id': 'req-0bad15c4-c425-4901-9b08-9c8e1e9e574c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.307081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc8a3e8bb87645bda0350e929ecb7553', 'request_id': 'req-0bad15c4-c425-4901-9b08-9c8e1e9e574c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.399728 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc8a3e8bb87645bda0350e929ecb7553', 'request_id': 'req-0bad15c4-c425-4901-9b08-9c8e1e9e574c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.424216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] The token cache is being invalidate because project bc8a3e8bb87645bda0350e929ecb7553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:18.424501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.424924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0bad15c4-c425-4901-9b08-9c8e1e9e574c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.426327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 747/1510] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:18 2022] DELETE /identity/v3/projects/bc8a3e8bb87645bda0350e929ecb7553 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:27.534837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=62 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:28.422270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:57.597930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35702e1f-0bcf-45dc-b161-cf2bfc24b9a0 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.598497 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35702e1f-0bcf-45dc-b161-cf2bfc24b9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.598497 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35702e1f-0bcf-45dc-b161-cf2bfc24b9a0 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.599940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:42:57.604875 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027091ec-6077-4dd4-9d27-3426fba308a4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.605304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027091ec-6077-4dd4-9d27-3426fba308a4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.605461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027091ec-6077-4dd4-9d27-3426fba308a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.688078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-027091ec-6077-4dd4-9d27-3426fba308a4 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.689281 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-027091ec-6077-4dd4-9d27-3426fba308a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.793754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.950370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35702e1f-0bcf-45dc-b161-cf2bfc24b9a0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.952579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-35702e1f-0bcf-45dc-b161-cf2bfc24b9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:58.073729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35702e1f-0bcf-45dc-b161-cf2bfc24b9a0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.079123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0a111-7b46-4391-8db8-66303a939b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.079737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a111-7b46-4391-8db8-66303a939b29 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.080029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a111-7b46-4391-8db8-66303a939b29 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.080302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a111-7b46-4391-8db8-66303a939b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.089419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0a111-7b46-4391-8db8-66303a939b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.090998 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0a111-7b46-4391-8db8-66303a939b29 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.100914 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 765/1513] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:58.942439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772fba6-c494-4757-995c-b27b3d7317f5 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.943013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772fba6-c494-4757-995c-b27b3d7317f5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.944024 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772fba6-c494-4757-995c-b27b3d7317f5 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.946424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:42:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:42:58.951275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe2dca-a063-4a31-a929-ba738bedac52 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.951697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe2dca-a063-4a31-a929-ba738bedac52 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.951852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe2dca-a063-4a31-a929-ba738bedac52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.971768 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3afe2dca-a063-4a31-a929-ba738bedac52 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:58.973092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3afe2dca-a063-4a31-a929-ba738bedac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:58.981921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:59.136765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772fba6-c494-4757-995c-b27b3d7317f5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:59.152836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772fba6-c494-4757-995c-b27b3d7317f5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:59.158381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e5cb6-7f3a-4184-9205-780cbcc15a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:59.159029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e5cb6-7f3a-4184-9205-780cbcc15a71 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.159303 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e5cb6-7f3a-4184-9205-780cbcc15a71 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.159567 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e5cb6-7f3a-4184-9205-780cbcc15a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.168433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e5cb6-7f3a-4184-9205-780cbcc15a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:59.170025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e5cb6-7f3a-4184-9205-780cbcc15a71 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:59.179566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 750/1516] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:00.480774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bc425-7f3d-4cc3-92be-6f2936c1278b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.481383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bc425-7f3d-4cc3-92be-6f2936c1278b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.481383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bc425-7f3d-4cc3-92be-6f2936c1278b None None] PATH_INFO: `/v3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.482585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 767/1517] 10.222.0.59 () {54 vars in 925 bytes} [Wed Aug 24 10:43:00 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:00.488999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6013dcc-55b7-4b3c-acd3-9f7790b32bb6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.489545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6013dcc-55b7-4b3c-acd3-9f7790b32bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.489545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6013dcc-55b7-4b3c-acd3-9f7790b32bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.557322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a6013dcc-55b7-4b3c-acd3-9f7790b32bb6 None None] MFA Rules not processed for user `8ebfb233b2504463a4ee9202b5a3ab50`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:00.558528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a6013dcc-55b7-4b3c-acd3-9f7790b32bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:00.576938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:00.634640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 751/1518] 10.222.0.59 () {58 vars in 1015 bytes} [Wed Aug 24 10:43:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:04.754632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f4525-5361-4da8-87a0-41fac158ce03 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:04.755176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f4525-5361-4da8-87a0-41fac158ce03 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:04.755176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f4525-5361-4da8-87a0-41fac158ce03 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:04.756602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 768/1519] 10.222.0.91 () {54 vars in 961 bytes} [Wed Aug 24 10:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:04.762693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80577e-ff48-461f-b57d-c85074a9bb6a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:04.763179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80577e-ff48-461f-b57d-c85074a9bb6a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:04.763297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80577e-ff48-461f-b57d-c85074a9bb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:04.782214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7a80577e-ff48-461f-b57d-c85074a9bb6a None None] MFA Rules not processed for user `8ebfb233b2504463a4ee9202b5a3ab50`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:04.783440 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7a80577e-ff48-461f-b57d-c85074a9bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:04.792534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 752/1520] 10.222.0.91 () {58 vars in 1058 bytes} [Wed Aug 24 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:04.800430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f4525-5361-4da8-87a0-41fac158ce03 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:04.814524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f4525-5361-4da8-87a0-41fac158ce03 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:04.820223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86baeb-88bc-478e-8f35-0a94eef89b5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebfb233b2504463a4ee9202b5a3ab50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:04.820816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86baeb-88bc-478e-8f35-0a94eef89b5f service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:04.821099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86baeb-88bc-478e-8f35-0a94eef89b5f service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:04.821372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86baeb-88bc-478e-8f35-0a94eef89b5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:04.829938 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86baeb-88bc-478e-8f35-0a94eef89b5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:04.831520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86baeb-88bc-478e-8f35-0a94eef89b5f service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:04.841467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 769/1521] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:10.609255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1890e9-6546-43c5-9ebd-14b8da6cd322 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:10.609836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1890e9-6546-43c5-9ebd-14b8da6cd322 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:10.609836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1890e9-6546-43c5-9ebd-14b8da6cd322 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:10.611519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:10.618335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5616-eafc-4b2d-a55a-80fb116b951b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:10.618935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5616-eafc-4b2d-a55a-80fb116b951b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:10.618935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5616-eafc-4b2d-a55a-80fb116b951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:10.641877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d5bb5616-eafc-4b2d-a55a-80fb116b951b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:10.643136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d5bb5616-eafc-4b2d-a55a-80fb116b951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:10.652039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:10.809966 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1890e9-6546-43c5-9ebd-14b8da6cd322 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:10.827002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1890e9-6546-43c5-9ebd-14b8da6cd322 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:10.832642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb8eeb-f193-43d5-b4ab-897adc92261c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:10.833255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb8eeb-f193-43d5-b4ab-897adc92261c service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:10.833520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb8eeb-f193-43d5-b4ab-897adc92261c service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:10.833792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb8eeb-f193-43d5-b4ab-897adc92261c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:10.846828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb8eeb-f193-43d5-b4ab-897adc92261c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:10.848549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb8eeb-f193-43d5-b4ab-897adc92261c service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:10.866248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 754/1524] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:11.700729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce4aab-33f3-4078-8177-d3b439aa55fa None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:11.701511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce4aab-33f3-4078-8177-d3b439aa55fa None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:11.701511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce4aab-33f3-4078-8177-d3b439aa55fa None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:11.702668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:11.708046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679552-a44d-46bc-8a1d-fc0073619fec None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:11.708745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679552-a44d-46bc-8a1d-fc0073619fec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:11.708745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679552-a44d-46bc-8a1d-fc0073619fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:11.730252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-71679552-a44d-46bc-8a1d-fc0073619fec None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:11.731480 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-71679552-a44d-46bc-8a1d-fc0073619fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:11.740000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:11.895901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce4aab-33f3-4078-8177-d3b439aa55fa None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:11.913551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce4aab-33f3-4078-8177-d3b439aa55fa None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:11.919331 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f6f33-8a3e-4be5-ba12-10a4af77fd0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:11.919974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f6f33-8a3e-4be5-ba12-10a4af77fd0b service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:11.920257 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f6f33-8a3e-4be5-ba12-10a4af77fd0b service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:11.920526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f6f33-8a3e-4be5-ba12-10a4af77fd0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:11.932192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f6f33-8a3e-4be5-ba12-10a4af77fd0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:11.933854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f6f33-8a3e-4be5-ba12-10a4af77fd0b service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:11.947811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 772/1527] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:16.066534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b1f29-cf1c-462b-8b86-5463f5a8c774 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:16.067064 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b1f29-cf1c-462b-8b86-5463f5a8c774 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:16.067196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b1f29-cf1c-462b-8b86-5463f5a8c774 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:16.069688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:43:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:16.075076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371edac3-e436-422e-afdf-b0199b5b57cd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:16.075514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371edac3-e436-422e-afdf-b0199b5b57cd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:16.075614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371edac3-e436-422e-afdf-b0199b5b57cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:16.095693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-371edac3-e436-422e-afdf-b0199b5b57cd None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:16.097078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-371edac3-e436-422e-afdf-b0199b5b57cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:16.105233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:16.397752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b1f29-cf1c-462b-8b86-5463f5a8c774 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:16.399466 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-956b1f29-cf1c-462b-8b86-5463f5a8c774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:16.504780 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b1f29-cf1c-462b-8b86-5463f5a8c774 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:16.508665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac2e32-2330-4364-8f5d-1a078c49ea74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:16.509297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac2e32-2330-4364-8f5d-1a078c49ea74 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:16.509571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac2e32-2330-4364-8f5d-1a078c49ea74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:16.509837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac2e32-2330-4364-8f5d-1a078c49ea74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:16.519884 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac2e32-2330-4364-8f5d-1a078c49ea74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:16.521395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac2e32-2330-4364-8f5d-1a078c49ea74 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:16.531372 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 757/1530] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:18.513149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fc4ce-ac93-42be-973f-2f20901ce5c3 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:18.513707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fc4ce-ac93-42be-973f-2f20901ce5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:18.513707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fc4ce-ac93-42be-973f-2f20901ce5c3 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:18.515064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:18.522104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3555-15e6-4b23-8f9b-e9d81d34a599 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:18.522631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3555-15e6-4b23-8f9b-e9d81d34a599 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:18.522983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3555-15e6-4b23-8f9b-e9d81d34a599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:18.547453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-561b3555-15e6-4b23-8f9b-e9d81d34a599 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:18.548711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-561b3555-15e6-4b23-8f9b-e9d81d34a599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:18.557762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:18.849136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fc4ce-ac93-42be-973f-2f20901ce5c3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:18.860002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fc4ce-ac93-42be-973f-2f20901ce5c3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:18.863564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb3795-ef29-42b3-a314-dd4fc84f8475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:18.864189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3795-ef29-42b3-a314-dd4fc84f8475 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:18.864463 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3795-ef29-42b3-a314-dd4fc84f8475 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:18.864732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3795-ef29-42b3-a314-dd4fc84f8475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:18.874377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb3795-ef29-42b3-a314-dd4fc84f8475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:18.876084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb3795-ef29-42b3-a314-dd4fc84f8475 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:18.886416 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 775/1533] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:22.363870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9ca52-382a-44a9-80b0-542f80f1cbde None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:22.364375 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9ca52-382a-44a9-80b0-542f80f1cbde None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:22.364488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9ca52-382a-44a9-80b0-542f80f1cbde None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:22.366412 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:22.371868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfec1e-bece-4146-84fd-e942df7217da None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:22.372314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfec1e-bece-4146-84fd-e942df7217da None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:22.372441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfec1e-bece-4146-84fd-e942df7217da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:22.393698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-96dfec1e-bece-4146-84fd-e942df7217da None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:22.395073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-96dfec1e-bece-4146-84fd-e942df7217da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:22.403921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:22.975633 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9ca52-382a-44a9-80b0-542f80f1cbde None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:22.977459 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bad9ca52-382a-44a9-80b0-542f80f1cbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:23.046084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:23.060937 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9ca52-382a-44a9-80b0-542f80f1cbde None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:23.064722 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae48d73-96fb-4c6c-8927-2cc537fff5b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:23.065328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae48d73-96fb-4c6c-8927-2cc537fff5b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.065608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae48d73-96fb-4c6c-8927-2cc537fff5b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.065882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae48d73-96fb-4c6c-8927-2cc537fff5b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.076019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae48d73-96fb-4c6c-8927-2cc537fff5b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:23.077516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae48d73-96fb-4c6c-8927-2cc537fff5b1 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.088923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 760/1536] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:25.092430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bf93e-f577-46a5-b2a2-d557f44b773d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.093043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bf93e-f577-46a5-b2a2-d557f44b773d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.093043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bf93e-f577-46a5-b2a2-d557f44b773d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.094367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:25.103525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae74c9-8f15-4164-8812-52d594dacdf4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.103525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae74c9-8f15-4164-8812-52d594dacdf4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.103525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae74c9-8f15-4164-8812-52d594dacdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.133779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-12ae74c9-8f15-4164-8812-52d594dacdf4 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:25.135111 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-12ae74c9-8f15-4164-8812-52d594dacdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:25.144003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:25.739845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bf93e-f577-46a5-b2a2-d557f44b773d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:25.741504 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-810bf93e-f577-46a5-b2a2-d557f44b773d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:25.755501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bf93e-f577-46a5-b2a2-d557f44b773d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:25.759290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff8e2d-5c2c-40ec-a269-a0442523d5e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:25.759921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff8e2d-5c2c-40ec-a269-a0442523d5e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.760197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff8e2d-5c2c-40ec-a269-a0442523d5e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.760468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff8e2d-5c2c-40ec-a269-a0442523d5e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.772090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff8e2d-5c2c-40ec-a269-a0442523d5e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:25.773549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff8e2d-5c2c-40ec-a269-a0442523d5e7 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:25.784327 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 778/1539] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:35.125004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=11 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:35.779368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:01.218866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cddc65-e1c2-4245-86e0-a3ba6128a934 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:01.228465 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cddc65-e1c2-4245-86e0-a3ba6128a934 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:01.228465 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cddc65-e1c2-4245-86e0-a3ba6128a934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:01.276377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-19cddc65-e1c2-4245-86e0-a3ba6128a934 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:01.278795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-19cddc65-e1c2-4245-86e0-a3ba6128a934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:01.304712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 762/1540] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:01.325944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13932d-7b92-4dcd-ab48-c87cdf32e7df None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:01.326734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13932d-7b92-4dcd-ab48-c87cdf32e7df None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:01.328391 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13932d-7b92-4dcd-ab48-c87cdf32e7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:01.372186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5c13932d-7b92-4dcd-ab48-c87cdf32e7df None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:01.374803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5c13932d-7b92-4dcd-ab48-c87cdf32e7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:01.398110 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 779/1541] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:01.403367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cddc65-e1c2-4245-86e0-a3ba6128a934 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:01.436127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cddc65-e1c2-4245-86e0-a3ba6128a934 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:01.456117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646bb82-4f88-49a6-a712-7aa4d5d303f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:01.457395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646bb82-4f88-49a6-a712-7aa4d5d303f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:01.457991 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646bb82-4f88-49a6-a712-7aa4d5d303f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:01.459184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646bb82-4f88-49a6-a712-7aa4d5d303f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:01.459997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646bb82-4f88-49a6-a712-7aa4d5d303f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:01.460608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646bb82-4f88-49a6-a712-7aa4d5d303f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:01.474891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646bb82-4f88-49a6-a712-7aa4d5d303f3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:01.521330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 763/1542] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:45:01.537880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13932d-7b92-4dcd-ab48-c87cdf32e7df None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:01.585160 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13932d-7b92-4dcd-ab48-c87cdf32e7df None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:01.605436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b5afa-a788-49d0-a625-ad3259d6cb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:01.608168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b5afa-a788-49d0-a625-ad3259d6cb0c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:01.608168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b5afa-a788-49d0-a625-ad3259d6cb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:01.608168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b5afa-a788-49d0-a625-ad3259d6cb0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:01.609061 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b5afa-a788-49d0-a625-ad3259d6cb0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:01.618432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b5afa-a788-49d0-a625-ad3259d6cb0c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:01.639546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfcad5-36d6-4a6f-a84c-f1f2c76d8c94 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:01.640039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfcad5-36d6-4a6f-a84c-f1f2c76d8c94 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:01.640538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfcad5-36d6-4a6f-a84c-f1f2c76d8c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:01.731515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-55dfcad5-36d6-4a6f-a84c-f1f2c76d8c94 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:01.733949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-55dfcad5-36d6-4a6f-a84c-f1f2c76d8c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:01.777329 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 764/1543] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:01.794428 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19290dbd-79e4-474a-979c-06f448e31359 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:01.795976 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19290dbd-79e4-474a-979c-06f448e31359 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:01.796539 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19290dbd-79e4-474a-979c-06f448e31359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:01.858675 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-19290dbd-79e4-474a-979c-06f448e31359 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:01.861879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-19290dbd-79e4-474a-979c-06f448e31359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:01.893487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 765/1544] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:01.898934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 780/1545] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:01 2022] POST /identity/v3/projects => generated 379 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:01.902046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19290dbd-79e4-474a-979c-06f448e31359 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:01.905754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b5afa-a788-49d0-a625-ad3259d6cb0c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:01.932983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19290dbd-79e4-474a-979c-06f448e31359 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:02.083258 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b5afa-a788-49d0-a625-ad3259d6cb0c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:02.098115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3df7b1-c8a0-4af9-9b8b-6c78f2ba499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:02.098974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3df7b1-c8a0-4af9-9b8b-6c78f2ba499c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.099380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3df7b1-c8a0-4af9-9b8b-6c78f2ba499c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.099769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3df7b1-c8a0-4af9-9b8b-6c78f2ba499c admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.100563 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3df7b1-c8a0-4af9-9b8b-6c78f2ba499c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:02.101937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-bb3df7b1-c8a0-4af9-9b8b-6c78f2ba499c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:45:02.101937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 24 10:45:02.101937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: Aug 24 10:45:02.103473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3df7b1-c8a0-4af9-9b8b-6c78f2ba499c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:02.169734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2722fe-5836-47a4-bd7e-2220b932deae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:02.170378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2722fe-5836-47a4-bd7e-2220b932deae admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.170657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2722fe-5836-47a4-bd7e-2220b932deae admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.170930 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2722fe-5836-47a4-bd7e-2220b932deae admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.171599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2722fe-5836-47a4-bd7e-2220b932deae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:02.171939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2722fe-5836-47a4-bd7e-2220b932deae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:02.173833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2722fe-5836-47a4-bd7e-2220b932deae admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:02.200252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 766/1546] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:45:02.224437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2722fe-5836-47a4-bd7e-2220b932deae admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:02.242866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 781/1547] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:01 2022] POST /identity/v3/users => generated 290 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:02.245595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2722fe-5836-47a4-bd7e-2220b932deae admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:02.247392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3df7b1-c8a0-4af9-9b8b-6c78f2ba499c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:02.268349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3df7b1-c8a0-4af9-9b8b-6c78f2ba499c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:02.272502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d7db2-4ed0-45c8-835e-2ad6cd1ceaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:02.273374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d7db2-4ed0-45c8-835e-2ad6cd1ceaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.273782 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d7db2-4ed0-45c8-835e-2ad6cd1ceaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.274283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d7db2-4ed0-45c8-835e-2ad6cd1ceaa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.275419 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d7db2-4ed0-45c8-835e-2ad6cd1ceaa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:02.277156 dv-cinder-854274-2-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-a89d7db2-4ed0-45c8-835e-2ad6cd1ceaa1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:45:02.277156 dv-cinder-854274-2-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 24 10:45:02.277156 dv-cinder-854274-2-smb devstack@keystone.service[81632]: Aug 24 10:45:02.282093 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab8976-47df-4134-adfa-2d05b680a92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:02.283013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8976-47df-4134-adfa-2d05b680a92f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.283635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8976-47df-4134-adfa-2d05b680a92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.284001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8976-47df-4134-adfa-2d05b680a92f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.284643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab8976-47df-4134-adfa-2d05b680a92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:02.285411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d7db2-4ed0-45c8-835e-2ad6cd1ceaa1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:02.286526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab8976-47df-4134-adfa-2d05b680a92f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:02.303706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 782/1548] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:45:02.308260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab8976-47df-4134-adfa-2d05b680a92f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:02.329384 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab8976-47df-4134-adfa-2d05b680a92f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:02.339763 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5c4d9-6ed1-4c6f-9dc3-ad09ff9f2da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:02.355785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5c4d9-6ed1-4c6f-9dc3-ad09ff9f2da5 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.355785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5c4d9-6ed1-4c6f-9dc3-ad09ff9f2da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.355785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5c4d9-6ed1-4c6f-9dc3-ad09ff9f2da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.355785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5c4d9-6ed1-4c6f-9dc3-ad09ff9f2da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:02.355785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5c4d9-6ed1-4c6f-9dc3-ad09ff9f2da5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:02.369042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 783/1549] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:02.373605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5c4d9-6ed1-4c6f-9dc3-ad09ff9f2da5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:02.396352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5c4d9-6ed1-4c6f-9dc3-ad09ff9f2da5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:02.411668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cc2c8-eba5-424a-9014-45b5d2f5b698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:02.413888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cc2c8-eba5-424a-9014-45b5d2f5b698 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.414666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cc2c8-eba5-424a-9014-45b5d2f5b698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.415506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cc2c8-eba5-424a-9014-45b5d2f5b698 admin admin] PATH_INFO: `/v3/projects/86078f10d6a8435cb7fe63394c82295b/users/53775327011e435a8a08edcb90f01db3/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.455250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cc2c8-eba5-424a-9014-45b5d2f5b698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86078f10d6a8435cb7fe63394c82295b, user_id=53775327011e435a8a08edcb90f01db3, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:02.467231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cc2c8-eba5-424a-9014-45b5d2f5b698 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:02.478065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 767/1550] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:02 2022] POST /identity/v3/projects => generated 403 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:45:02.479411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c818dc-1f66-46d0-b780-14a7dda5e812 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.479694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c818dc-1f66-46d0-b780-14a7dda5e812 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.487052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c818dc-1f66-46d0-b780-14a7dda5e812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.533080 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f6c818dc-1f66-46d0-b780-14a7dda5e812 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:02.535591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f6c818dc-1f66-46d0-b780-14a7dda5e812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:02.580436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 784/1551] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:02 2022] PUT /identity/v3/projects/86078f10d6a8435cb7fe63394c82295b/users/53775327011e435a8a08edcb90f01db3/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:45:02.584074 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce02f32-981a-40f7-9f48-3d0f3827d0dd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.585122 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce02f32-981a-40f7-9f48-3d0f3827d0dd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.586377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce02f32-981a-40f7-9f48-3d0f3827d0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.653040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3ce02f32-981a-40f7-9f48-3d0f3827d0dd None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:02.656476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3ce02f32-981a-40f7-9f48-3d0f3827d0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:02.688017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 768/1552] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:02.697500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c818dc-1f66-46d0-b780-14a7dda5e812 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:02.710355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c818dc-1f66-46d0-b780-14a7dda5e812 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:02.766154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:02.773957 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 785/1553] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:02.775954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1371a-985e-4027-a2d3-a7e09ec4f356 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.775954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1371a-985e-4027-a2d3-a7e09ec4f356 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.775954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1371a-985e-4027-a2d3-a7e09ec4f356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.802752 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:02.805251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6ae1371a-985e-4027-a2d3-a7e09ec4f356 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:02.807700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b23ed9-c1aa-4238-af12-8192abd6a130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:02.815027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6ae1371a-985e-4027-a2d3-a7e09ec4f356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:02.815461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b23ed9-c1aa-4238-af12-8192abd6a130 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.815461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b23ed9-c1aa-4238-af12-8192abd6a130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.815461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b23ed9-c1aa-4238-af12-8192abd6a130 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.815461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b23ed9-c1aa-4238-af12-8192abd6a130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:02.815461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b23ed9-c1aa-4238-af12-8192abd6a130 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:02.822113 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 786/1554] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:02.823628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc3dd-b4ca-4a1c-aac1-58bc83a3abea None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.824108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc3dd-b4ca-4a1c-aac1-58bc83a3abea None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.824612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc3dd-b4ca-4a1c-aac1-58bc83a3abea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.853514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0d0fc3dd-b4ca-4a1c-aac1-58bc83a3abea None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:02.854746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0d0fc3dd-b4ca-4a1c-aac1-58bc83a3abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:02.863911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 787/1555] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:02.865323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06a063-945a-4b03-9294-72adb85002d3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.865609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06a063-945a-4b03-9294-72adb85002d3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.865882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06a063-945a-4b03-9294-72adb85002d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.892749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ea06a063-945a-4b03-9294-72adb85002d3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:02.893983 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ea06a063-945a-4b03-9294-72adb85002d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:02.903153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 788/1556] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:02.904662 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5812f-48df-48c9-9ed9-e3199ee2931d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.904985 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5812f-48df-48c9-9ed9-e3199ee2931d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.905511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5812f-48df-48c9-9ed9-e3199ee2931d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.938968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-93b5812f-48df-48c9-9ed9-e3199ee2931d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:02.941047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-93b5812f-48df-48c9-9ed9-e3199ee2931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:02.950655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 789/1557] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:02.952168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6065f8-5136-45dc-9d77-4f483b8a6ae3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.952449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6065f8-5136-45dc-9d77-4f483b8a6ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.952717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6065f8-5136-45dc-9d77-4f483b8a6ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.980608 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9f6065f8-5136-45dc-9d77-4f483b8a6ae3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:02.981821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9f6065f8-5136-45dc-9d77-4f483b8a6ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:02.987595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 769/1558] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:02 2022] POST /identity/v3/users => generated 302 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:02.987595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c510d25-8a4d-4e2d-8baa-9bbdcecae244 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.988736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c510d25-8a4d-4e2d-8baa-9bbdcecae244 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.989239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c510d25-8a4d-4e2d-8baa-9bbdcecae244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.994955 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 790/1559] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:02.998565 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177702-6846-48e6-a2ec-7a1bced2f430 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.998565 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177702-6846-48e6-a2ec-7a1bced2f430 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.998565 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177702-6846-48e6-a2ec-7a1bced2f430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.017788 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2c510d25-8a4d-4e2d-8baa-9bbdcecae244 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:03.020358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2c510d25-8a4d-4e2d-8baa-9bbdcecae244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:03.023181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4e177702-6846-48e6-a2ec-7a1bced2f430 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:03.028658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4e177702-6846-48e6-a2ec-7a1bced2f430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:03.036187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 770/1560] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:03.037405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b859a8-6149-44cb-b6c0-8dbdec8e0b6a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.037691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b859a8-6149-44cb-b6c0-8dbdec8e0b6a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.037965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b859a8-6149-44cb-b6c0-8dbdec8e0b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.048099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 791/1561] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:03.050148 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e177702-6846-48e6-a2ec-7a1bced2f430 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.072837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-29b859a8-6149-44cb-b6c0-8dbdec8e0b6a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:03.074066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-29b859a8-6149-44cb-b6c0-8dbdec8e0b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:03.088457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 771/1562] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:03.090144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48abe-b890-4e15-957f-a1566f2715ad None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.090568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48abe-b890-4e15-957f-a1566f2715ad None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.091008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48abe-b890-4e15-957f-a1566f2715ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.119622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1cb48abe-b890-4e15-957f-a1566f2715ad None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:03.121609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1cb48abe-b890-4e15-957f-a1566f2715ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:03.130693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e177702-6846-48e6-a2ec-7a1bced2f430 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.130968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 772/1563] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:03.132103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fa713-5a7f-4577-8f50-11195fb5a71a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.132422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fa713-5a7f-4577-8f50-11195fb5a71a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.132650 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fa713-5a7f-4577-8f50-11195fb5a71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.138938 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7094fd3-9aa7-4ed1-a269-07c68ca223ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.140015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7094fd3-9aa7-4ed1-a269-07c68ca223ff service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.140989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7094fd3-9aa7-4ed1-a269-07c68ca223ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.143367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7094fd3-9aa7-4ed1-a269-07c68ca223ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.155047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f85fa713-5a7f-4577-8f50-11195fb5a71a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:03.156316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f85fa713-5a7f-4577-8f50-11195fb5a71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:03.157102 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7094fd3-9aa7-4ed1-a269-07c68ca223ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.159928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7094fd3-9aa7-4ed1-a269-07c68ca223ff service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.169007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 773/1564] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:03.169907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fa713-5a7f-4577-8f50-11195fb5a71a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.171862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 792/1565] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:03.173770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7094fd3-9aa7-4ed1-a269-07c68ca223ff service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.186340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fa713-5a7f-4577-8f50-11195fb5a71a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.194257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9213dc-cd81-404f-816d-a2c355ae79d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.194903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9213dc-cd81-404f-816d-a2c355ae79d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.195517 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9213dc-cd81-404f-816d-a2c355ae79d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.195517 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9213dc-cd81-404f-816d-a2c355ae79d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.196114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9213dc-cd81-404f-816d-a2c355ae79d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.198027 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9213dc-cd81-404f-816d-a2c355ae79d8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.200211 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7094fd3-9aa7-4ed1-a269-07c68ca223ff service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.209831 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aff7c8-ffbd-4655-a366-a49ee8accc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.210456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aff7c8-ffbd-4655-a366-a49ee8accc66 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.212375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aff7c8-ffbd-4655-a366-a49ee8accc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.212375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aff7c8-ffbd-4655-a366-a49ee8accc66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.212375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aff7c8-ffbd-4655-a366-a49ee8accc66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:03.212678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aff7c8-ffbd-4655-a366-a49ee8accc66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.213497 dv-cinder-854274-2-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-26aff7c8-ffbd-4655-a366-a49ee8accc66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:45:03.213497 dv-cinder-854274-2-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 24 10:45:03.213497 dv-cinder-854274-2-smb devstack@keystone.service[81633]: Aug 24 10:45:03.214652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aff7c8-ffbd-4655-a366-a49ee8accc66 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.215046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 774/1566] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:03.215953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9213dc-cd81-404f-816d-a2c355ae79d8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.237454 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9213dc-cd81-404f-816d-a2c355ae79d8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.243203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc7c72-a436-44ad-93f0-2b0fdd9f3175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.243849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc7c72-a436-44ad-93f0-2b0fdd9f3175 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.244135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc7c72-a436-44ad-93f0-2b0fdd9f3175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.244412 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc7c72-a436-44ad-93f0-2b0fdd9f3175 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.245085 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc7c72-a436-44ad-93f0-2b0fdd9f3175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:03.245390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc7c72-a436-44ad-93f0-2b0fdd9f3175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.247004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc7c72-a436-44ad-93f0-2b0fdd9f3175 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.251039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 793/1567] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:45:03.253510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452a250-4aaa-4ca5-a169-72f24970580a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.253796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452a250-4aaa-4ca5-a169-72f24970580a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.254076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452a250-4aaa-4ca5-a169-72f24970580a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.270210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 775/1568] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:45:03.271165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc7c72-a436-44ad-93f0-2b0fdd9f3175 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.282062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc7c72-a436-44ad-93f0-2b0fdd9f3175 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.289458 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1452a250-4aaa-4ca5-a169-72f24970580a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:03.289705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1e5d5-25ba-4d2a-8479-eefec5376fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.289705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1e5d5-25ba-4d2a-8479-eefec5376fcc admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.289705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1e5d5-25ba-4d2a-8479-eefec5376fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.289705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1e5d5-25ba-4d2a-8479-eefec5376fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.290370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1452a250-4aaa-4ca5-a169-72f24970580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:03.290542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1e5d5-25ba-4d2a-8479-eefec5376fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:03.290542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1e5d5-25ba-4d2a-8479-eefec5376fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.291283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1e5d5-25ba-4d2a-8479-eefec5376fcc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.304317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 794/1569] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:03.305584 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452a250-4aaa-4ca5-a169-72f24970580a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.311964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 776/1570] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:45:03.313515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1e5d5-25ba-4d2a-8479-eefec5376fcc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.329554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452a250-4aaa-4ca5-a169-72f24970580a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.336063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1e5d5-25ba-4d2a-8479-eefec5376fcc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.337697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca7a45-e8c7-47ce-8a4d-c3419f9f01b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.338518 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca7a45-e8c7-47ce-8a4d-c3419f9f01b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.339041 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca7a45-e8c7-47ce-8a4d-c3419f9f01b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.339618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca7a45-e8c7-47ce-8a4d-c3419f9f01b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.340888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca7a45-e8c7-47ce-8a4d-c3419f9f01b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:03.341827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca7a45-e8c7-47ce-8a4d-c3419f9f01b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.344694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca7a45-e8c7-47ce-8a4d-c3419f9f01b7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.350881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdc7c1-098d-48ba-bebe-43186ce3cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.352323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdc7c1-098d-48ba-bebe-43186ce3cd43 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.353011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdc7c1-098d-48ba-bebe-43186ce3cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.353421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdc7c1-098d-48ba-bebe-43186ce3cd43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.355192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdc7c1-098d-48ba-bebe-43186ce3cd43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:03.355192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdc7c1-098d-48ba-bebe-43186ce3cd43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.357204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdc7c1-098d-48ba-bebe-43186ce3cd43 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.375830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 795/1571] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:45:03.375830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca7a45-e8c7-47ce-8a4d-c3419f9f01b7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.387426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 777/1572] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:45:03.390422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdc7c1-098d-48ba-bebe-43186ce3cd43 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.391548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca7a45-e8c7-47ce-8a4d-c3419f9f01b7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.406949 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f7ce1-a7e2-4443-b8d5-23dbea2ac86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.408621 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f7ce1-a7e2-4443-b8d5-23dbea2ac86d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.408621 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f7ce1-a7e2-4443-b8d5-23dbea2ac86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.409158 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f7ce1-a7e2-4443-b8d5-23dbea2ac86d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.410082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f7ce1-a7e2-4443-b8d5-23dbea2ac86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.411963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f7ce1-a7e2-4443-b8d5-23dbea2ac86d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.418054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdc7c1-098d-48ba-bebe-43186ce3cd43 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.426620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f0933-b26c-4f45-ad89-9ef9a19a3a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.427679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f0933-b26c-4f45-ad89-9ef9a19a3a97 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.428281 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f0933-b26c-4f45-ad89-9ef9a19a3a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.428805 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f0933-b26c-4f45-ad89-9ef9a19a3a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.430027 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f0933-b26c-4f45-ad89-9ef9a19a3a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.433430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 796/1573] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:03.433430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f7ce1-a7e2-4443-b8d5-23dbea2ac86d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.441333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f0933-b26c-4f45-ad89-9ef9a19a3a97 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.455803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f7ce1-a7e2-4443-b8d5-23dbea2ac86d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.462852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b55cf-d693-4e44-8ee1-633e64fa7f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.467253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b55cf-d693-4e44-8ee1-633e64fa7f96 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.467253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b55cf-d693-4e44-8ee1-633e64fa7f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.467253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b55cf-d693-4e44-8ee1-633e64fa7f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.467253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b55cf-d693-4e44-8ee1-633e64fa7f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.467253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b55cf-d693-4e44-8ee1-633e64fa7f96 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.583377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 778/1574] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:03 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:03.585678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f0933-b26c-4f45-ad89-9ef9a19a3a97 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.630948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 797/1575] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:03 2022] POST /identity/v3/projects => generated 391 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:03.631957 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b55cf-d693-4e44-8ee1-633e64fa7f96 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.678194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f0933-b26c-4f45-ad89-9ef9a19a3a97 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.753622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:03.755393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b55cf-d693-4e44-8ee1-633e64fa7f96 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.760556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c93b9f-1566-4386-8983-df3eeaf8dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.761839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c93b9f-1566-4386-8983-df3eeaf8dadf admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.762211 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c93b9f-1566-4386-8983-df3eeaf8dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.762493 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c93b9f-1566-4386-8983-df3eeaf8dadf admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.763168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c93b9f-1566-4386-8983-df3eeaf8dadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.765485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c93b9f-1566-4386-8983-df3eeaf8dadf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.778180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:03.792743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62249673-823b-473b-8ac6-d3905632dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.792743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62249673-823b-473b-8ac6-d3905632dee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.792743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62249673-823b-473b-8ac6-d3905632dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.792743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62249673-823b-473b-8ac6-d3905632dee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.793420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62249673-823b-473b-8ac6-d3905632dee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:03.793420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62249673-823b-473b-8ac6-d3905632dee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.793420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62249673-823b-473b-8ac6-d3905632dee8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.812079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 779/1576] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:45:03.813137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62249673-823b-473b-8ac6-d3905632dee8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.831807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62249673-823b-473b-8ac6-d3905632dee8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.839353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb0b83-cef5-4dad-9348-03f8d37ca0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.840346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0b83-cef5-4dad-9348-03f8d37ca0cd admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.840833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0b83-cef5-4dad-9348-03f8d37ca0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.841307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0b83-cef5-4dad-9348-03f8d37ca0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.842252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb0b83-cef5-4dad-9348-03f8d37ca0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.844206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb0b83-cef5-4dad-9348-03f8d37ca0cd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.964888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 798/1577] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:03 2022] POST /identity/v3/projects => generated 355 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:03.965715 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c93b9f-1566-4386-8983-df3eeaf8dadf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:04.019661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 780/1578] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:03 2022] POST /identity/v3/projects => generated 393 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:04.027131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb0b83-cef5-4dad-9348-03f8d37ca0cd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:04.046695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c93b9f-1566-4386-8983-df3eeaf8dadf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:04.158231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb0b83-cef5-4dad-9348-03f8d37ca0cd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:04.161379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cd088-8555-49ed-acc3-6887c823db12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:04.163673 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cd088-8555-49ed-acc3-6887c823db12 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:04.164001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cd088-8555-49ed-acc3-6887c823db12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:04.164415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cd088-8555-49ed-acc3-6887c823db12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:04.165209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cd088-8555-49ed-acc3-6887c823db12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:04.168173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cd088-8555-49ed-acc3-6887c823db12 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:04.169325 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d2a47-dcab-4eee-bffa-33f0422c8c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:04.170647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d2a47-dcab-4eee-bffa-33f0422c8c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:04.171265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d2a47-dcab-4eee-bffa-33f0422c8c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:04.171700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d2a47-dcab-4eee-bffa-33f0422c8c4d admin admin] PATH_INFO: `/v3/projects/1d6b610525a24e00a48df67a3d5c4273/users/d7f8f05888a84757a2edc5dad82d7105/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:04.200675 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d2a47-dcab-4eee-bffa-33f0422c8c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6b610525a24e00a48df67a3d5c4273, user_id=d7f8f05888a84757a2edc5dad82d7105, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:04.201815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-8c6d2a47-dcab-4eee-bffa-33f0422c8c4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:45:04.201815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 24 10:45:04.201815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: Aug 24 10:45:04.203942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d2a47-dcab-4eee-bffa-33f0422c8c4d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:04.390591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 799/1580] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:03 2022] POST /identity/v3/projects => generated 377 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:04.394219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cd088-8555-49ed-acc3-6887c823db12 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:04.400453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 781/1580] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:04 2022] PUT /identity/v3/projects/1d6b610525a24e00a48df67a3d5c4273/users/d7f8f05888a84757a2edc5dad82d7105/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:04.402114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d2a47-dcab-4eee-bffa-33f0422c8c4d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:04.508239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cd088-8555-49ed-acc3-6887c823db12 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:04.511092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2753fd-202e-42c0-95b9-bf41133b19bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:04.512125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2753fd-202e-42c0-95b9-bf41133b19bd admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:04.512804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2753fd-202e-42c0-95b9-bf41133b19bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:04.513374 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2753fd-202e-42c0-95b9-bf41133b19bd admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:04.514562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2753fd-202e-42c0-95b9-bf41133b19bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:04.518070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2753fd-202e-42c0-95b9-bf41133b19bd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:04.529406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d2a47-dcab-4eee-bffa-33f0422c8c4d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:04.536504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d960c-cdc1-412a-b34a-0c174e180796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:04.537189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d960c-cdc1-412a-b34a-0c174e180796 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:04.537501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d960c-cdc1-412a-b34a-0c174e180796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:04.537810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d960c-cdc1-412a-b34a-0c174e180796 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:04.538604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d960c-cdc1-412a-b34a-0c174e180796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:04.540691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d960c-cdc1-412a-b34a-0c174e180796 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:04.665201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 800/1581] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:04 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:04.665724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2753fd-202e-42c0-95b9-bf41133b19bd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:04.680712 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2753fd-202e-42c0-95b9-bf41133b19bd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:04.688081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123866d-008c-4bf3-be43-1eb9af5f008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:04.688773 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123866d-008c-4bf3-be43-1eb9af5f008a admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:04.689127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123866d-008c-4bf3-be43-1eb9af5f008a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:04.689433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123866d-008c-4bf3-be43-1eb9af5f008a admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:04.690237 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123866d-008c-4bf3-be43-1eb9af5f008a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:04.692739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123866d-008c-4bf3-be43-1eb9af5f008a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:04.708626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:04.716753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 782/1582] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:04 2022] POST /identity/v3/users => generated 296 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:04.718401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d960c-cdc1-412a-b34a-0c174e180796 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:04.733180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d960c-cdc1-412a-b34a-0c174e180796 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:04.741042 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abdfdb-36ab-40a3-97ea-eefbb3463dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:04.741927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abdfdb-36ab-40a3-97ea-eefbb3463dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:04.742342 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abdfdb-36ab-40a3-97ea-eefbb3463dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:04.742765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abdfdb-36ab-40a3-97ea-eefbb3463dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:04.743766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abdfdb-36ab-40a3-97ea-eefbb3463dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:04.746051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abdfdb-36ab-40a3-97ea-eefbb3463dd8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:04.844202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 801/1583] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:04 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:04.844202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123866d-008c-4bf3-be43-1eb9af5f008a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:04.881796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 783/1584] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:04 2022] POST /identity/v3/users => generated 278 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:04.882832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abdfdb-36ab-40a3-97ea-eefbb3463dd8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:04.897229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:04.903889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abdfdb-36ab-40a3-97ea-eefbb3463dd8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:04.957988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123866d-008c-4bf3-be43-1eb9af5f008a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:04.966532 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58fa0-3598-4601-bbf8-fec7827e7dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:04.967643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58fa0-3598-4601-bbf8-fec7827e7dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:04.968182 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58fa0-3598-4601-bbf8-fec7827e7dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:04.968675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58fa0-3598-4601-bbf8-fec7827e7dfc admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:04.969853 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec58fa0-3598-4601-bbf8-fec7827e7dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:04.974243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec58fa0-3598-4601-bbf8-fec7827e7dfc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.003294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaab09e-0526-44b5-aa84-a4c5e06e1aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.007078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaab09e-0526-44b5-aa84-a4c5e06e1aac admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.007078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaab09e-0526-44b5-aa84-a4c5e06e1aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.007078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaab09e-0526-44b5-aa84-a4c5e06e1aac admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.007078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaab09e-0526-44b5-aa84-a4c5e06e1aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.009552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaab09e-0526-44b5-aa84-a4c5e06e1aac admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.073684 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 802/1585] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:04 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:05.075086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d44004-d206-446a-bbf9-9843d40b1611 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.075437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d44004-d206-446a-bbf9-9843d40b1611 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.075890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d44004-d206-446a-bbf9-9843d40b1611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.115936 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-91d44004-d206-446a-bbf9-9843d40b1611 None None] MFA Rules not processed for user `d7f8f05888a84757a2edc5dad82d7105`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:05.118289 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-91d44004-d206-446a-bbf9-9843d40b1611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:05.119474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 784/1586] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:04 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:05.121054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaab09e-0526-44b5-aa84-a4c5e06e1aac admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.137105 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaab09e-0526-44b5-aa84-a4c5e06e1aac admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.143585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899c0ae-8d4c-4977-a8df-4197962a88e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.144335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899c0ae-8d4c-4977-a8df-4197962a88e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.144697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899c0ae-8d4c-4977-a8df-4197962a88e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.144952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899c0ae-8d4c-4977-a8df-4197962a88e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.145615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899c0ae-8d4c-4977-a8df-4197962a88e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.147278 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899c0ae-8d4c-4977-a8df-4197962a88e5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.169738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 785/1587] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:05.170743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899c0ae-8d4c-4977-a8df-4197962a88e5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.185716 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899c0ae-8d4c-4977-a8df-4197962a88e5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.192179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e0818-a3ca-45e4-8488-6d34b659f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.192984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e0818-a3ca-45e4-8488-6d34b659f1dc admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.193282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e0818-a3ca-45e4-8488-6d34b659f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.193538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e0818-a3ca-45e4-8488-6d34b659f1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.194212 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e0818-a3ca-45e4-8488-6d34b659f1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.196699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e0818-a3ca-45e4-8488-6d34b659f1dc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.212501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 786/1588] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:05.214677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e0818-a3ca-45e4-8488-6d34b659f1dc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.232746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 803/1589] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:05.234339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d44004-d206-446a-bbf9-9843d40b1611 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.242631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e0818-a3ca-45e4-8488-6d34b659f1dc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.250368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d44004-d206-446a-bbf9-9843d40b1611 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.255636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f358e7-c655-480e-902a-7a199ee7638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.256596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f358e7-c655-480e-902a-7a199ee7638d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.264011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5de619-812a-4027-9018-71a83e2f9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.264771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5de619-812a-4027-9018-71a83e2f9708 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.265111 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5de619-812a-4027-9018-71a83e2f9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.265500 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5de619-812a-4027-9018-71a83e2f9708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.266844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5de619-812a-4027-9018-71a83e2f9708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.269964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f358e7-c655-480e-902a-7a199ee7638d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.270259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5de619-812a-4027-9018-71a83e2f9708 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.270380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f358e7-c655-480e-902a-7a199ee7638d admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.271013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f358e7-c655-480e-902a-7a199ee7638d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.273686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f358e7-c655-480e-902a-7a199ee7638d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.290329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 804/1590] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:05.291956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5de619-812a-4027-9018-71a83e2f9708 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.309848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5de619-812a-4027-9018-71a83e2f9708 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.320361 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dec708-32b6-4ce8-bc0c-fd4e7012f3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.321118 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dec708-32b6-4ce8-bc0c-fd4e7012f3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.321871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dec708-32b6-4ce8-bc0c-fd4e7012f3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.322324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dec708-32b6-4ce8-bc0c-fd4e7012f3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.323181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dec708-32b6-4ce8-bc0c-fd4e7012f3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.326583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dec708-32b6-4ce8-bc0c-fd4e7012f3b0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.341666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 805/1591] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:05.343169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dec708-32b6-4ce8-bc0c-fd4e7012f3b0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.360459 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 787/1592] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:05 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:05.362152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f358e7-c655-480e-902a-7a199ee7638d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.370577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dec708-32b6-4ce8-bc0c-fd4e7012f3b0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.377276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f358e7-c655-480e-902a-7a199ee7638d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.381352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d77726-12a0-4b66-bd01-b67a1dbff61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.382993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d77726-12a0-4b66-bd01-b67a1dbff61f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.383632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d77726-12a0-4b66-bd01-b67a1dbff61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.384273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d77726-12a0-4b66-bd01-b67a1dbff61f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.385443 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d77726-12a0-4b66-bd01-b67a1dbff61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.391513 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d77726-12a0-4b66-bd01-b67a1dbff61f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.392202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac144c-d298-4e20-9712-2d5329bdb874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.393407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac144c-d298-4e20-9712-2d5329bdb874 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.394033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac144c-d298-4e20-9712-2d5329bdb874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.394576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac144c-d298-4e20-9712-2d5329bdb874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.395505 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac144c-d298-4e20-9712-2d5329bdb874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.397313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac144c-d298-4e20-9712-2d5329bdb874 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.413062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 788/1593] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:05.415183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac144c-d298-4e20-9712-2d5329bdb874 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.425024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 806/1594] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:05.425024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d77726-12a0-4b66-bd01-b67a1dbff61f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.435474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac144c-d298-4e20-9712-2d5329bdb874 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.441738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d77726-12a0-4b66-bd01-b67a1dbff61f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.444500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2d332-1b72-4266-a33b-726373b44713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.452290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2d332-1b72-4266-a33b-726373b44713 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.452290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2d332-1b72-4266-a33b-726373b44713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.452290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2d332-1b72-4266-a33b-726373b44713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.452290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2d332-1b72-4266-a33b-726373b44713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.452290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2d332-1b72-4266-a33b-726373b44713 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.461918 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac8d67-e7fc-4ea7-b86e-4ba52ce9a79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.462905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac8d67-e7fc-4ea7-b86e-4ba52ce9a79d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.463634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac8d67-e7fc-4ea7-b86e-4ba52ce9a79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.464107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac8d67-e7fc-4ea7-b86e-4ba52ce9a79d admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.465965 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac8d67-e7fc-4ea7-b86e-4ba52ce9a79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.472513 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac8d67-e7fc-4ea7-b86e-4ba52ce9a79d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.484730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 789/1595] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:05.484730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2d332-1b72-4266-a33b-726373b44713 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.495446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2d332-1b72-4266-a33b-726373b44713 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.502435 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299936ea-f5e0-4432-abf4-ecd7fa7e7139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.503166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299936ea-f5e0-4432-abf4-ecd7fa7e7139 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.503449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299936ea-f5e0-4432-abf4-ecd7fa7e7139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.503847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299936ea-f5e0-4432-abf4-ecd7fa7e7139 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.504499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299936ea-f5e0-4432-abf4-ecd7fa7e7139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.506238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299936ea-f5e0-4432-abf4-ecd7fa7e7139 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.520739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 790/1596] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:05.521632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299936ea-f5e0-4432-abf4-ecd7fa7e7139 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.535086 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299936ea-f5e0-4432-abf4-ecd7fa7e7139 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.549284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d8f8d-fee5-494a-a76b-1180aba01fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.550838 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d8f8d-fee5-494a-a76b-1180aba01fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.551060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d8f8d-fee5-494a-a76b-1180aba01fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.551563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d8f8d-fee5-494a-a76b-1180aba01fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.552815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d8f8d-fee5-494a-a76b-1180aba01fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.555956 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d8f8d-fee5-494a-a76b-1180aba01fb2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.582446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 791/1597] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:05.582446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d8f8d-fee5-494a-a76b-1180aba01fb2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.597442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d8f8d-fee5-494a-a76b-1180aba01fb2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.608754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6c6d6-faf5-45a7-bc0c-b756402f2837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.614348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6c6d6-faf5-45a7-bc0c-b756402f2837 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.614348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6c6d6-faf5-45a7-bc0c-b756402f2837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.614348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6c6d6-faf5-45a7-bc0c-b756402f2837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.614348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6c6d6-faf5-45a7-bc0c-b756402f2837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.616515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6c6d6-faf5-45a7-bc0c-b756402f2837 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.620763 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 807/1598] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:05 2022] POST /identity/v3/projects => generated 405 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:05.621633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac8d67-e7fc-4ea7-b86e-4ba52ce9a79d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.639771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:05.650786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 792/1599] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:05.657506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6c6d6-faf5-45a7-bc0c-b756402f2837 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.665817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6c6d6-faf5-45a7-bc0c-b756402f2837 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.763754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac8d67-e7fc-4ea7-b86e-4ba52ce9a79d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.781180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cec54-a53e-4b2a-bad1-5bc2d80df053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.784794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cec54-a53e-4b2a-bad1-5bc2d80df053 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.787287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cec54-a53e-4b2a-bad1-5bc2d80df053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.788009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cec54-a53e-4b2a-bad1-5bc2d80df053 admin admin] PATH_INFO: `/v3/projects/4f42a72f14ba4b11b4be37a1b96fb363/users/ee78e3616d234c06baded38da42da0ee/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.791634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131be6-0be3-4bf7-a922-eaa62989b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.792991 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131be6-0be3-4bf7-a922-eaa62989b2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.793276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131be6-0be3-4bf7-a922-eaa62989b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.793543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131be6-0be3-4bf7-a922-eaa62989b2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.794195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d131be6-0be3-4bf7-a922-eaa62989b2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.796364 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d131be6-0be3-4bf7-a922-eaa62989b2f5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.799626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:05.816183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 793/1600] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:05.817137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131be6-0be3-4bf7-a922-eaa62989b2f5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:05.821721 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cec54-a53e-4b2a-bad1-5bc2d80df053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f42a72f14ba4b11b4be37a1b96fb363, user_id=ee78e3616d234c06baded38da42da0ee, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.824814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cec54-a53e-4b2a-bad1-5bc2d80df053 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.834561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131be6-0be3-4bf7-a922-eaa62989b2f5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:05.844348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15242d7-90f5-401f-8f38-e376edf89c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:05.845750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15242d7-90f5-401f-8f38-e376edf89c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:05.846517 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15242d7-90f5-401f-8f38-e376edf89c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:05.847191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15242d7-90f5-401f-8f38-e376edf89c03 admin admin] PATH_INFO: `/v3/projects/28863afc908d4415ad856f0e067f5d6b/users/5eec554b613142b0a8ec4976501fb45d/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:05.873378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15242d7-90f5-401f-8f38-e376edf89c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28863afc908d4415ad856f0e067f5d6b, user_id=5eec554b613142b0a8ec4976501fb45d, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:05.885316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15242d7-90f5-401f-8f38-e376edf89c03 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:05.988177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 808/1601] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:05 2022] PUT /identity/v3/projects/4f42a72f14ba4b11b4be37a1b96fb363/users/ee78e3616d234c06baded38da42da0ee/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:05.989356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cec54-a53e-4b2a-bad1-5bc2d80df053 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:06.026853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 794/1602] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:05 2022] PUT /identity/v3/projects/28863afc908d4415ad856f0e067f5d6b/users/5eec554b613142b0a8ec4976501fb45d/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:06.034572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15242d7-90f5-401f-8f38-e376edf89c03 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:06.115572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cec54-a53e-4b2a-bad1-5bc2d80df053 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:06.156135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15242d7-90f5-401f-8f38-e376edf89c03 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:06.164661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634bf33-4ceb-4fd6-8006-65c767d66fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:06.165851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634bf33-4ceb-4fd6-8006-65c767d66fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:06.166327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634bf33-4ceb-4fd6-8006-65c767d66fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:06.166854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634bf33-4ceb-4fd6-8006-65c767d66fa7 admin admin] PATH_INFO: `/v3/projects/fcd852bf22744911b64ab11cca4ebda1/users/f6c5024c0fd14f62870d94037b1312c2/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:06.206253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634bf33-4ceb-4fd6-8006-65c767d66fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd852bf22744911b64ab11cca4ebda1, user_id=f6c5024c0fd14f62870d94037b1312c2, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:06.211753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634bf33-4ceb-4fd6-8006-65c767d66fa7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:06.256955 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe91b24-1acc-4281-b2b2-53e2daedf742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:06.258213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe91b24-1acc-4281-b2b2-53e2daedf742 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:06.258835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe91b24-1acc-4281-b2b2-53e2daedf742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:06.259398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe91b24-1acc-4281-b2b2-53e2daedf742 admin admin] PATH_INFO: `/v3/projects/ddac328fbcba440b82eebd902fd2698f/users/3b67cd82b83340418e9629589a4c0644/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:06.300531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe91b24-1acc-4281-b2b2-53e2daedf742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddac328fbcba440b82eebd902fd2698f, user_id=3b67cd82b83340418e9629589a4c0644, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:06.304072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe91b24-1acc-4281-b2b2-53e2daedf742 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:06.497308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 795/1603] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:06 2022] PUT /identity/v3/projects/fcd852bf22744911b64ab11cca4ebda1/users/f6c5024c0fd14f62870d94037b1312c2/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:06.501509 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634bf33-4ceb-4fd6-8006-65c767d66fa7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:06.607977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 809/1604] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:05 2022] PUT /identity/v3/projects/ddac328fbcba440b82eebd902fd2698f/users/3b67cd82b83340418e9629589a4c0644/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:06.607977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe91b24-1acc-4281-b2b2-53e2daedf742 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:06.651571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634bf33-4ceb-4fd6-8006-65c767d66fa7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:06.698188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:06.827279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe91b24-1acc-4281-b2b2-53e2daedf742 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:06.840520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cca839-4f24-47f5-a1ce-2bd3c9224d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:06.841371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dc03a-7c68-4af7-9742-deab62f1b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:06.842563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cca839-4f24-47f5-a1ce-2bd3c9224d54 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:06.842745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dc03a-7c68-4af7-9742-deab62f1b059 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:06.843036 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dc03a-7c68-4af7-9742-deab62f1b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:06.843336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dc03a-7c68-4af7-9742-deab62f1b059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:06.843666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cca839-4f24-47f5-a1ce-2bd3c9224d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:06.844153 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cca839-4f24-47f5-a1ce-2bd3c9224d54 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:06.844261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dc03a-7c68-4af7-9742-deab62f1b059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:06.845090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cca839-4f24-47f5-a1ce-2bd3c9224d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:06.846741 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dc03a-7c68-4af7-9742-deab62f1b059 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:06.850187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cca839-4f24-47f5-a1ce-2bd3c9224d54 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:06.867470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:06.870001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 810/1605] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:06.871376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dc03a-7c68-4af7-9742-deab62f1b059 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:06.890235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dc03a-7c68-4af7-9742-deab62f1b059 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:06.898186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff9177-c397-45c0-8ae0-b3ba423237d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:06.899370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9177-c397-45c0-8ae0-b3ba423237d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:06.899795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9177-c397-45c0-8ae0-b3ba423237d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:06.900126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9177-c397-45c0-8ae0-b3ba423237d3 admin admin] PATH_INFO: `/v3/projects/8c9b9a4f5ddb477da493acd905e9bee1/users/ae1db5003ba24c71a7a68c68a74c7197/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:06.922486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff9177-c397-45c0-8ae0-b3ba423237d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9b9a4f5ddb477da493acd905e9bee1, user_id=ae1db5003ba24c71a7a68c68a74c7197, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:06.925865 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff9177-c397-45c0-8ae0-b3ba423237d3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:07.146206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 811/1606] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:06 2022] PUT /identity/v3/projects/8c9b9a4f5ddb477da493acd905e9bee1/users/ae1db5003ba24c71a7a68c68a74c7197/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:07.147312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd7b1a-c379-4d34-9a28-945c71f9a1ea None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:07.147843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd7b1a-c379-4d34-9a28-945c71f9a1ea None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:07.148138 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd7b1a-c379-4d34-9a28-945c71f9a1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:07.153995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 796/1607] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:06 2022] POST /identity/v3/users => generated 309 bytes in 656 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:07.155468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a181cb9-392f-42e0-9ee1-e33ba56b12a5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:07.155857 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a181cb9-392f-42e0-9ee1-e33ba56b12a5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:07.156297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a181cb9-392f-42e0-9ee1-e33ba56b12a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:07.189863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5a181cb9-392f-42e0-9ee1-e33ba56b12a5 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:07.191964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5a181cb9-392f-42e0-9ee1-e33ba56b12a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:07.197123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-80dd7b1a-c379-4d34-9a28-945c71f9a1ea None None] MFA Rules not processed for user `ee78e3616d234c06baded38da42da0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:07.199333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-80dd7b1a-c379-4d34-9a28-945c71f9a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:07.287262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 797/1608] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:07.288537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125d4e-a387-4ee6-8126-5ad8e7523431 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:07.288822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125d4e-a387-4ee6-8126-5ad8e7523431 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:07.289092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125d4e-a387-4ee6-8126-5ad8e7523431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:07.333410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 812/1609] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:07.334870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8bb2a-1bbf-4e0c-bf2d-03be1c7cb44f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:07.335158 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8bb2a-1bbf-4e0c-bf2d-03be1c7cb44f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:07.335526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8bb2a-1bbf-4e0c-bf2d-03be1c7cb44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:07.340299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f2125d4e-a387-4ee6-8126-5ad8e7523431 None None] MFA Rules not processed for user `f6c5024c0fd14f62870d94037b1312c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:07.349379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f2125d4e-a387-4ee6-8126-5ad8e7523431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:07.390512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-88e8bb2a-1bbf-4e0c-bf2d-03be1c7cb44f None None] MFA Rules not processed for user `3b67cd82b83340418e9629589a4c0644`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:07.391831 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-88e8bb2a-1bbf-4e0c-bf2d-03be1c7cb44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:07.482090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 798/1610] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:07.482674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2125d4e-a387-4ee6-8126-5ad8e7523431 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:07.499521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2125d4e-a387-4ee6-8126-5ad8e7523431 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:07.506111 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb251fea-a19e-4e14-9ab2-2fe9d3593e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:07.507117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb251fea-a19e-4e14-9ab2-2fe9d3593e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:07.507587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb251fea-a19e-4e14-9ab2-2fe9d3593e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:07.508110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb251fea-a19e-4e14-9ab2-2fe9d3593e18 admin admin] PATH_INFO: `/v3/projects/e7e05fab39724ad886c25fbd86062339/users/c1e0da5f2891468383a43fd3e1af3d53/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:07.521176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 813/1611] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:07.521176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f65271-8c07-4509-8ee4-61cc8ebc5469 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:07.521176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f65271-8c07-4509-8ee4-61cc8ebc5469 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:07.527159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f65271-8c07-4509-8ee4-61cc8ebc5469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:07.537254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb251fea-a19e-4e14-9ab2-2fe9d3593e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e05fab39724ad886c25fbd86062339, user_id=c1e0da5f2891468383a43fd3e1af3d53, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:07.540742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb251fea-a19e-4e14-9ab2-2fe9d3593e18 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:07.558673 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d3f65271-8c07-4509-8ee4-61cc8ebc5469 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:07.560280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d3f65271-8c07-4509-8ee4-61cc8ebc5469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:07.574116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 814/1612] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:07.575633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f65271-8c07-4509-8ee4-61cc8ebc5469 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:07.592984 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f65271-8c07-4509-8ee4-61cc8ebc5469 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:07.601446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b1eec-7108-497c-87aa-46fc41ec30f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:07.602870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b1eec-7108-497c-87aa-46fc41ec30f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:07.603334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b1eec-7108-497c-87aa-46fc41ec30f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:07.603817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b1eec-7108-497c-87aa-46fc41ec30f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:07.605008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b1eec-7108-497c-87aa-46fc41ec30f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:07.606778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b1eec-7108-497c-87aa-46fc41ec30f5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:07.614747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:07.621676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 815/1613] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:07.632766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b1eec-7108-497c-87aa-46fc41ec30f5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:07.632766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bb0b1eec-7108-497c-87aa-46fc41ec30f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:07.692425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 799/1614] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:07 2022] PUT /identity/v3/projects/e7e05fab39724ad886c25fbd86062339/users/c1e0da5f2891468383a43fd3e1af3d53/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:07.694322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cb592-a1ea-4cd0-ae05-0d4c67621367 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:07.694829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cb592-a1ea-4cd0-ae05-0d4c67621367 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:07.695332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cb592-a1ea-4cd0-ae05-0d4c67621367 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:07.698701 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 800/1615] 10.222.0.91 () {54 vars in 962 bytes} [Wed Aug 24 10:45:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:45:07.700157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cb592-a1ea-4cd0-ae05-0d4c67621367 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:07.726358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b1eec-7108-497c-87aa-46fc41ec30f5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:07.820091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:07.827477 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cb592-a1ea-4cd0-ae05-0d4c67621367 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:07.842559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04dafc-3d04-4e46-8044-694658b8b4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:07.843291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04dafc-3d04-4e46-8044-694658b8b4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:07.843553 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04dafc-3d04-4e46-8044-694658b8b4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:07.843952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04dafc-3d04-4e46-8044-694658b8b4a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:07.844969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04dafc-3d04-4e46-8044-694658b8b4a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:07.847316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5a188-18af-4e51-b1d3-2ee7e7411c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:07.847946 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04dafc-3d04-4e46-8044-694658b8b4a5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:07.849027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5a188-18af-4e51-b1d3-2ee7e7411c4d service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:07.849193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5a188-18af-4e51-b1d3-2ee7e7411c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:07.849853 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5a188-18af-4e51-b1d3-2ee7e7411c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:07.872234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5a188-18af-4e51-b1d3-2ee7e7411c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:07.874885 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5a188-18af-4e51-b1d3-2ee7e7411c4d service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:07.890850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 816/1616] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:07.892838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5a188-18af-4e51-b1d3-2ee7e7411c4d service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:07.910795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5a188-18af-4e51-b1d3-2ee7e7411c4d service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:07.922685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f678da-45d5-4978-bef8-73830201f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:07.923351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f678da-45d5-4978-bef8-73830201f865 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:07.923869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f678da-45d5-4978-bef8-73830201f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:07.924576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f678da-45d5-4978-bef8-73830201f865 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:07.925652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f678da-45d5-4978-bef8-73830201f865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:07.929940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f678da-45d5-4978-bef8-73830201f865 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:07.985824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 801/1617] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:07 2022] POST /identity/v3/projects => generated 393 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:07.986655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04dafc-3d04-4e46-8044-694658b8b4a5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:08.087055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04dafc-3d04-4e46-8044-694658b8b4a5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:08.092806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5715f5-1144-4f82-a2d8-c92deba1bf12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:08.093522 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5715f5-1144-4f82-a2d8-c92deba1bf12 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:08.093911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5715f5-1144-4f82-a2d8-c92deba1bf12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:08.094260 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5715f5-1144-4f82-a2d8-c92deba1bf12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:08.182240 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 817/1618] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:07 2022] POST /identity/v3/projects => generated 357 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:08.182240 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f678da-45d5-4978-bef8-73830201f865 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:08.260581 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5715f5-1144-4f82-a2d8-c92deba1bf12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:08.263530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5715f5-1144-4f82-a2d8-c92deba1bf12 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:08.290930 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 802/1619] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:08.292062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb9ce8-fc9d-4ed8-8704-247c7fcfad5e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:08.292306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb9ce8-fc9d-4ed8-8704-247c7fcfad5e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:08.292572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb9ce8-fc9d-4ed8-8704-247c7fcfad5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:08.335551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f678da-45d5-4978-bef8-73830201f865 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:08.338807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-54eb9ce8-fc9d-4ed8-8704-247c7fcfad5e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:08.339700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-54eb9ce8-fc9d-4ed8-8704-247c7fcfad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:08.347925 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d78aa-332b-407f-b759-d927f35cb266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:08.348906 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d78aa-332b-407f-b759-d927f35cb266 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:08.349215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d78aa-332b-407f-b759-d927f35cb266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:08.349506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d78aa-332b-407f-b759-d927f35cb266 admin admin] PATH_INFO: `/v3/projects/8412233b90d4470ca5e71a317749d10c/users/0f3d2d9bfc524ed5a19bf7e471c228c5/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:08.352722 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 803/1620] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:08.354206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6cd4-35f5-45be-b627-7ff82b65e3cb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:08.354494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6cd4-35f5-45be-b627-7ff82b65e3cb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:08.354770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6cd4-35f5-45be-b627-7ff82b65e3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:08.399001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d78aa-332b-407f-b759-d927f35cb266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8412233b90d4470ca5e71a317749d10c, user_id=0f3d2d9bfc524ed5a19bf7e471c228c5, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:08.405728 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d78aa-332b-407f-b759-d927f35cb266 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:08.442138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-977f6cd4-35f5-45be-b627-7ff82b65e3cb None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:08.444166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-977f6cd4-35f5-45be-b627-7ff82b65e3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:08.573106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 804/1621] 10.222.0.91 () {58 vars in 1059 bytes} [Wed Aug 24 10:45:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:08.574318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6cd4-35f5-45be-b627-7ff82b65e3cb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:08.588034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6cd4-35f5-45be-b627-7ff82b65e3cb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:08.594873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdae76-51f5-4972-825c-aae2d7107892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:08.595880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdae76-51f5-4972-825c-aae2d7107892 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:08.596207 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdae76-51f5-4972-825c-aae2d7107892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:08.596588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdae76-51f5-4972-825c-aae2d7107892 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:08.597340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdae76-51f5-4972-825c-aae2d7107892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:08.599549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdae76-51f5-4972-825c-aae2d7107892 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:08.630149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 818/1622] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:08 2022] PUT /identity/v3/projects/8412233b90d4470ca5e71a317749d10c/users/0f3d2d9bfc524ed5a19bf7e471c228c5/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:08.630793 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d78aa-332b-407f-b759-d927f35cb266 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:08.725428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:08.762836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d78aa-332b-407f-b759-d927f35cb266 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:08.784576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8feb37-2e54-4150-9ca2-438c0d471831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:08.785500 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8feb37-2e54-4150-9ca2-438c0d471831 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:08.785990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8feb37-2e54-4150-9ca2-438c0d471831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:08.786476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8feb37-2e54-4150-9ca2-438c0d471831 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:08.787733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8feb37-2e54-4150-9ca2-438c0d471831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:08.791863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8feb37-2e54-4150-9ca2-438c0d471831 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:08.798150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 805/1623] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:08 2022] POST /identity/v3/users => generated 303 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:08.802741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdae76-51f5-4972-825c-aae2d7107892 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:08.948727 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdae76-51f5-4972-825c-aae2d7107892 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:09.002005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 819/1624] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:08 2022] POST /identity/v3/users => generated 285 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:09.002005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8feb37-2e54-4150-9ca2-438c0d471831 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:09.099213 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:09.102743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fee47-1cb8-454f-8fbb-9ecb1011765f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:09.104072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fee47-1cb8-454f-8fbb-9ecb1011765f service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:09.104932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fee47-1cb8-454f-8fbb-9ecb1011765f service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:09.105094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fee47-1cb8-454f-8fbb-9ecb1011765f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:09.140554 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fee47-1cb8-454f-8fbb-9ecb1011765f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:09.143849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fee47-1cb8-454f-8fbb-9ecb1011765f service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:09.178306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 806/1625] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:09.179500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fee47-1cb8-454f-8fbb-9ecb1011765f service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:09.238148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fee47-1cb8-454f-8fbb-9ecb1011765f service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:09.247270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8feb37-2e54-4150-9ca2-438c0d471831 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:09.261356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37ee1c-b298-49d5-8da5-5956a954bb56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:09.263502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7567fa-c8ab-4b40-a6a2-6d991926df80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:09.264413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37ee1c-b298-49d5-8da5-5956a954bb56 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:09.264621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7567fa-c8ab-4b40-a6a2-6d991926df80 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:09.264876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7567fa-c8ab-4b40-a6a2-6d991926df80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:09.265046 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37ee1c-b298-49d5-8da5-5956a954bb56 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:09.265325 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37ee1c-b298-49d5-8da5-5956a954bb56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:09.265493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7567fa-c8ab-4b40-a6a2-6d991926df80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:09.266541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7567fa-c8ab-4b40-a6a2-6d991926df80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:09.277451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7567fa-c8ab-4b40-a6a2-6d991926df80 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:09.342447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 807/1626] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:09.343857 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7567fa-c8ab-4b40-a6a2-6d991926df80 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:09.413483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7567fa-c8ab-4b40-a6a2-6d991926df80 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:09.418741 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37ee1c-b298-49d5-8da5-5956a954bb56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:09.421537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37ee1c-b298-49d5-8da5-5956a954bb56 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:09.434510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 820/1627] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:09.436455 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37ee1c-b298-49d5-8da5-5956a954bb56 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:09.449426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892410a-5b84-4ac8-affd-e61419f70354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:09.450050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892410a-5b84-4ac8-affd-e61419f70354 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:09.450315 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892410a-5b84-4ac8-affd-e61419f70354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:09.450605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892410a-5b84-4ac8-affd-e61419f70354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:09.451228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892410a-5b84-4ac8-affd-e61419f70354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:09.453297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892410a-5b84-4ac8-affd-e61419f70354 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:09.478465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37ee1c-b298-49d5-8da5-5956a954bb56 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:09.489823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8ca0a-3f79-44b8-8e70-ced5d7b08247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:09.490770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8ca0a-3f79-44b8-8e70-ced5d7b08247 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:09.491249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8ca0a-3f79-44b8-8e70-ced5d7b08247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:09.491694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8ca0a-3f79-44b8-8e70-ced5d7b08247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:09.492574 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8ca0a-3f79-44b8-8e70-ced5d7b08247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:09.495456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8ca0a-3f79-44b8-8e70-ced5d7b08247 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:09.508487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 808/1628] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:09.510280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892410a-5b84-4ac8-affd-e61419f70354 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:09.525404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 821/1629] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:09.527449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8ca0a-3f79-44b8-8e70-ced5d7b08247 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:09.543194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8ca0a-3f79-44b8-8e70-ced5d7b08247 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:09.552694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892410a-5b84-4ac8-affd-e61419f70354 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:09.553823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b49ecf-45c2-47d6-ab95-bfc1a854c55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:09.555607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b49ecf-45c2-47d6-ab95-bfc1a854c55f admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:09.556311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b49ecf-45c2-47d6-ab95-bfc1a854c55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:09.557041 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b49ecf-45c2-47d6-ab95-bfc1a854c55f admin admin] PATH_INFO: `/v3/projects/860ca9285daa495fa9813af1e2861262/users/5ab31b3bb8cb4af0a2410020225773af/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:09.584027 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b4a5-ca36-41af-970a-723769aef8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:09.585118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b4a5-ca36-41af-970a-723769aef8c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:09.585390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b4a5-ca36-41af-970a-723769aef8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:09.585707 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b4a5-ca36-41af-970a-723769aef8c4 admin admin] PATH_INFO: `/v3/projects/8412233b90d4470ca5e71a317749d10c/users/0f3d2d9bfc524ed5a19bf7e471c228c5/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:09.597295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7b4a5-ca36-41af-970a-723769aef8c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8412233b90d4470ca5e71a317749d10c, user_id=0f3d2d9bfc524ed5a19bf7e471c228c5, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:09.602131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b49ecf-45c2-47d6-ab95-bfc1a854c55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=860ca9285daa495fa9813af1e2861262, user_id=5ab31b3bb8cb4af0a2410020225773af, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:09.612317 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7b4a5-ca36-41af-970a-723769aef8c4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:09.619523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b49ecf-45c2-47d6-ab95-bfc1a854c55f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:09.653631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 809/1630] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:09 2022] PUT /identity/v3/projects/8412233b90d4470ca5e71a317749d10c/users/0f3d2d9bfc524ed5a19bf7e471c228c5/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:09.658129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b4a5-ca36-41af-970a-723769aef8c4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:09.806901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 822/1631] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:09 2022] PUT /identity/v3/projects/860ca9285daa495fa9813af1e2861262/users/5ab31b3bb8cb4af0a2410020225773af/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:09.811481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45077909-f70f-4f2b-892c-b817c82fbfd4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:09.813409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45077909-f70f-4f2b-892c-b817c82fbfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:09.815530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45077909-f70f-4f2b-892c-b817c82fbfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:09.854843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b4a5-ca36-41af-970a-723769aef8c4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:09.948649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-45077909-f70f-4f2b-892c-b817c82fbfd4 None None] MFA Rules not processed for user `0f3d2d9bfc524ed5a19bf7e471c228c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:09.956481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-45077909-f70f-4f2b-892c-b817c82fbfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:10.043334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:10.045689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2adf6-a416-41f4-9885-e435f5e96f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:10.047825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2adf6-a416-41f4-9885-e435f5e96f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:10.047825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2adf6-a416-41f4-9885-e435f5e96f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:10.047825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2adf6-a416-41f4-9885-e435f5e96f17 admin admin] PATH_INFO: `/v3/projects/208e8edf646b478fa677877ffa6fbc38/users/85cd4703eefb43e4b2cfeed8afd3e93a/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:10.092798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2adf6-a416-41f4-9885-e435f5e96f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208e8edf646b478fa677877ffa6fbc38, user_id=85cd4703eefb43e4b2cfeed8afd3e93a, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:10.101313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2adf6-a416-41f4-9885-e435f5e96f17 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:10.149416 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 823/1632] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:09 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:10.151167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45077909-f70f-4f2b-892c-b817c82fbfd4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:10.168653 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45077909-f70f-4f2b-892c-b817c82fbfd4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:10.177886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f67dca-0a0b-4cfb-b598-4d2a4c160d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:10.185111 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67dca-0a0b-4cfb-b598-4d2a4c160d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:10.185111 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67dca-0a0b-4cfb-b598-4d2a4c160d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:10.185111 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67dca-0a0b-4cfb-b598-4d2a4c160d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:10.648656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f67dca-0a0b-4cfb-b598-4d2a4c160d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:10.648656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f67dca-0a0b-4cfb-b598-4d2a4c160d1f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:10.648656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 824/1633] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:10.648656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4df695-539a-4b4e-930c-89d4364c3abb None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:10.648656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4df695-539a-4b4e-930c-89d4364c3abb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:10.648656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4df695-539a-4b4e-930c-89d4364c3abb None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:10.650644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 810/1634] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:09 2022] PUT /identity/v3/projects/208e8edf646b478fa677877ffa6fbc38/users/85cd4703eefb43e4b2cfeed8afd3e93a/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:10.650644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2adf6-a416-41f4-9885-e435f5e96f17 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:10.651625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 825/1635] 10.222.0.91 () {54 vars in 912 bytes} [Wed Aug 24 10:45:10 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:45:10.651625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4df695-539a-4b4e-930c-89d4364c3abb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:10.652969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2adf6-a416-41f4-9885-e435f5e96f17 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:10.652969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f8811-469d-4e28-82cf-0ebac012290d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:10.652969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f8811-469d-4e28-82cf-0ebac012290d service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:10.652969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f8811-469d-4e28-82cf-0ebac012290d service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:10.654106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f8811-469d-4e28-82cf-0ebac012290d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:10.654650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4df695-539a-4b4e-930c-89d4364c3abb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:10.654650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31695584-1a9d-4a51-8f60-70c0508a31a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:10.654650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31695584-1a9d-4a51-8f60-70c0508a31a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:10.654650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31695584-1a9d-4a51-8f60-70c0508a31a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:10.658156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31695584-1a9d-4a51-8f60-70c0508a31a7 admin admin] PATH_INFO: `/v3/projects/860ca9285daa495fa9813af1e2861262/users/5ab31b3bb8cb4af0a2410020225773af/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:10.658156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31695584-1a9d-4a51-8f60-70c0508a31a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860ca9285daa495fa9813af1e2861262, user_id=5ab31b3bb8cb4af0a2410020225773af, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:10.658156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31695584-1a9d-4a51-8f60-70c0508a31a7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:10.658156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 826/1636] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:10 2022] PUT /identity/v3/projects/860ca9285daa495fa9813af1e2861262/users/5ab31b3bb8cb4af0a2410020225773af/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:10.658156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31695584-1a9d-4a51-8f60-70c0508a31a7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:10.659246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f8811-469d-4e28-82cf-0ebac012290d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:10.659246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f8811-469d-4e28-82cf-0ebac012290d service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:10.659246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 811/1637] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:10 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:10.659246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ede2a-ddb9-42d0-adf2-94236aedb4cb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:10.659246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ede2a-ddb9-42d0-adf2-94236aedb4cb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:10.659246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ede2a-ddb9-42d0-adf2-94236aedb4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:10.685284 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31695584-1a9d-4a51-8f60-70c0508a31a7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:10.696668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-175ede2a-ddb9-42d0-adf2-94236aedb4cb None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:10.699630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d1169-9b50-4669-847b-eadae6f558ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:10.705682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1169-9b50-4669-847b-eadae6f558ee admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:10.705682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1169-9b50-4669-847b-eadae6f558ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:10.705682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1169-9b50-4669-847b-eadae6f558ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:10.706056 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d1169-9b50-4669-847b-eadae6f558ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:10.707515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-175ede2a-ddb9-42d0-adf2-94236aedb4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:10.709815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d1169-9b50-4669-847b-eadae6f558ee admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:10.733121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 827/1638] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:10.736658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eafee0-808d-4d02-95c4-251520962ceb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:10.736658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eafee0-808d-4d02-95c4-251520962ceb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:10.736973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eafee0-808d-4d02-95c4-251520962ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:10.826502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-38eafee0-808d-4d02-95c4-251520962ceb None None] MFA Rules not processed for user `5ab31b3bb8cb4af0a2410020225773af`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:10.828130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-38eafee0-808d-4d02-95c4-251520962ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:10.932532 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 812/1639] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:45:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:10.933082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ede2a-ddb9-42d0-adf2-94236aedb4cb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:10.970003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ede2a-ddb9-42d0-adf2-94236aedb4cb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:10.986336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644ab83-f230-46c9-831c-752fe8d4ea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:10.987514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644ab83-f230-46c9-831c-752fe8d4ea6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:10.988022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644ab83-f230-46c9-831c-752fe8d4ea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:10.988480 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644ab83-f230-46c9-831c-752fe8d4ea6b admin admin] PATH_INFO: `/v3/projects/208e8edf646b478fa677877ffa6fbc38/users/85cd4703eefb43e4b2cfeed8afd3e93a/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:11.004217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644ab83-f230-46c9-831c-752fe8d4ea6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=208e8edf646b478fa677877ffa6fbc38, user_id=85cd4703eefb43e4b2cfeed8afd3e93a, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:11.007198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644ab83-f230-46c9-831c-752fe8d4ea6b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:11.061461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 828/1640] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:11.063290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 813/1641] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:10 2022] PUT /identity/v3/projects/208e8edf646b478fa677877ffa6fbc38/users/85cd4703eefb43e4b2cfeed8afd3e93a/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:11.064755 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eafee0-808d-4d02-95c4-251520962ceb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:11.087694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5ee6-3023-4923-afec-793aed6db1d1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:11.088262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5ee6-3023-4923-afec-793aed6db1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:11.089543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5ee6-3023-4923-afec-793aed6db1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:11.193133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b18a5ee6-3023-4923-afec-793aed6db1d1 None None] MFA Rules not processed for user `85cd4703eefb43e4b2cfeed8afd3e93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:11.201299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b18a5ee6-3023-4923-afec-793aed6db1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:11.253579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eafee0-808d-4d02-95c4-251520962ceb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:11.345368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eb1b9-6fd4-4e2c-9a3a-54fcf2a6700a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:11.351115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eb1b9-6fd4-4e2c-9a3a-54fcf2a6700a service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:11.351115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eb1b9-6fd4-4e2c-9a3a-54fcf2a6700a service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:11.351115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eb1b9-6fd4-4e2c-9a3a-54fcf2a6700a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:11.370176 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 814/1642] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:11.371412 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5ee6-3023-4923-afec-793aed6db1d1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:11.455261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:11.535667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eb1b9-6fd4-4e2c-9a3a-54fcf2a6700a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:11.539432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eb1b9-6fd4-4e2c-9a3a-54fcf2a6700a service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:11.586225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 829/1643] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:11.590926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eb1b9-6fd4-4e2c-9a3a-54fcf2a6700a service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:11.630952 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eb1b9-6fd4-4e2c-9a3a-54fcf2a6700a service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:11.640026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7545e13-63d4-424c-a37e-7f654b6b37b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:11.641103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545e13-63d4-424c-a37e-7f654b6b37b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:11.641568 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545e13-63d4-424c-a37e-7f654b6b37b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:11.642376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545e13-63d4-424c-a37e-7f654b6b37b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:11.666404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5ee6-3023-4923-afec-793aed6db1d1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:11.688011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:11.689440 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:11.690114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:11.690531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] PATH_INFO: `/v3/users/d7f8f05888a84757a2edc5dad82d7105` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:11.695242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f8f05888a84757a2edc5dad82d7105)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:11.697681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:45:11.697681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 24 10:45:11.697681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: Aug 24 10:45:11.703107 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:11.866084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7545e13-63d4-424c-a37e-7f654b6b37b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:11.870075 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7545e13-63d4-424c-a37e-7f654b6b37b7 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:11.934142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 830/1644] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:11 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:12.114228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f8f05888a84757a2edc5dad82d7105'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:12.117504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f8f05888a84757a2edc5dad82d7105'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:12.174968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7545e13-63d4-424c-a37e-7f654b6b37b7 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:12.201862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7545e13-63d4-424c-a37e-7f654b6b37b7 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:12.203824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f8f05888a84757a2edc5dad82d7105'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:12.204983 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:12.220902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f8f05888a84757a2edc5dad82d7105'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:12.221657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f8f05888a84757a2edc5dad82d7105'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:12.239084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb18a1a-eb35-4d56-ae53-068d0896d25e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:12.243980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb18a1a-eb35-4d56-ae53-068d0896d25e service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:12.244477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb18a1a-eb35-4d56-ae53-068d0896d25e service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:12.244824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb18a1a-eb35-4d56-ae53-068d0896d25e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:12.249791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dbb18a1a-eb35-4d56-ae53-068d0896d25e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:12.288532 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb18a1a-eb35-4d56-ae53-068d0896d25e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:12.294078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb18a1a-eb35-4d56-ae53-068d0896d25e service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:12.324978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 831/1645] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:12.368482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 815/1646] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:11 2022] DELETE /identity/v3/users/d7f8f05888a84757a2edc5dad82d7105 => generated 0 bytes in 993 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:12.372177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf3bf5-076a-4a77-a60a-59ded4e347bd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:12.373375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf3bf5-076a-4a77-a60a-59ded4e347bd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:12.373845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf3bf5-076a-4a77-a60a-59ded4e347bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:12.472063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6ccf3bf5-076a-4a77-a60a-59ded4e347bd None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:12.478218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6ccf3bf5-076a-4a77-a60a-59ded4e347bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:12.542515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:12.546697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:12.647978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 832/1647] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:12.692735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf3bf5-076a-4a77-a60a-59ded4e347bd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:12.696991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6ccf3bf5-076a-4a77-a60a-59ded4e347bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:12.701844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8d97e-5dc7-4b57-b19f-64027261ab5d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:12.713705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0ac4b-f90a-4c04-b692-f631bd422f62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:12.714896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0ac4b-f90a-4c04-b692-f631bd422f62 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:12.715851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0ac4b-f90a-4c04-b692-f631bd422f62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:12.716727 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0ac4b-f90a-4c04-b692-f631bd422f62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:12.721117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-aac0ac4b-f90a-4c04-b692-f631bd422f62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:12.826279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:12.893685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0ac4b-f90a-4c04-b692-f631bd422f62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:12.895434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0ac4b-f90a-4c04-b692-f631bd422f62 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:12.925006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 816/1648] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:12.957232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf3bf5-076a-4a77-a60a-59ded4e347bd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:12.967516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455aade-8622-4852-84bb-da9ac17c9340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:12.968271 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455aade-8622-4852-84bb-da9ac17c9340 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:12.970020 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455aade-8622-4852-84bb-da9ac17c9340 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:12.970406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455aade-8622-4852-84bb-da9ac17c9340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:13.002024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455aade-8622-4852-84bb-da9ac17c9340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:13.003710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455aade-8622-4852-84bb-da9ac17c9340 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:13.028902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 833/1649] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:45:13.622049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:14.260491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:14.268691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0ac4b-f90a-4c04-b692-f631bd422f62 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:14.271656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-aac0ac4b-f90a-4c04-b692-f631bd422f62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:14.400141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0ac4b-f90a-4c04-b692-f631bd422f62 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:14.422397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a9826-f008-445c-bb3c-68a594213739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:14.425753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a9826-f008-445c-bb3c-68a594213739 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:14.429854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a9826-f008-445c-bb3c-68a594213739 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:14.430532 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a9826-f008-445c-bb3c-68a594213739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:14.438688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7a3a9826-f008-445c-bb3c-68a594213739 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:14.672326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a9826-f008-445c-bb3c-68a594213739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:14.676247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a9826-f008-445c-bb3c-68a594213739 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:14.712225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 817/1650] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:15.030298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3d43a-069e-4de3-9d92-60272ff0859d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:15.031176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3d43a-069e-4de3-9d92-60272ff0859d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:15.031590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3d43a-069e-4de3-9d92-60272ff0859d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:15.033856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 834/1651] 10.222.0.91 () {54 vars in 962 bytes} [Wed Aug 24 10:45:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:45:15.042186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bf5ee-1977-4951-8d0c-91e0992c6971 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:15.042557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bf5ee-1977-4951-8d0c-91e0992c6971 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:15.042832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bf5ee-1977-4951-8d0c-91e0992c6971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:15.093404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-376bf5ee-1977-4951-8d0c-91e0992c6971 None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:15.096374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-376bf5ee-1977-4951-8d0c-91e0992c6971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:15.176662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:15.309467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf7394-9588-4df1-866b-b943e8b0e27b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:15.311240 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf7394-9588-4df1-866b-b943e8b0e27b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:15.311634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf7394-9588-4df1-866b-b943e8b0e27b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:15.313310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 835/1652] 10.222.0.91 () {54 vars in 912 bytes} [Wed Aug 24 10:45:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:45:15.323390 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16554f30-d880-4f0b-a946-afee947777bd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:15.325408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16554f30-d880-4f0b-a946-afee947777bd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:15.326111 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16554f30-d880-4f0b-a946-afee947777bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:15.326882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 818/1653] 10.222.0.91 () {58 vars in 1059 bytes} [Wed Aug 24 10:45:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:15.367699 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-16554f30-d880-4f0b-a946-afee947777bd None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:15.369959 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-16554f30-d880-4f0b-a946-afee947777bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:15.424879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 836/1654] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:45:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:15.433101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bf5ee-1977-4951-8d0c-91e0992c6971 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:15.478347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bf5ee-1977-4951-8d0c-91e0992c6971 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:15.494159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a821da-32f4-40f3-96d3-378e3842f067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:15.501771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a821da-32f4-40f3-96d3-378e3842f067 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:15.504074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a821da-32f4-40f3-96d3-378e3842f067 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:15.508647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a821da-32f4-40f3-96d3-378e3842f067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:15.562698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a821da-32f4-40f3-96d3-378e3842f067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:15.568166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a821da-32f4-40f3-96d3-378e3842f067 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:15.602940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 819/1655] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:16.905063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b78462-0cf6-4c4c-9dbe-e6cf108d53db None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:16.906642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b78462-0cf6-4c4c-9dbe-e6cf108d53db None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:16.907087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b78462-0cf6-4c4c-9dbe-e6cf108d53db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:16.991514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-72b78462-0cf6-4c4c-9dbe-e6cf108d53db None None] MFA Rules not processed for user `53775327011e435a8a08edcb90f01db3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:16.993361 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-72b78462-0cf6-4c4c-9dbe-e6cf108d53db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:16.998634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:17.155038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 837/1656] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:17.167534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b7d45-5507-4ea3-bfee-01bc46eaba85 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.168245 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b7d45-5507-4ea3-bfee-01bc46eaba85 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.168245 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b7d45-5507-4ea3-bfee-01bc46eaba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.208910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a94b7d45-5507-4ea3-bfee-01bc46eaba85 None None] MFA Rules not processed for user `53775327011e435a8a08edcb90f01db3`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:17.210123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a94b7d45-5507-4ea3-bfee-01bc46eaba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:17.237334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 820/1657] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:17.248888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b78462-0cf6-4c4c-9dbe-e6cf108d53db None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:17.285769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b78462-0cf6-4c4c-9dbe-e6cf108d53db None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:17.304400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ffce0-627b-49c3-89b0-b85c62b2ee4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:17.308263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ffce0-627b-49c3-89b0-b85c62b2ee4d service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.309095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ffce0-627b-49c3-89b0-b85c62b2ee4d service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.309675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ffce0-627b-49c3-89b0-b85c62b2ee4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.348325 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ffce0-627b-49c3-89b0-b85c62b2ee4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:17.355548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ffce0-627b-49c3-89b0-b85c62b2ee4d service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:17.383862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b7d45-5507-4ea3-bfee-01bc46eaba85 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:17.389096 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 838/1658] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:17.389515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a94b7d45-5507-4ea3-bfee-01bc46eaba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:17.417037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b7d45-5507-4ea3-bfee-01bc46eaba85 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:17.427042 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:17.428228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.428699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.437810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] PATH_INFO: `/v3/projects/1d6b610525a24e00a48df67a3d5c4273` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.437810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6b610525a24e00a48df67a3d5c4273)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:17.437810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:17.597622 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ffce0-627b-49c3-89b0-b85c62b2ee4d service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:17.599231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5f1ffce0-627b-49c3-89b0-b85c62b2ee4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:17.650487 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ffce0-627b-49c3-89b0-b85c62b2ee4d service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:17.662054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85f54f-e7b9-4617-9abd-5b6c44122b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:17.662054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85f54f-e7b9-4617-9abd-5b6c44122b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.662054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85f54f-e7b9-4617-9abd-5b6c44122b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.662054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85f54f-e7b9-4617-9abd-5b6c44122b9b admin admin] PATH_INFO: `/v3/users/ee78e3616d234c06baded38da42da0ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.664116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85f54f-e7b9-4617-9abd-5b6c44122b9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee78e3616d234c06baded38da42da0ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:17.666855 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85f54f-e7b9-4617-9abd-5b6c44122b9b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:17.762162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6b610525a24e00a48df67a3d5c4273', 'request_id': 'req-bf8f219b-ac08-427b-a16c-3e1025359a14'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:17.785050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6b610525a24e00a48df67a3d5c4273', 'request_id': 'req-bf8f219b-ac08-427b-a16c-3e1025359a14'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:17.929138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6b610525a24e00a48df67a3d5c4273', 'request_id': 'req-bf8f219b-ac08-427b-a16c-3e1025359a14'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:17.952001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] The token cache is being invalidate because project 1d6b610525a24e00a48df67a3d5c4273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:17.952524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:17.955118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:17.957584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 821/1659] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:17 2022] DELETE /identity/v3/projects/1d6b610525a24e00a48df67a3d5c4273 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:45:17.962704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:17.964449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:18.096004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f219b-ac08-427b-a16c-3e1025359a14 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:18.107323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:18.114147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:18.114147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:18.114147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] PATH_INFO: `/v3/users/0f3d2d9bfc524ed5a19bf7e471c228c5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:18.114988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3d2d9bfc524ed5a19bf7e471c228c5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:18.116601 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:18.156797 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:18.204501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ba85f54f-e7b9-4617-9abd-5b6c44122b9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee78e3616d234c06baded38da42da0ee'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:18.277398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ba85f54f-e7b9-4617-9abd-5b6c44122b9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee78e3616d234c06baded38da42da0ee'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:18.477656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ba85f54f-e7b9-4617-9abd-5b6c44122b9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee78e3616d234c06baded38da42da0ee'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:18.479022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ba85f54f-e7b9-4617-9abd-5b6c44122b9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee78e3616d234c06baded38da42da0ee'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:18.480264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ba85f54f-e7b9-4617-9abd-5b6c44122b9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee78e3616d234c06baded38da42da0ee'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:18.510722 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3d2d9bfc524ed5a19bf7e471c228c5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:18.512308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3d2d9bfc524ed5a19bf7e471c228c5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:18.545730 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 839/1660] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:17 2022] DELETE /identity/v3/users/ee78e3616d234c06baded38da42da0ee => generated 0 bytes in 949 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:18.567037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84dc7-5cb2-43f6-8852-671091577b6d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:18.593333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3d2d9bfc524ed5a19bf7e471c228c5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:18.598747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84dc7-5cb2-43f6-8852-671091577b6d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:18.598747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84dc7-5cb2-43f6-8852-671091577b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:18.623749 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3d2d9bfc524ed5a19bf7e471c228c5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:18.624930 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3d2d9bfc524ed5a19bf7e471c228c5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:18.679992 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-72d84dc7-5cb2-43f6-8852-671091577b6d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:18.682856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-72d84dc7-5cb2-43f6-8852-671091577b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:18.745214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 822/1661] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:17 2022] DELETE /identity/v3/users/0f3d2d9bfc524ed5a19bf7e471c228c5 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:18.877539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 840/1662] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:18.922636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:18.926317 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:19.115321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e33631-3c06-45b3-b3d3-5cd6f43d81f5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:19.116160 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e33631-3c06-45b3-b3d3-5cd6f43d81f5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:19.116922 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e33631-3c06-45b3-b3d3-5cd6f43d81f5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:19.120210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 841/1663] 10.222.0.91 () {54 vars in 912 bytes} [Wed Aug 24 10:45:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:45:19.133406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65790dbb-3d26-49ae-aedc-9baa3ef5f4ae None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:19.134046 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65790dbb-3d26-49ae-aedc-9baa3ef5f4ae None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:19.134813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65790dbb-3d26-49ae-aedc-9baa3ef5f4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:19.162733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:19.164532 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5de98-16e4-4d26-8357-caff0789bd75 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:19.184229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eaf40-0d15-4745-9773-fb1d8de3d087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:19.185502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eaf40-0d15-4745-9773-fb1d8de3d087 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:19.185618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eaf40-0d15-4745-9773-fb1d8de3d087 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:19.185993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eaf40-0d15-4745-9773-fb1d8de3d087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:19.247960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-65790dbb-3d26-49ae-aedc-9baa3ef5f4ae None None] MFA Rules not processed for user `8956453f963242a087d2f90d70ed8f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:19.253372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-65790dbb-3d26-49ae-aedc-9baa3ef5f4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:19.278518 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 842/1664] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:45:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:19.376821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eaf40-0d15-4745-9773-fb1d8de3d087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:19.384445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eaf40-0d15-4745-9773-fb1d8de3d087 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:19.414083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 823/1665] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:19.789016 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65790dbb-3d26-49ae-aedc-9baa3ef5f4ae None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:19.825052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65790dbb-3d26-49ae-aedc-9baa3ef5f4ae None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:19.833931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8951dbf-5a37-4f7d-914a-8dc83bdea418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:19.835401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8951dbf-5a37-4f7d-914a-8dc83bdea418 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:19.836567 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8951dbf-5a37-4f7d-914a-8dc83bdea418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:19.837255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8951dbf-5a37-4f7d-914a-8dc83bdea418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:19.866420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8951dbf-5a37-4f7d-914a-8dc83bdea418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:19.872658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8951dbf-5a37-4f7d-914a-8dc83bdea418 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:19.872934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eaf40-0d15-4745-9773-fb1d8de3d087 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:19.875131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-978eaf40-0d15-4745-9773-fb1d8de3d087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:19.889467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 843/1666] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:19.909915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eaf40-0d15-4745-9773-fb1d8de3d087 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:19.929547 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ed92f-9061-49e8-9ff2-54a3a34c0992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:19.931518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ed92f-9061-49e8-9ff2-54a3a34c0992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:19.932232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ed92f-9061-49e8-9ff2-54a3a34c0992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:19.947383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ed92f-9061-49e8-9ff2-54a3a34c0992 admin admin] PATH_INFO: `/v3/projects/8412233b90d4470ca5e71a317749d10c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:19.958869 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ed92f-9061-49e8-9ff2-54a3a34c0992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8412233b90d4470ca5e71a317749d10c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:19.965696 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ed92f-9061-49e8-9ff2-54a3a34c0992 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:20.358507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a96ed92f-9061-49e8-9ff2-54a3a34c0992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8412233b90d4470ca5e71a317749d10c', 'request_id': 'req-a96ed92f-9061-49e8-9ff2-54a3a34c0992'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:20.388686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a96ed92f-9061-49e8-9ff2-54a3a34c0992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8412233b90d4470ca5e71a317749d10c', 'request_id': 'req-a96ed92f-9061-49e8-9ff2-54a3a34c0992'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:20.591079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a96ed92f-9061-49e8-9ff2-54a3a34c0992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8412233b90d4470ca5e71a317749d10c', 'request_id': 'req-a96ed92f-9061-49e8-9ff2-54a3a34c0992'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:20.646658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a96ed92f-9061-49e8-9ff2-54a3a34c0992 admin admin] The token cache is being invalidate because project 8412233b90d4470ca5e71a317749d10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:20.646956 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a96ed92f-9061-49e8-9ff2-54a3a34c0992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:20.650522 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a96ed92f-9061-49e8-9ff2-54a3a34c0992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:20.657583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 824/1667] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:19 2022] DELETE /identity/v3/projects/8412233b90d4470ca5e71a317749d10c => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:20.658442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb85c52-59bc-430a-b5a4-29f5f4fb8dbe None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:20.659226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb85c52-59bc-430a-b5a4-29f5f4fb8dbe None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:20.659676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb85c52-59bc-430a-b5a4-29f5f4fb8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:20.696908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-acb85c52-59bc-430a-b5a4-29f5f4fb8dbe None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:20.707582 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-acb85c52-59bc-430a-b5a4-29f5f4fb8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:20.863492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 844/1668] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:20.867398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754e194-7de4-4339-b285-33e94fe47c49 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:20.868210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754e194-7de4-4339-b285-33e94fe47c49 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:20.870300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754e194-7de4-4339-b285-33e94fe47c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:20.913605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c754e194-7de4-4339-b285-33e94fe47c49 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:20.919508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c754e194-7de4-4339-b285-33e94fe47c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:20.978254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 825/1669] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:20.986520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb85c52-59bc-430a-b5a4-29f5f4fb8dbe None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:21.049579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb85c52-59bc-430a-b5a4-29f5f4fb8dbe None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:21.069402 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c73af8-a054-4cd7-a6d4-e4eeaf9a03cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:21.070046 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c73af8-a054-4cd7-a6d4-e4eeaf9a03cd admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:21.070326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c73af8-a054-4cd7-a6d4-e4eeaf9a03cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:21.070599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c73af8-a054-4cd7-a6d4-e4eeaf9a03cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:21.071398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c73af8-a054-4cd7-a6d4-e4eeaf9a03cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:21.071768 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c73af8-a054-4cd7-a6d4-e4eeaf9a03cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:21.073439 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c73af8-a054-4cd7-a6d4-e4eeaf9a03cd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:21.147829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 845/1670] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:45:21.159932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754e194-7de4-4339-b285-33e94fe47c49 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:21.197420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754e194-7de4-4339-b285-33e94fe47c49 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:21.213326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4894d-260b-491f-b37e-9e93deb12445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:21.216378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4894d-260b-491f-b37e-9e93deb12445 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:21.217841 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4894d-260b-491f-b37e-9e93deb12445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:21.218793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4894d-260b-491f-b37e-9e93deb12445 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:21.221152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4894d-260b-491f-b37e-9e93deb12445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:21.226132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4894d-260b-491f-b37e-9e93deb12445 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:21.816792 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c73af8-a054-4cd7-a6d4-e4eeaf9a03cd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:21.834410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 826/1671] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:21 2022] POST /identity/v3/projects => generated 373 bytes in 660 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:45:21.838985 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c73af8-a054-4cd7-a6d4-e4eeaf9a03cd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:21.966575 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ce10c-3471-4f3d-99d5-f0f148da4935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:21.967587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ce10c-3471-4f3d-99d5-f0f148da4935 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:21.968015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ce10c-3471-4f3d-99d5-f0f148da4935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:21.968439 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ce10c-3471-4f3d-99d5-f0f148da4935 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:21.969466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ce10c-3471-4f3d-99d5-f0f148da4935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:21.973051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ce10c-3471-4f3d-99d5-f0f148da4935 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:22.175536 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4894d-260b-491f-b37e-9e93deb12445 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:22.176492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 846/1672] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:21 2022] POST /identity/v3/users => generated 287 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:22.199015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4894d-260b-491f-b37e-9e93deb12445 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:22.211838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ce10c-3471-4f3d-99d5-f0f148da4935 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:22.214275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9a5ce10c-3471-4f3d-99d5-f0f148da4935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:22.226993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db80b68-4eaa-42d5-9270-7e9765f2f58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:22.227627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db80b68-4eaa-42d5-9270-7e9765f2f58c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:22.227934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db80b68-4eaa-42d5-9270-7e9765f2f58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:22.232480 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db80b68-4eaa-42d5-9270-7e9765f2f58c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:22.233223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db80b68-4eaa-42d5-9270-7e9765f2f58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:22.236871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db80b68-4eaa-42d5-9270-7e9765f2f58c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:22.252295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ce10c-3471-4f3d-99d5-f0f148da4935 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:22.261581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:22.262867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:22.265116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:22.267150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] PATH_INFO: `/v3/projects/4f42a72f14ba4b11b4be37a1b96fb363` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:22.269146 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f42a72f14ba4b11b4be37a1b96fb363)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:22.271680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:45:22.271680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 24 10:45:22.271680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: Aug 24 10:45:22.276373 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:22.300200 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 827/1673] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:22.301171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db80b68-4eaa-42d5-9270-7e9765f2f58c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:22.346660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db80b68-4eaa-42d5-9270-7e9765f2f58c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:22.376853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795e838-a4d1-46b0-8a33-f7ad0aaa4377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:22.377349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795e838-a4d1-46b0-8a33-f7ad0aaa4377 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:22.377806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795e838-a4d1-46b0-8a33-f7ad0aaa4377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:22.378228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795e838-a4d1-46b0-8a33-f7ad0aaa4377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:22.379207 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795e838-a4d1-46b0-8a33-f7ad0aaa4377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:22.384229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795e838-a4d1-46b0-8a33-f7ad0aaa4377 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:22.417573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 828/1674] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:22.431968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795e838-a4d1-46b0-8a33-f7ad0aaa4377 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:22.526983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795e838-a4d1-46b0-8a33-f7ad0aaa4377 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:22.686373 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f42a72f14ba4b11b4be37a1b96fb363', 'request_id': 'req-5030b97d-c348-4525-afea-1c734d42fc31'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:22.738153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f42a72f14ba4b11b4be37a1b96fb363', 'request_id': 'req-5030b97d-c348-4525-afea-1c734d42fc31'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:22.814348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b2fe0-a4c8-4719-a789-b6d0a8d5af7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:22.815483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b2fe0-a4c8-4719-a789-b6d0a8d5af7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:22.828896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b2fe0-a4c8-4719-a789-b6d0a8d5af7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:22.838695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b2fe0-a4c8-4719-a789-b6d0a8d5af7e admin admin] PATH_INFO: `/v3/projects/769d68e93e874bd7a5a6e4fe04da84fc/users/18f49d8b1b8845efbeaba3e6d92c7bae/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:22.878572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b2fe0-a4c8-4719-a789-b6d0a8d5af7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=769d68e93e874bd7a5a6e4fe04da84fc, user_id=18f49d8b1b8845efbeaba3e6d92c7bae, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:22.885658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b2fe0-a4c8-4719-a789-b6d0a8d5af7e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:22.949173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f42a72f14ba4b11b4be37a1b96fb363', 'request_id': 'req-5030b97d-c348-4525-afea-1c734d42fc31'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:22.993514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:23.006137 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] The token cache is being invalidate because project 4f42a72f14ba4b11b4be37a1b96fb363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:23.013412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:23.019121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5030b97d-c348-4525-afea-1c734d42fc31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:23.027291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 847/1675] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:22 2022] DELETE /identity/v3/projects/4f42a72f14ba4b11b4be37a1b96fb363 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:23.033060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa408c-3d84-4aa3-97fe-305479e13da0 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:23.036176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa408c-3d84-4aa3-97fe-305479e13da0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:23.036176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa408c-3d84-4aa3-97fe-305479e13da0 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:23.043001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 848/1676] 10.222.0.91 () {54 vars in 961 bytes} [Wed Aug 24 10:45:23 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:45:23.057972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 829/1677] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:22 2022] PUT /identity/v3/projects/769d68e93e874bd7a5a6e4fe04da84fc/users/18f49d8b1b8845efbeaba3e6d92c7bae/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:23.059232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e44fe7-793e-4bd9-8484-5ee6266a39b3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:23.059670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e44fe7-793e-4bd9-8484-5ee6266a39b3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:23.060147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e44fe7-793e-4bd9-8484-5ee6266a39b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:23.072028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542338-131e-4900-a016-cf67eef2400e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:23.073007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542338-131e-4900-a016-cf67eef2400e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:23.073925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542338-131e-4900-a016-cf67eef2400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:23.155065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d9e44fe7-793e-4bd9-8484-5ee6266a39b3 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:23.157956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d9e44fe7-793e-4bd9-8484-5ee6266a39b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:23.161781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-99542338-131e-4900-a016-cf67eef2400e None None] MFA Rules not processed for user `8ebfb233b2504463a4ee9202b5a3ab50`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:23.174949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-99542338-131e-4900-a016-cf67eef2400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:23.435356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 849/1678] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:23.437131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5bbc7-6af3-47a7-9982-a6ef963cab13 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:23.442993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5bbc7-6af3-47a7-9982-a6ef963cab13 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:23.443507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5bbc7-6af3-47a7-9982-a6ef963cab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:23.525370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 830/1679] 10.222.0.91 () {58 vars in 1058 bytes} [Wed Aug 24 10:45:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 24 10:45:23.529812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12466e3-bffd-4849-9911-7d409db4c0ec None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:23.530099 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12466e3-bffd-4849-9911-7d409db4c0ec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:23.539340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12466e3-bffd-4849-9911-7d409db4c0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:23.540159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-49d5bbc7-6af3-47a7-9982-a6ef963cab13 None None] MFA Rules not processed for user `18f49d8b1b8845efbeaba3e6d92c7bae`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:23.543329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-49d5bbc7-6af3-47a7-9982-a6ef963cab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:23.592934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b12466e3-bffd-4849-9911-7d409db4c0ec None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:23.594164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b12466e3-bffd-4849-9911-7d409db4c0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:23.609381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:23.616376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 831/1680] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:23.617380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12466e3-bffd-4849-9911-7d409db4c0ec None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:23.628020 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b12466e3-bffd-4849-9911-7d409db4c0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:23.667675 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12466e3-bffd-4849-9911-7d409db4c0ec None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:23.681781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:23.682346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:23.682622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:23.682889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] PATH_INFO: `/v3/users/f6c5024c0fd14f62870d94037b1312c2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:23.687926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c5024c0fd14f62870d94037b1312c2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:23.690595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:23.790353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 850/1681] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:23.791243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5bbc7-6af3-47a7-9982-a6ef963cab13 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:23.844285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5bbc7-6af3-47a7-9982-a6ef963cab13 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:23.862472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2952894-ec01-406f-a72e-26cb4aee1ff3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebfb233b2504463a4ee9202b5a3ab50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:23.863182 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952894-ec01-406f-a72e-26cb4aee1ff3 service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:23.863527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952894-ec01-406f-a72e-26cb4aee1ff3 service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:23.863977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952894-ec01-406f-a72e-26cb4aee1ff3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:23.866824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c2952894-ec01-406f-a72e-26cb4aee1ff3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:23.900802 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2952894-ec01-406f-a72e-26cb4aee1ff3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:23.902420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2952894-ec01-406f-a72e-26cb4aee1ff3 service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:23.933263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 851/1682] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:23.934708 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2952894-ec01-406f-a72e-26cb4aee1ff3 service placement] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:23.968742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2952894-ec01-406f-a72e-26cb4aee1ff3 service placement] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:23.979774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff93cd3-986e-4d88-a3cf-8699c1c34996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:23.980851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff93cd3-986e-4d88-a3cf-8699c1c34996 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:23.981269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff93cd3-986e-4d88-a3cf-8699c1c34996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:23.981546 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff93cd3-986e-4d88-a3cf-8699c1c34996 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:23.982558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff93cd3-986e-4d88-a3cf-8699c1c34996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:23.986584 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff93cd3-986e-4d88-a3cf-8699c1c34996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:23.988466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff93cd3-986e-4d88-a3cf-8699c1c34996 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:24.027763 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 852/1683] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:45:24.041847 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff93cd3-986e-4d88-a3cf-8699c1c34996 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:24.041847 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bff93cd3-986e-4d88-a3cf-8699c1c34996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:24.081729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff93cd3-986e-4d88-a3cf-8699c1c34996 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:24.101806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e1839-aaf3-4b52-87e4-d5e2e41bf421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:24.103647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e1839-aaf3-4b52-87e4-d5e2e41bf421 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:24.104366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e1839-aaf3-4b52-87e4-d5e2e41bf421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:24.105742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e1839-aaf3-4b52-87e4-d5e2e41bf421 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:24.109458 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e1839-aaf3-4b52-87e4-d5e2e41bf421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:24.116464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e1839-aaf3-4b52-87e4-d5e2e41bf421 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:24.121336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c5024c0fd14f62870d94037b1312c2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:24.123589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c5024c0fd14f62870d94037b1312c2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:24.178107 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c5024c0fd14f62870d94037b1312c2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:24.197100 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c5024c0fd14f62870d94037b1312c2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:24.199220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c5024c0fd14f62870d94037b1312c2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:24.285856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 853/1684] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:24 2022] POST /identity/v3/projects => generated 371 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:24.288262 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e1839-aaf3-4b52-87e4-d5e2e41bf421 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:24.300584 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-418e1839-aaf3-4b52-87e4-d5e2e41bf421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:24.325674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 832/1685] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:23 2022] DELETE /identity/v3/users/f6c5024c0fd14f62870d94037b1312c2 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:24.326840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:24.330527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:24.498480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e1839-aaf3-4b52-87e4-d5e2e41bf421 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:24.558475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922e86-44bb-4e2e-9fd2-c54d9c60fd5c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:24.566404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecd7a9-de36-4462-bd61-c36243625b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:24.567703 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecd7a9-de36-4462-bd61-c36243625b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:24.568273 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecd7a9-de36-4462-bd61-c36243625b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:24.568725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecd7a9-de36-4462-bd61-c36243625b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:24.569950 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecd7a9-de36-4462-bd61-c36243625b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:24.572358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecd7a9-de36-4462-bd61-c36243625b9e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:24.646331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 833/1686] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:24 2022] POST /identity/v3/users => generated 292 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:24.649187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326d136-c4bd-4000-8dbb-e0c5d3b71236 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:24.649187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326d136-c4bd-4000-8dbb-e0c5d3b71236 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:24.649187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326d136-c4bd-4000-8dbb-e0c5d3b71236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:24.658506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf60825-2294-4300-9c6d-2389c15a022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:24.659298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf60825-2294-4300-9c6d-2389c15a022b admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:24.659679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf60825-2294-4300-9c6d-2389c15a022b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:24.660077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf60825-2294-4300-9c6d-2389c15a022b admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:24.660821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf60825-2294-4300-9c6d-2389c15a022b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:24.663013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf60825-2294-4300-9c6d-2389c15a022b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:24.700700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8326d136-c4bd-4000-8dbb-e0c5d3b71236 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:24.700700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8326d136-c4bd-4000-8dbb-e0c5d3b71236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:24.721836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 834/1687] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:24.723098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326d136-c4bd-4000-8dbb-e0c5d3b71236 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:24.748462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326d136-c4bd-4000-8dbb-e0c5d3b71236 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:24.762682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9666df4-eec5-44ee-9fba-f657f421d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:24.763770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9666df4-eec5-44ee-9fba-f657f421d12b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:24.764278 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9666df4-eec5-44ee-9fba-f657f421d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:24.764749 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9666df4-eec5-44ee-9fba-f657f421d12b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:24.765572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9666df4-eec5-44ee-9fba-f657f421d12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:24.771135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9666df4-eec5-44ee-9fba-f657f421d12b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:24.810142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 835/1688] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:24.810142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9666df4-eec5-44ee-9fba-f657f421d12b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:24.810142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e9666df4-eec5-44ee-9fba-f657f421d12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:24.844355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 854/1689] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:24 2022] POST /identity/v3/projects => generated 367 bytes in 557 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:24.846520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf60825-2294-4300-9c6d-2389c15a022b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:24.943776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9666df4-eec5-44ee-9fba-f657f421d12b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:25.013719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:25.058418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf60825-2294-4300-9c6d-2389c15a022b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:25.083386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6902c63-e7c7-4f21-9683-a88fff618ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:25.084929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6902c63-e7c7-4f21-9683-a88fff618ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:25.086676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6902c63-e7c7-4f21-9683-a88fff618ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:25.087325 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6902c63-e7c7-4f21-9683-a88fff618ef7 admin admin] PATH_INFO: `/v3/projects/287b810edf5d487297a8931cc8fa1131/users/5f3c1ddb79f44c2786de52dc7cde5972/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:25.170534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6902c63-e7c7-4f21-9683-a88fff618ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=287b810edf5d487297a8931cc8fa1131, user_id=5f3c1ddb79f44c2786de52dc7cde5972, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:25.170788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6902c63-e7c7-4f21-9683-a88fff618ef7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:25.200257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a73ab9-4ee0-434e-b7a3-892b893b4f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:25.200868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a73ab9-4ee0-434e-b7a3-892b893b4f9e service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:25.201246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a73ab9-4ee0-434e-b7a3-892b893b4f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:25.201618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a73ab9-4ee0-434e-b7a3-892b893b4f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:25.233928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a73ab9-4ee0-434e-b7a3-892b893b4f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:25.238741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a73ab9-4ee0-434e-b7a3-892b893b4f9e service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:25.312793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 836/1690] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:25.314113 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 855/1691] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:24 2022] PUT /identity/v3/projects/287b810edf5d487297a8931cc8fa1131/users/5f3c1ddb79f44c2786de52dc7cde5972/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:25.317954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a73ab9-4ee0-434e-b7a3-892b893b4f9e service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:25.323844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6902c63-e7c7-4f21-9683-a88fff618ef7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:25.357346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a73ab9-4ee0-434e-b7a3-892b893b4f9e service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:25.539468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa259d-512c-4908-b3bc-22a10a30d72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:25.540328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa259d-512c-4908-b3bc-22a10a30d72d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:25.540709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa259d-512c-4908-b3bc-22a10a30d72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:25.541103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa259d-512c-4908-b3bc-22a10a30d72d admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:25.541819 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa259d-512c-4908-b3bc-22a10a30d72d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:25.549201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6902c63-e7c7-4f21-9683-a88fff618ef7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:25.549780 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa259d-512c-4908-b3bc-22a10a30d72d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:25.557651 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe035e2c-1355-409a-aed2-2b5b44a6c4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:25.558610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035e2c-1355-409a-aed2-2b5b44a6c4ca admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:25.558976 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035e2c-1355-409a-aed2-2b5b44a6c4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:25.559359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035e2c-1355-409a-aed2-2b5b44a6c4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:25.560298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe035e2c-1355-409a-aed2-2b5b44a6c4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:25.562765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe035e2c-1355-409a-aed2-2b5b44a6c4ca admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:25.575757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 856/1692] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:25.585223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe035e2c-1355-409a-aed2-2b5b44a6c4ca admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:25.598777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe035e2c-1355-409a-aed2-2b5b44a6c4ca admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:25.604239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a39ca-53bc-4872-ab60-40d15f7d8e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:25.605144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a39ca-53bc-4872-ab60-40d15f7d8e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:25.605425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a39ca-53bc-4872-ab60-40d15f7d8e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:25.605697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a39ca-53bc-4872-ab60-40d15f7d8e37 admin admin] PATH_INFO: `/v3/projects/287b810edf5d487297a8931cc8fa1131/users/5f3c1ddb79f44c2786de52dc7cde5972/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:25.607648 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a39ca-53bc-4872-ab60-40d15f7d8e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=287b810edf5d487297a8931cc8fa1131, user_id=5f3c1ddb79f44c2786de52dc7cde5972, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:25.611095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a39ca-53bc-4872-ab60-40d15f7d8e37 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:25.651039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 857/1693] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:25 2022] PUT /identity/v3/projects/287b810edf5d487297a8931cc8fa1131/users/5f3c1ddb79f44c2786de52dc7cde5972/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:25.653924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0d445-b379-4e48-997f-c74b16fa05b7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:25.654408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0d445-b379-4e48-997f-c74b16fa05b7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:25.654815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0d445-b379-4e48-997f-c74b16fa05b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:25.741649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 837/1694] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:25 2022] POST /identity/v3/users => generated 284 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:25.748923 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-58e0d445-b379-4e48-997f-c74b16fa05b7 None None] MFA Rules not processed for user `5f3c1ddb79f44c2786de52dc7cde5972`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:25.752966 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa259d-512c-4908-b3bc-22a10a30d72d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:25.753328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-58e0d445-b379-4e48-997f-c74b16fa05b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:25.784259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa259d-512c-4908-b3bc-22a10a30d72d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:26.014382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:26.029098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcd9de-9ab1-4af3-a5ff-8716aaa8cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:26.030125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcd9de-9ab1-4af3-a5ff-8716aaa8cc30 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:26.030607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcd9de-9ab1-4af3-a5ff-8716aaa8cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:26.031230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcd9de-9ab1-4af3-a5ff-8716aaa8cc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:26.032502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcd9de-9ab1-4af3-a5ff-8716aaa8cc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:26.035498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcd9de-9ab1-4af3-a5ff-8716aaa8cc30 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:26.050495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 858/1695] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:26.062562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0d445-b379-4e48-997f-c74b16fa05b7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:26.066849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-58e0d445-b379-4e48-997f-c74b16fa05b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:26.083005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 838/1696] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:26.084736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcd9de-9ab1-4af3-a5ff-8716aaa8cc30 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:26.112437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcd9de-9ab1-4af3-a5ff-8716aaa8cc30 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:26.132269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30d490-9dd0-4224-b0d9-590fddad9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:26.133172 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30d490-9dd0-4224-b0d9-590fddad9d35 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:26.133584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30d490-9dd0-4224-b0d9-590fddad9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:26.133982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30d490-9dd0-4224-b0d9-590fddad9d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:26.135011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30d490-9dd0-4224-b0d9-590fddad9d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:26.140593 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30d490-9dd0-4224-b0d9-590fddad9d35 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:26.191794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 839/1697] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:45:26.193570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30d490-9dd0-4224-b0d9-590fddad9d35 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:26.230304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30d490-9dd0-4224-b0d9-590fddad9d35 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:26.261562 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81208652-3f17-433e-9377-f9307152adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:26.262502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81208652-3f17-433e-9377-f9307152adde admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:26.262850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81208652-3f17-433e-9377-f9307152adde admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:26.263273 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81208652-3f17-433e-9377-f9307152adde admin admin] PATH_INFO: `/v3/projects/6077f4a2157e44b997e94a31204fc234/users/19ecc86b39b746ac94f4a696b666e5c5/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:26.337552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0d445-b379-4e48-997f-c74b16fa05b7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:26.341312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81208652-3f17-433e-9377-f9307152adde admin admin] RBAC: Authorizing `identity:create_grant(project_id=6077f4a2157e44b997e94a31204fc234, user_id=19ecc86b39b746ac94f4a696b666e5c5, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:26.353936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81208652-3f17-433e-9377-f9307152adde admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:26.368743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652e5b4-1464-4247-8c74-02ee950995f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:26.368743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652e5b4-1464-4247-8c74-02ee950995f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:26.368962 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652e5b4-1464-4247-8c74-02ee950995f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:26.369282 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652e5b4-1464-4247-8c74-02ee950995f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:26.406568 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652e5b4-1464-4247-8c74-02ee950995f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:26.410452 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652e5b4-1464-4247-8c74-02ee950995f6 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:26.438147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 859/1698] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:45:26.500413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 840/1699] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:26 2022] PUT /identity/v3/projects/6077f4a2157e44b997e94a31204fc234/users/19ecc86b39b746ac94f4a696b666e5c5/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:26.512613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50f94f-03c7-47e3-aaf3-0d11d3b3aea3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:26.513070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50f94f-03c7-47e3-aaf3-0d11d3b3aea3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:26.513491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50f94f-03c7-47e3-aaf3-0d11d3b3aea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:26.664721 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-fd50f94f-03c7-47e3-aaf3-0d11d3b3aea3 None None] MFA Rules not processed for user `19ecc86b39b746ac94f4a696b666e5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:26.672365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fd50f94f-03c7-47e3-aaf3-0d11d3b3aea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:26.780695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81208652-3f17-433e-9377-f9307152adde admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:26.868380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 860/1700] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:26.920796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81208652-3f17-433e-9377-f9307152adde admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:26.921664 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50f94f-03c7-47e3-aaf3-0d11d3b3aea3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:26.924509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fd50f94f-03c7-47e3-aaf3-0d11d3b3aea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:26.928111 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb81ec-7bd9-4886-846a-6e2d89be2136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:26.930343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb81ec-7bd9-4886-846a-6e2d89be2136 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:26.930506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb81ec-7bd9-4886-846a-6e2d89be2136 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:26.930682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb81ec-7bd9-4886-846a-6e2d89be2136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:26.937246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-64bb81ec-7bd9-4886-846a-6e2d89be2136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:26.993186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50f94f-03c7-47e3-aaf3-0d11d3b3aea3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:27.001348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7179569-397f-42df-adcd-6de3590c4069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:27.005248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7179569-397f-42df-adcd-6de3590c4069 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:27.008233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7179569-397f-42df-adcd-6de3590c4069 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:27.010828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7179569-397f-42df-adcd-6de3590c4069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:27.060881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7179569-397f-42df-adcd-6de3590c4069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:27.068366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7179569-397f-42df-adcd-6de3590c4069 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:27.071517 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb81ec-7bd9-4886-846a-6e2d89be2136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:27.076070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb81ec-7bd9-4886-846a-6e2d89be2136 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:27.113951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 841/1701] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:45:27.116644 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 861/1702] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:45:27.118403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0378db-518d-4891-af9f-b41fd09f6397 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:27.118705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0378db-518d-4891-af9f-b41fd09f6397 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:27.120459 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0378db-518d-4891-af9f-b41fd09f6397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:27.286923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7a0378db-518d-4891-af9f-b41fd09f6397 None None] MFA Rules not processed for user `5eec554b613142b0a8ec4976501fb45d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:27.294628 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7a0378db-518d-4891-af9f-b41fd09f6397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:27.551885 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 842/1703] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:27.560232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84178f-a316-44b8-b4e9-58d0e7cb57ae None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:27.564660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84178f-a316-44b8-b4e9-58d0e7cb57ae None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:27.565675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84178f-a316-44b8-b4e9-58d0e7cb57ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:27.662042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1b84178f-a316-44b8-b4e9-58d0e7cb57ae None None] MFA Rules not processed for user `5eec554b613142b0a8ec4976501fb45d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:27.670337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1b84178f-a316-44b8-b4e9-58d0e7cb57ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:27.713105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 862/1704] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:27.722544 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0378db-518d-4891-af9f-b41fd09f6397 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:27.733137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7a0378db-518d-4891-af9f-b41fd09f6397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:27.824818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:27.831977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84178f-a316-44b8-b4e9-58d0e7cb57ae None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:27.833731 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1b84178f-a316-44b8-b4e9-58d0e7cb57ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:28.073283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0378db-518d-4891-af9f-b41fd09f6397 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:28.106337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef9bbb-4263-4089-8db3-eadee77334f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:28.107263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef9bbb-4263-4089-8db3-eadee77334f9 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:28.107686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef9bbb-4263-4089-8db3-eadee77334f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:28.108149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef9bbb-4263-4089-8db3-eadee77334f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:28.139157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef9bbb-4263-4089-8db3-eadee77334f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:28.143306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef9bbb-4263-4089-8db3-eadee77334f9 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:28.154239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84178f-a316-44b8-b4e9-58d0e7cb57ae None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:28.180501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 843/1705] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:28.192550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df7f5d-a1ab-4de3-8775-064649be4d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:28.193223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7f5d-a1ab-4de3-8775-064649be4d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:28.193503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7f5d-a1ab-4de3-8775-064649be4d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:28.193776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7f5d-a1ab-4de3-8775-064649be4d60 admin admin] PATH_INFO: `/v3/projects/fcd852bf22744911b64ab11cca4ebda1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:28.202012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7f5d-a1ab-4de3-8775-064649be4d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd852bf22744911b64ab11cca4ebda1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:28.204804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7f5d-a1ab-4de3-8775-064649be4d60 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:28.567212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-21df7f5d-a1ab-4de3-8775-064649be4d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd852bf22744911b64ab11cca4ebda1', 'request_id': 'req-21df7f5d-a1ab-4de3-8775-064649be4d60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:28.601257 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-21df7f5d-a1ab-4de3-8775-064649be4d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd852bf22744911b64ab11cca4ebda1', 'request_id': 'req-21df7f5d-a1ab-4de3-8775-064649be4d60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:28.773648 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-21df7f5d-a1ab-4de3-8775-064649be4d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd852bf22744911b64ab11cca4ebda1', 'request_id': 'req-21df7f5d-a1ab-4de3-8775-064649be4d60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:28.791386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-21df7f5d-a1ab-4de3-8775-064649be4d60 admin admin] The token cache is being invalidate because project fcd852bf22744911b64ab11cca4ebda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:28.794377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-21df7f5d-a1ab-4de3-8775-064649be4d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:28.812986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-21df7f5d-a1ab-4de3-8775-064649be4d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:28.812986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 863/1706] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:27 2022] DELETE /identity/v3/projects/fcd852bf22744911b64ab11cca4ebda1 => generated 0 bytes in 976 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:28.814041 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef9bbb-4263-4089-8db3-eadee77334f9 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:28.828895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef9bbb-4263-4089-8db3-eadee77334f9 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:28.939635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530719-1761-40d4-ac3e-6fc12123dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:28.939635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530719-1761-40d4-ac3e-6fc12123dfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:28.939635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530719-1761-40d4-ac3e-6fc12123dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:28.939635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530719-1761-40d4-ac3e-6fc12123dfc2 admin admin] PATH_INFO: `/v3/users/5ab31b3bb8cb4af0a2410020225773af` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:28.941709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df530719-1761-40d4-ac3e-6fc12123dfc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab31b3bb8cb4af0a2410020225773af)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:28.944649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df530719-1761-40d4-ac3e-6fc12123dfc2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:28.991128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea250d-7adf-4b0f-be3e-a99bc262a6ef None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:28.991422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea250d-7adf-4b0f-be3e-a99bc262a6ef None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:28.992050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea250d-7adf-4b0f-be3e-a99bc262a6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:29.075522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-fbea250d-7adf-4b0f-be3e-a99bc262a6ef None None] MFA Rules not processed for user `ae1db5003ba24c71a7a68c68a74c7197`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:29.088026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fbea250d-7adf-4b0f-be3e-a99bc262a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:29.249351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:29.342175 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-df530719-1761-40d4-ac3e-6fc12123dfc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab31b3bb8cb4af0a2410020225773af'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:29.343160 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-df530719-1761-40d4-ac3e-6fc12123dfc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab31b3bb8cb4af0a2410020225773af'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:29.379133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-df530719-1761-40d4-ac3e-6fc12123dfc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab31b3bb8cb4af0a2410020225773af'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:29.392730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-df530719-1761-40d4-ac3e-6fc12123dfc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab31b3bb8cb4af0a2410020225773af'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:29.394034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-df530719-1761-40d4-ac3e-6fc12123dfc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab31b3bb8cb4af0a2410020225773af'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:29.493611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 864/1707] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:29.514407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 844/1708] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:28 2022] DELETE /identity/v3/users/5ab31b3bb8cb4af0a2410020225773af => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:29.518310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea250d-7adf-4b0f-be3e-a99bc262a6ef None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:29.520640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fbea250d-7adf-4b0f-be3e-a99bc262a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:29.704531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea250d-7adf-4b0f-be3e-a99bc262a6ef None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:29.736600 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18feae8-5993-4818-9718-1d7cc2b7561d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:29.740148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18feae8-5993-4818-9718-1d7cc2b7561d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:29.740148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18feae8-5993-4818-9718-1d7cc2b7561d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:29.740405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 845/1709] 10.222.0.91 () {54 vars in 912 bytes} [Wed Aug 24 10:45:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:45:29.770206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221357-023b-4383-8e7f-6eaa4c7c0351 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:29.771453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221357-023b-4383-8e7f-6eaa4c7c0351 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:29.771453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221357-023b-4383-8e7f-6eaa4c7c0351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:29.873659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8a221357-023b-4383-8e7f-6eaa4c7c0351 None None] MFA Rules not processed for user `8956453f963242a087d2f90d70ed8f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:29.875824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8a221357-023b-4383-8e7f-6eaa4c7c0351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:29.920932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883fa88-4932-4716-bbd2-14204e3f8e27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:29.920932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883fa88-4932-4716-bbd2-14204e3f8e27 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:29.920932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883fa88-4932-4716-bbd2-14204e3f8e27 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:29.920932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883fa88-4932-4716-bbd2-14204e3f8e27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:30.061427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 846/1710] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:45:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:30.081486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221357-023b-4383-8e7f-6eaa4c7c0351 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:30.084503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8a221357-023b-4383-8e7f-6eaa4c7c0351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:30.132660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883fa88-4932-4716-bbd2-14204e3f8e27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:30.140659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221357-023b-4383-8e7f-6eaa4c7c0351 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:30.140822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883fa88-4932-4716-bbd2-14204e3f8e27 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:30.150739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f9ef8-2ad0-4af5-bf89-b5c92b094e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:30.154615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f9ef8-2ad0-4af5-bf89-b5c92b094e2b service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:30.157822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f9ef8-2ad0-4af5-bf89-b5c92b094e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:30.158860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f9ef8-2ad0-4af5-bf89-b5c92b094e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:30.161412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 865/1711] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:30.209837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f9ef8-2ad0-4af5-bf89-b5c92b094e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:30.213312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f9ef8-2ad0-4af5-bf89-b5c92b094e2b service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:30.233239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 847/1712] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:31.047943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497e66-5446-4f4a-8c87-9bf7f2c863c3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:31.049367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497e66-5446-4f4a-8c87-9bf7f2c863c3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:31.050517 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497e66-5446-4f4a-8c87-9bf7f2c863c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:31.256821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-03497e66-5446-4f4a-8c87-9bf7f2c863c3 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:31.258203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-03497e66-5446-4f4a-8c87-9bf7f2c863c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:31.557624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 866/1713] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:45:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:31.897442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42db9f-cf28-4701-a44a-5cfaa6273a83 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:31.897442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42db9f-cf28-4701-a44a-5cfaa6273a83 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:31.897442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42db9f-cf28-4701-a44a-5cfaa6273a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:32.008231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0e42db9f-cf28-4701-a44a-5cfaa6273a83 None None] MFA Rules not processed for user `c1e0da5f2891468383a43fd3e1af3d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:32.008231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0e42db9f-cf28-4701-a44a-5cfaa6273a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:32.150963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497e66-5446-4f4a-8c87-9bf7f2c863c3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:32.150963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-03497e66-5446-4f4a-8c87-9bf7f2c863c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:32.311400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:32.316442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 848/1714] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:32.355817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497e66-5446-4f4a-8c87-9bf7f2c863c3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:32.372103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b3eda-51c9-415a-b7a8-1bbc2b5a0e90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:32.373618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b3eda-51c9-415a-b7a8-1bbc2b5a0e90 service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:32.374212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b3eda-51c9-415a-b7a8-1bbc2b5a0e90 service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:32.374772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b3eda-51c9-415a-b7a8-1bbc2b5a0e90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:32.388173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:32.458444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42db9f-cf28-4701-a44a-5cfaa6273a83 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:32.459676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b3eda-51c9-415a-b7a8-1bbc2b5a0e90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:32.483234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b3eda-51c9-415a-b7a8-1bbc2b5a0e90 service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:32.490580 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42db9f-cf28-4701-a44a-5cfaa6273a83 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:32.505484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380ccf0-e92e-4dfa-b86f-c3e26ababf1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:32.507870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380ccf0-e92e-4dfa-b86f-c3e26ababf1c service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:32.512524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380ccf0-e92e-4dfa-b86f-c3e26ababf1c service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:32.513075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380ccf0-e92e-4dfa-b86f-c3e26ababf1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:32.524771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 867/1715] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:45:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:45:32.526530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b3ef2-e86e-491a-92e6-ec8cbdcc4a3b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:32.533349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b3ef2-e86e-491a-92e6-ec8cbdcc4a3b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:32.533349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b3ef2-e86e-491a-92e6-ec8cbdcc4a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:32.541070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380ccf0-e92e-4dfa-b86f-c3e26ababf1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:32.546345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380ccf0-e92e-4dfa-b86f-c3e26ababf1c service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:32.580411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 849/1716] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:45:32.620397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1f7b3ef2-e86e-491a-92e6-ec8cbdcc4a3b None None] MFA Rules not processed for user `5eec554b613142b0a8ec4976501fb45d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:32.630565 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1f7b3ef2-e86e-491a-92e6-ec8cbdcc4a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:32.644883 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380ccf0-e92e-4dfa-b86f-c3e26ababf1c service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:32.646881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9380ccf0-e92e-4dfa-b86f-c3e26ababf1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:32.973884 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380ccf0-e92e-4dfa-b86f-c3e26ababf1c service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:32.976107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 868/1717] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:33.005247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:33.006234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:33.006863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:33.007471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6 admin admin] PATH_INFO: `/v3/projects/860ca9285daa495fa9813af1e2861262` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:33.011427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=860ca9285daa495fa9813af1e2861262)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:33.019993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:33.377829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860ca9285daa495fa9813af1e2861262', 'request_id': 'req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:33.419356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860ca9285daa495fa9813af1e2861262', 'request_id': 'req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:33.633761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860ca9285daa495fa9813af1e2861262', 'request_id': 'req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:33.691993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6 admin admin] The token cache is being invalidate because project 860ca9285daa495fa9813af1e2861262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:33.692575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:33.695285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9500b40e-3143-43cc-a8b9-9fb7c596e8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:33.702053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 850/1718] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:32 2022] DELETE /identity/v3/projects/860ca9285daa495fa9813af1e2861262 => generated 0 bytes in 1053 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:33.705560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005f54-a65b-47b5-a882-bd6130f0cb0d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:33.706116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005f54-a65b-47b5-a882-bd6130f0cb0d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:33.706759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005f54-a65b-47b5-a882-bd6130f0cb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:33.860510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-30005f54-a65b-47b5-a882-bd6130f0cb0d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:33.872749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-30005f54-a65b-47b5-a882-bd6130f0cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:34.266138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69cded-6c7b-438c-88b7-67c1d0734b86 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:34.267893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69cded-6c7b-438c-88b7-67c1d0734b86 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:34.268367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69cded-6c7b-438c-88b7-67c1d0734b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:34.276929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 869/1719] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:34.308808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2d69cded-6c7b-438c-88b7-67c1d0734b86 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:34.310090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2d69cded-6c7b-438c-88b7-67c1d0734b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:34.362326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 851/1720] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:34.365439 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30005f54-a65b-47b5-a882-bd6130f0cb0d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:34.381096 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30005f54-a65b-47b5-a882-bd6130f0cb0d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:34.405248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19435905-06b6-46ca-aa9b-3ec2e935164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:34.406249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19435905-06b6-46ca-aa9b-3ec2e935164d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:34.406744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19435905-06b6-46ca-aa9b-3ec2e935164d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:34.407229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19435905-06b6-46ca-aa9b-3ec2e935164d admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:34.408484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19435905-06b6-46ca-aa9b-3ec2e935164d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:34.409190 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19435905-06b6-46ca-aa9b-3ec2e935164d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:34.414553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19435905-06b6-46ca-aa9b-3ec2e935164d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:34.459888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 870/1721] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:45:34.465242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69cded-6c7b-438c-88b7-67c1d0734b86 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:34.489727 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69cded-6c7b-438c-88b7-67c1d0734b86 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:34.510776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadedd54-e82e-41c4-9715-3b0cf6decfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:34.511639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadedd54-e82e-41c4-9715-3b0cf6decfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:34.512051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadedd54-e82e-41c4-9715-3b0cf6decfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:34.512414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadedd54-e82e-41c4-9715-3b0cf6decfd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:34.513331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadedd54-e82e-41c4-9715-3b0cf6decfd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:34.529017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadedd54-e82e-41c4-9715-3b0cf6decfd4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:34.835072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 852/1722] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:34 2022] POST /identity/v3/projects => generated 407 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:45:34.841412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19435905-06b6-46ca-aa9b-3ec2e935164d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:34.872420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19435905-06b6-46ca-aa9b-3ec2e935164d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:35.164860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ff978-3346-4073-b550-13e4c6df02fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:35.166416 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ff978-3346-4073-b550-13e4c6df02fa admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:35.168001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ff978-3346-4073-b550-13e4c6df02fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:35.168373 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ff978-3346-4073-b550-13e4c6df02fa admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:35.171998 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ff978-3346-4073-b550-13e4c6df02fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:35.183285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ff978-3346-4073-b550-13e4c6df02fa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:35.424745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 871/1723] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:34 2022] POST /identity/v3/users => generated 304 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:35.432928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadedd54-e82e-41c4-9715-3b0cf6decfd4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:35.451745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadedd54-e82e-41c4-9715-3b0cf6decfd4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:35.477729 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db369ee-41fd-4316-8ff5-dbc5ae2ec67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:35.478487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db369ee-41fd-4316-8ff5-dbc5ae2ec67f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:35.478763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db369ee-41fd-4316-8ff5-dbc5ae2ec67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:35.479270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db369ee-41fd-4316-8ff5-dbc5ae2ec67f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:35.482859 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db369ee-41fd-4316-8ff5-dbc5ae2ec67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:35.489772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db369ee-41fd-4316-8ff5-dbc5ae2ec67f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:35.581240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 853/1724] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:45:35.588835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ff978-3346-4073-b550-13e4c6df02fa admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:35.631407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ff978-3346-4073-b550-13e4c6df02fa admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:35.679157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb32561-5d08-41ad-990e-0ffae22ec527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:35.683820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb32561-5d08-41ad-990e-0ffae22ec527 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:35.692559 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb32561-5d08-41ad-990e-0ffae22ec527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:35.694388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb32561-5d08-41ad-990e-0ffae22ec527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:35.699448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb32561-5d08-41ad-990e-0ffae22ec527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:35.702684 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb32561-5d08-41ad-990e-0ffae22ec527 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:35.777155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 872/1725] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:35.782786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db369ee-41fd-4316-8ff5-dbc5ae2ec67f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:35.817129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db369ee-41fd-4316-8ff5-dbc5ae2ec67f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:35.854538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879dd58-5587-4d48-a169-e57511ef7395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:35.861039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879dd58-5587-4d48-a169-e57511ef7395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:35.861532 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879dd58-5587-4d48-a169-e57511ef7395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:35.862024 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879dd58-5587-4d48-a169-e57511ef7395 admin admin] PATH_INFO: `/v3/projects/9406b239405248c1bd3fea3427d96fc1/users/a049ac2694124b55bd342a74aa3ab559/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:36.000153 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879dd58-5587-4d48-a169-e57511ef7395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9406b239405248c1bd3fea3427d96fc1, user_id=a049ac2694124b55bd342a74aa3ab559, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:36.015198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879dd58-5587-4d48-a169-e57511ef7395 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:36.019496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065d883-965d-4629-aefd-cd8c786a9bc8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:36.020677 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065d883-965d-4629-aefd-cd8c786a9bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:36.021751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065d883-965d-4629-aefd-cd8c786a9bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:36.152340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2065d883-965d-4629-aefd-cd8c786a9bc8 None None] MFA Rules not processed for user `8956453f963242a087d2f90d70ed8f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:36.155489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2065d883-965d-4629-aefd-cd8c786a9bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:36.303798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 854/1726] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:35 2022] PUT /identity/v3/projects/9406b239405248c1bd3fea3427d96fc1/users/a049ac2694124b55bd342a74aa3ab559/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:36.327795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0568415-a846-4506-8e32-907115b5cfdb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:36.332151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0568415-a846-4506-8e32-907115b5cfdb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:36.332151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0568415-a846-4506-8e32-907115b5cfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:36.478022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a0568415-a846-4506-8e32-907115b5cfdb None None] MFA Rules not processed for user `a049ac2694124b55bd342a74aa3ab559`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:36.484448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a0568415-a846-4506-8e32-907115b5cfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:36.599598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 873/1727] 10.222.0.59 () {58 vars in 1015 bytes} [Wed Aug 24 10:45:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 582 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:36.616014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065d883-965d-4629-aefd-cd8c786a9bc8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:36.627365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2065d883-965d-4629-aefd-cd8c786a9bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:36.660388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065d883-965d-4629-aefd-cd8c786a9bc8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:36.852094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 855/1728] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:36 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 526 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:36.860712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0568415-a846-4506-8e32-907115b5cfdb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:36.973656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be46238-86d0-4bc6-8ab7-8bb388033d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:36.974913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be46238-86d0-4bc6-8ab7-8bb388033d1b service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:36.975533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be46238-86d0-4bc6-8ab7-8bb388033d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:36.976180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be46238-86d0-4bc6-8ab7-8bb388033d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:37.018027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be46238-86d0-4bc6-8ab7-8bb388033d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:37.025447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be46238-86d0-4bc6-8ab7-8bb388033d1b service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:37.127854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:37.127854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 874/1729] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:45:37.191413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:37.239043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0568415-a846-4506-8e32-907115b5cfdb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:37.262978 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357102fc-c54b-4f6f-ba98-3371f6e77510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:37.266825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357102fc-c54b-4f6f-ba98-3371f6e77510 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:37.266825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357102fc-c54b-4f6f-ba98-3371f6e77510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:37.266825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357102fc-c54b-4f6f-ba98-3371f6e77510 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:37.272791 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357102fc-c54b-4f6f-ba98-3371f6e77510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:37.277130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357102fc-c54b-4f6f-ba98-3371f6e77510 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:37.860416 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be46238-86d0-4bc6-8ab7-8bb388033d1b service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:37.866215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 856/1730] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:36 2022] POST /identity/v3/projects => generated 407 bytes in 1009 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:37.884653 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be46238-86d0-4bc6-8ab7-8bb388033d1b service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:38.312546 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb03e5-fd4e-494f-9851-e75750f08854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:38.314363 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb03e5-fd4e-494f-9851-e75750f08854 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:38.315366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb03e5-fd4e-494f-9851-e75750f08854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:38.316653 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb03e5-fd4e-494f-9851-e75750f08854 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:38.318290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb03e5-fd4e-494f-9851-e75750f08854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:38.326134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb03e5-fd4e-494f-9851-e75750f08854 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:38.681150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 875/1731] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:37 2022] POST /identity/v3/users => generated 310 bytes in 817 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:38.686942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357102fc-c54b-4f6f-ba98-3371f6e77510 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:38.745038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357102fc-c54b-4f6f-ba98-3371f6e77510 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:38.796844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde7182-febd-4646-81b6-9720cfc1675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:38.799516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde7182-febd-4646-81b6-9720cfc1675e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:38.800466 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde7182-febd-4646-81b6-9720cfc1675e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:38.802189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde7182-febd-4646-81b6-9720cfc1675e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:38.804953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde7182-febd-4646-81b6-9720cfc1675e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:38.809583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde7182-febd-4646-81b6-9720cfc1675e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:38.854119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 857/1732] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:38.959882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb03e5-fd4e-494f-9851-e75750f08854 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:38.974431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb03e5-fd4e-494f-9851-e75750f08854 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:38.992842 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715be40-12ba-49bb-b19d-0c95d8b13ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:38.994059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715be40-12ba-49bb-b19d-0c95d8b13ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:39.008592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715be40-12ba-49bb-b19d-0c95d8b13ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:39.009318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715be40-12ba-49bb-b19d-0c95d8b13ce3 admin admin] PATH_INFO: `/v3/projects/6786dad055c14af59af86a406547bddf/users/f4eb638fe6b247f689b4916a3e30e86a/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:39.058492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715be40-12ba-49bb-b19d-0c95d8b13ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6786dad055c14af59af86a406547bddf, user_id=f4eb638fe6b247f689b4916a3e30e86a, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:39.067959 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715be40-12ba-49bb-b19d-0c95d8b13ce3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:39.343023 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde7182-febd-4646-81b6-9720cfc1675e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:39.345024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 876/1733] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:38 2022] PUT /identity/v3/projects/6786dad055c14af59af86a406547bddf/users/f4eb638fe6b247f689b4916a3e30e86a/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:39.381132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde7182-febd-4646-81b6-9720cfc1675e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:39.626384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a013a-01a3-480f-9bd4-950c7aece5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:39.635349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a013a-01a3-480f-9bd4-950c7aece5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:39.635349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a013a-01a3-480f-9bd4-950c7aece5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:39.635349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a013a-01a3-480f-9bd4-950c7aece5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:39.635349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a013a-01a3-480f-9bd4-950c7aece5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:39.644482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a013a-01a3-480f-9bd4-950c7aece5ab admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:39.664125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 858/1734] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:39.669643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715be40-12ba-49bb-b19d-0c95d8b13ce3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:39.691089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715be40-12ba-49bb-b19d-0c95d8b13ce3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:39.725682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf23e7-73cf-4bf3-912e-6abf26e1e301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:39.728704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf23e7-73cf-4bf3-912e-6abf26e1e301 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:39.730066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf23e7-73cf-4bf3-912e-6abf26e1e301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:39.730649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf23e7-73cf-4bf3-912e-6abf26e1e301 admin admin] PATH_INFO: `/v3/projects/6786dad055c14af59af86a406547bddf/users/f4eb638fe6b247f689b4916a3e30e86a/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:39.748540 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf23e7-73cf-4bf3-912e-6abf26e1e301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6786dad055c14af59af86a406547bddf, user_id=f4eb638fe6b247f689b4916a3e30e86a, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:39.758411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf23e7-73cf-4bf3-912e-6abf26e1e301 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:39.852423 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 877/1735] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:39 2022] PUT /identity/v3/projects/6786dad055c14af59af86a406547bddf/users/f4eb638fe6b247f689b4916a3e30e86a/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:45:39.865844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a883-186f-4e0f-b663-31f152b93ef9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:39.866132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a883-186f-4e0f-b663-31f152b93ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:39.866410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a883-186f-4e0f-b663-31f152b93ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:40.037572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c070a883-186f-4e0f-b663-31f152b93ef9 None None] MFA Rules not processed for user `f4eb638fe6b247f689b4916a3e30e86a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:40.042285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c070a883-186f-4e0f-b663-31f152b93ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:40.503978 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 859/1736] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:39 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 640 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:40.819469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf23e7-73cf-4bf3-912e-6abf26e1e301 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:40.822002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2bbf23e7-73cf-4bf3-912e-6abf26e1e301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:40.997331 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf23e7-73cf-4bf3-912e-6abf26e1e301 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:41.011331 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aa9fc-494e-465c-988b-19e7446886e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:41.012139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aa9fc-494e-465c-988b-19e7446886e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:41.012582 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aa9fc-494e-465c-988b-19e7446886e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:41.013027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aa9fc-494e-465c-988b-19e7446886e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:41.117429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aa9fc-494e-465c-988b-19e7446886e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:41.119468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aa9fc-494e-465c-988b-19e7446886e2 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:41.192441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 878/1737] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:40 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:42.436965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:42.500928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603ed9f-285d-4c59-a88b-b2fdd7472e14 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:42.501437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603ed9f-285d-4c59-a88b-b2fdd7472e14 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:42.502320 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603ed9f-285d-4c59-a88b-b2fdd7472e14 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:42.508801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 860/1738] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:45:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:45:43.031924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24be81e-95f1-4331-9cd4-9da23cd65984 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:43.032897 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24be81e-95f1-4331-9cd4-9da23cd65984 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:43.033539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24be81e-95f1-4331-9cd4-9da23cd65984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:43.148222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603ed9f-285d-4c59-a88b-b2fdd7472e14 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:43.152416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3603ed9f-285d-4c59-a88b-b2fdd7472e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:43.164785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b24be81e-95f1-4331-9cd4-9da23cd65984 None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:43.175010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b24be81e-95f1-4331-9cd4-9da23cd65984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:43.232453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603ed9f-285d-4c59-a88b-b2fdd7472e14 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:43.248472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71edd4-51e5-4372-9b29-cc9a6d3005de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:43.249615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71edd4-51e5-4372-9b29-cc9a6d3005de service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:43.250259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71edd4-51e5-4372-9b29-cc9a6d3005de service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:43.261633 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71edd4-51e5-4372-9b29-cc9a6d3005de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:43.540940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71edd4-51e5-4372-9b29-cc9a6d3005de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:43.542483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71edd4-51e5-4372-9b29-cc9a6d3005de service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:43.612293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 861/1739] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:43 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:43.651024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 879/1740] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:45:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 623 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:44.149052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:45.482216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71edd4-51e5-4372-9b29-cc9a6d3005de service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:45.486894 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4b71edd4-51e5-4372-9b29-cc9a6d3005de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:45.583020 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71edd4-51e5-4372-9b29-cc9a6d3005de service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:45.599388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:45.601224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc22aa0-5859-4bc9-a548-c4a0a53cb455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:45.602137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc22aa0-5859-4bc9-a548-c4a0a53cb455 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:45.604529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc22aa0-5859-4bc9-a548-c4a0a53cb455 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:45.605180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc22aa0-5859-4bc9-a548-c4a0a53cb455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:45.635271 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc22aa0-5859-4bc9-a548-c4a0a53cb455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:45.638766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc22aa0-5859-4bc9-a548-c4a0a53cb455 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:45.676635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 862/1741] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:46.235535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0d66-be94-4229-9348-4d7281b0aa0d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:46.236839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0d66-be94-4229-9348-4d7281b0aa0d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:46.239512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0d66-be94-4229-9348-4d7281b0aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:46.309139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-415d0d66-be94-4229-9348-4d7281b0aa0d None None] MFA Rules not processed for user `c1e0da5f2891468383a43fd3e1af3d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:46.318693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-415d0d66-be94-4229-9348-4d7281b0aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:46.615428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 880/1742] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:47.094059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:47.934053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:48.646677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ee6a1-db54-497e-bf5f-4dc9b1996b9c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:48.647792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ee6a1-db54-497e-bf5f-4dc9b1996b9c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:48.648479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ee6a1-db54-497e-bf5f-4dc9b1996b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:48.773803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5e2ee6a1-db54-497e-bf5f-4dc9b1996b9c None None] MFA Rules not processed for user `ae1db5003ba24c71a7a68c68a74c7197`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:48.776198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5e2ee6a1-db54-497e-bf5f-4dc9b1996b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:49.064414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 863/1743] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:49.513092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6405aac-4721-4ab3-a4b2-46d664ea7cdc None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:49.513092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6405aac-4721-4ab3-a4b2-46d664ea7cdc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:49.513092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6405aac-4721-4ab3-a4b2-46d664ea7cdc None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:49.515365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 881/1744] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:45:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:45:49.749737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f91c8e-f3f2-4d88-bd08-c09d60b83abd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:49.754559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f91c8e-f3f2-4d88-bd08-c09d60b83abd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:49.756130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f91c8e-f3f2-4d88-bd08-c09d60b83abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:49.820926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-42f91c8e-f3f2-4d88-bd08-c09d60b83abd None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:49.823688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-42f91c8e-f3f2-4d88-bd08-c09d60b83abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:49.848869 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 864/1745] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:45:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:50.766512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6405aac-4721-4ab3-a4b2-46d664ea7cdc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:50.769884 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c6405aac-4721-4ab3-a4b2-46d664ea7cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:51.005197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6405aac-4721-4ab3-a4b2-46d664ea7cdc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:51.017428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209d1cf-6487-41dc-8276-7b88b23e8045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:51.018145 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d1cf-6487-41dc-8276-7b88b23e8045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:51.018419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d1cf-6487-41dc-8276-7b88b23e8045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:51.023524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d1cf-6487-41dc-8276-7b88b23e8045 admin admin] PATH_INFO: `/v3/users/19ecc86b39b746ac94f4a696b666e5c5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:51.033067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209d1cf-6487-41dc-8276-7b88b23e8045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ecc86b39b746ac94f4a696b666e5c5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:51.036800 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209d1cf-6487-41dc-8276-7b88b23e8045 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:51.533996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2209d1cf-6487-41dc-8276-7b88b23e8045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ecc86b39b746ac94f4a696b666e5c5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:51.611053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2209d1cf-6487-41dc-8276-7b88b23e8045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ecc86b39b746ac94f4a696b666e5c5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:51.674800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f91c8e-f3f2-4d88-bd08-c09d60b83abd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:51.678012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-42f91c8e-f3f2-4d88-bd08-c09d60b83abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:51.714157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f91c8e-f3f2-4d88-bd08-c09d60b83abd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:51.725181 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0f7d5-2fc1-4e3c-824e-9b4d6fd8ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:51.726530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0f7d5-2fc1-4e3c-824e-9b4d6fd8ccf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:51.727119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0f7d5-2fc1-4e3c-824e-9b4d6fd8ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:51.727767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0f7d5-2fc1-4e3c-824e-9b4d6fd8ccf8 admin admin] PATH_INFO: `/v3/users/3b67cd82b83340418e9629589a4c0644` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:51.730001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0f7d5-2fc1-4e3c-824e-9b4d6fd8ccf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b67cd82b83340418e9629589a4c0644)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:51.735520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0f7d5-2fc1-4e3c-824e-9b4d6fd8ccf8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:51.866076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2209d1cf-6487-41dc-8276-7b88b23e8045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ecc86b39b746ac94f4a696b666e5c5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:51.867674 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2209d1cf-6487-41dc-8276-7b88b23e8045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ecc86b39b746ac94f4a696b666e5c5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:51.868415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2209d1cf-6487-41dc-8276-7b88b23e8045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ecc86b39b746ac94f4a696b666e5c5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:51.970261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 882/1746] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:50 2022] DELETE /identity/v3/users/19ecc86b39b746ac94f4a696b666e5c5 => generated 0 bytes in 1200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:45:51.973931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7821a-4728-4996-abf0-7a0f694c939b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:51.974687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7821a-4728-4996-abf0-7a0f694c939b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:51.975442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7821a-4728-4996-abf0-7a0f694c939b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:52.010012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e4e7821a-4728-4996-abf0-7a0f694c939b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:52.013423 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e4e7821a-4728-4996-abf0-7a0f694c939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:52.152383 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-61d0f7d5-2fc1-4e3c-824e-9b4d6fd8ccf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b67cd82b83340418e9629589a4c0644'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:52.162852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-61d0f7d5-2fc1-4e3c-824e-9b4d6fd8ccf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b67cd82b83340418e9629589a4c0644'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:52.194448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-61d0f7d5-2fc1-4e3c-824e-9b4d6fd8ccf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b67cd82b83340418e9629589a4c0644'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:52.201017 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 883/1747] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:52.224667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-61d0f7d5-2fc1-4e3c-824e-9b4d6fd8ccf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b67cd82b83340418e9629589a4c0644'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:52.225804 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-61d0f7d5-2fc1-4e3c-824e-9b4d6fd8ccf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b67cd82b83340418e9629589a4c0644'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:52.241132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7821a-4728-4996-abf0-7a0f694c939b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:52.243667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e4e7821a-4728-4996-abf0-7a0f694c939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:52.394419 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 865/1748] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:51 2022] DELETE /identity/v3/users/3b67cd82b83340418e9629589a4c0644 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:52.402811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36909745-7924-4886-953e-fa416c21e55f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:52.404688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36909745-7924-4886-953e-fa416c21e55f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:52.406215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36909745-7924-4886-953e-fa416c21e55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:52.432248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7821a-4728-4996-abf0-7a0f694c939b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:52.490215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-36909745-7924-4886-953e-fa416c21e55f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:52.502344 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-36909745-7924-4886-953e-fa416c21e55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:52.505770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:52.633041 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbffd6e-d942-4feb-9bbf-8b014f74904e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:52.633923 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbffd6e-d942-4feb-9bbf-8b014f74904e service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:52.634390 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbffd6e-d942-4feb-9bbf-8b014f74904e service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:52.634839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbffd6e-d942-4feb-9bbf-8b014f74904e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:52.661766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 866/1749] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:52.661766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36909745-7924-4886-953e-fa416c21e55f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:52.662984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-36909745-7924-4886-953e-fa416c21e55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:52.820082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36909745-7924-4886-953e-fa416c21e55f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:52.837986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa70e0d-f9a8-4751-9c3b-d1d13af4915b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:52.838933 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa70e0d-f9a8-4751-9c3b-d1d13af4915b service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:52.839412 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa70e0d-f9a8-4751-9c3b-d1d13af4915b service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:52.839655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa70e0d-f9a8-4751-9c3b-d1d13af4915b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:52.848752 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbffd6e-d942-4feb-9bbf-8b014f74904e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:52.850296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbffd6e-d942-4feb-9bbf-8b014f74904e service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:52.850647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-baa70e0d-f9a8-4751-9c3b-d1d13af4915b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:52.881683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 884/1750] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:52.883675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbffd6e-d942-4feb-9bbf-8b014f74904e service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:52.900203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbffd6e-d942-4feb-9bbf-8b014f74904e service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:52.924503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa70e0d-f9a8-4751-9c3b-d1d13af4915b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:52.933197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa70e0d-f9a8-4751-9c3b-d1d13af4915b service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:52.952477 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:52.953913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ae73c-2388-43e6-b58b-48432daabc56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:52.961155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ae73c-2388-43e6-b58b-48432daabc56 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:52.961673 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ae73c-2388-43e6-b58b-48432daabc56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:52.971335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ae73c-2388-43e6-b58b-48432daabc56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:52.981912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 867/1751] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:53.004303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ae73c-2388-43e6-b58b-48432daabc56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:53.013018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ae73c-2388-43e6-b58b-48432daabc56 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:53.057579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 885/1752] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:54.538928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa70e0d-f9a8-4751-9c3b-d1d13af4915b service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:54.540592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-baa70e0d-f9a8-4751-9c3b-d1d13af4915b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:54.576209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ae73c-2388-43e6-b58b-48432daabc56 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:54.582763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa70e0d-f9a8-4751-9c3b-d1d13af4915b service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:54.587315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-040ae73c-2388-43e6-b58b-48432daabc56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:54.610776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:54.610776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:54.610776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:54.610776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] PATH_INFO: `/v3/projects/ddac328fbcba440b82eebd902fd2698f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:54.611636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddac328fbcba440b82eebd902fd2698f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:54.611636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:54.652942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ae73c-2388-43e6-b58b-48432daabc56 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:54.670995 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5104a-26af-4f49-996a-3794b44aebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:54.672667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5104a-26af-4f49-996a-3794b44aebd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:54.672954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5104a-26af-4f49-996a-3794b44aebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:54.673399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5104a-26af-4f49-996a-3794b44aebd2 admin admin] PATH_INFO: `/v3/projects/6077f4a2157e44b997e94a31204fc234` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:54.675370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5104a-26af-4f49-996a-3794b44aebd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6077f4a2157e44b997e94a31204fc234)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:54.677831 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5104a-26af-4f49-996a-3794b44aebd2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:54.819763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddac328fbcba440b82eebd902fd2698f', 'request_id': 'req-2292c213-e0c8-452b-bff4-bf1a7c8fda66'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:54.827221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddac328fbcba440b82eebd902fd2698f', 'request_id': 'req-2292c213-e0c8-452b-bff4-bf1a7c8fda66'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:54.888103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bee5104a-26af-4f49-996a-3794b44aebd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6077f4a2157e44b997e94a31204fc234', 'request_id': 'req-bee5104a-26af-4f49-996a-3794b44aebd2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:54.908569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bee5104a-26af-4f49-996a-3794b44aebd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6077f4a2157e44b997e94a31204fc234', 'request_id': 'req-bee5104a-26af-4f49-996a-3794b44aebd2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:54.992326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddac328fbcba440b82eebd902fd2698f', 'request_id': 'req-2292c213-e0c8-452b-bff4-bf1a7c8fda66'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:55.018622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] The token cache is being invalidate because project ddac328fbcba440b82eebd902fd2698f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:55.019257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:55.021858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:55.023955 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 868/1753] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:54 2022] DELETE /identity/v3/projects/ddac328fbcba440b82eebd902fd2698f => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:45:55.028555 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:55.031114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:55.065376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bee5104a-26af-4f49-996a-3794b44aebd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6077f4a2157e44b997e94a31204fc234', 'request_id': 'req-bee5104a-26af-4f49-996a-3794b44aebd2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:55.100342 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bee5104a-26af-4f49-996a-3794b44aebd2 admin admin] The token cache is being invalidate because project 6077f4a2157e44b997e94a31204fc234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:55.100628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bee5104a-26af-4f49-996a-3794b44aebd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:55.101534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bee5104a-26af-4f49-996a-3794b44aebd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:55.103369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 886/1754] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:54 2022] DELETE /identity/v3/projects/6077f4a2157e44b997e94a31204fc234 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:55.110613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8144-ffb2-46f1-8c88-6eb86137fec0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:55.111505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8144-ffb2-46f1-8c88-6eb86137fec0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:55.111864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8144-ffb2-46f1-8c88-6eb86137fec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:55.154133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0e2f8144-ffb2-46f1-8c88-6eb86137fec0 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:55.156516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0e2f8144-ffb2-46f1-8c88-6eb86137fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:55.182681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292c213-e0c8-452b-bff4-bf1a7c8fda66 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:55.271913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:55.271913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:55.271913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:55.271913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] PATH_INFO: `/v3/users/85cd4703eefb43e4b2cfeed8afd3e93a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:55.272276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cd4703eefb43e4b2cfeed8afd3e93a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:55.272276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:55.400209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 887/1755] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:55.414122 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435738e-0e5b-4e68-98e5-a5bc0c8a6e90 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:55.432747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435738e-0e5b-4e68-98e5-a5bc0c8a6e90 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:55.432747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435738e-0e5b-4e68-98e5-a5bc0c8a6e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:55.447262 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0435738e-0e5b-4e68-98e5-a5bc0c8a6e90 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:55.449010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0435738e-0e5b-4e68-98e5-a5bc0c8a6e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:55.458847 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 888/1756] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:55.469975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435738e-0e5b-4e68-98e5-a5bc0c8a6e90 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:55.495370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435738e-0e5b-4e68-98e5-a5bc0c8a6e90 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:55.524504 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736703e0-5333-4ac1-a751-701f25b99144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:55.525294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736703e0-5333-4ac1-a751-701f25b99144 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:55.525591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736703e0-5333-4ac1-a751-701f25b99144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:55.525866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736703e0-5333-4ac1-a751-701f25b99144 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:55.526610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736703e0-5333-4ac1-a751-701f25b99144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:55.526913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736703e0-5333-4ac1-a751-701f25b99144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:55.528821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736703e0-5333-4ac1-a751-701f25b99144 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:55.573709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 889/1757] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:45:55.580872 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736703e0-5333-4ac1-a751-701f25b99144 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:55.602401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cd4703eefb43e4b2cfeed8afd3e93a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:55.604524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cd4703eefb43e4b2cfeed8afd3e93a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:55.604928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736703e0-5333-4ac1-a751-701f25b99144 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:55.621689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d119740-556f-439c-9059-63d749f048fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:55.621689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d119740-556f-439c-9059-63d749f048fe admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:55.622131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d119740-556f-439c-9059-63d749f048fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:55.622462 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d119740-556f-439c-9059-63d749f048fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:55.623050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d119740-556f-439c-9059-63d749f048fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:55.630392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d119740-556f-439c-9059-63d749f048fe admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:55.636450 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cd4703eefb43e4b2cfeed8afd3e93a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:55.661195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cd4703eefb43e4b2cfeed8afd3e93a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:55.662556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cd4703eefb43e4b2cfeed8afd3e93a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:55.760673 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 869/1758] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:55 2022] DELETE /identity/v3/users/85cd4703eefb43e4b2cfeed8afd3e93a => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:45:55.828438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 890/1759] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:55 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:55.829259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:55.832039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:56.021725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d0efd-e5a8-413b-8af4-6bee856f1447 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:56.218734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0f3ec-f60f-4d9c-a1f9-be77f0ddccfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:56.220259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0f3ec-f60f-4d9c-a1f9-be77f0ddccfc admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:56.220578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0f3ec-f60f-4d9c-a1f9-be77f0ddccfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:56.220985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0f3ec-f60f-4d9c-a1f9-be77f0ddccfc admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:56.221653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0f3ec-f60f-4d9c-a1f9-be77f0ddccfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:56.225281 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0f3ec-f60f-4d9c-a1f9-be77f0ddccfc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:56.377968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 870/1760] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:55 2022] POST /identity/v3/users => generated 290 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:45:56.383369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d119740-556f-439c-9059-63d749f048fe admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:56.395617 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d119740-556f-439c-9059-63d749f048fe admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:56.401142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41ed2d-b09e-488c-8447-463e8f595b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:56.401875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41ed2d-b09e-488c-8447-463e8f595b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:56.402225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41ed2d-b09e-488c-8447-463e8f595b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:56.403174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41ed2d-b09e-488c-8447-463e8f595b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:56.403353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41ed2d-b09e-488c-8447-463e8f595b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:56.405134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41ed2d-b09e-488c-8447-463e8f595b4e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:56.409852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:56.420113 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 891/1761] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:45:56.426982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0f3ec-f60f-4d9c-a1f9-be77f0ddccfc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:56.454021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0f3ec-f60f-4d9c-a1f9-be77f0ddccfc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:56.462721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeee65-fb41-4481-ad44-5e08bc54f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:56.464609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeee65-fb41-4481-ad44-5e08bc54f81d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:56.464609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeee65-fb41-4481-ad44-5e08bc54f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:56.467552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeee65-fb41-4481-ad44-5e08bc54f81d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:56.467552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeee65-fb41-4481-ad44-5e08bc54f81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:56.469764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeee65-fb41-4481-ad44-5e08bc54f81d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:56.491772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 871/1762] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:56.498966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41ed2d-b09e-488c-8447-463e8f595b4e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:56.516501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41ed2d-b09e-488c-8447-463e8f595b4e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:56.523073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8fdcb-7908-4467-91f6-67b94d881b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:56.524173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8fdcb-7908-4467-91f6-67b94d881b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:56.525182 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8fdcb-7908-4467-91f6-67b94d881b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:56.525670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8fdcb-7908-4467-91f6-67b94d881b6b admin admin] PATH_INFO: `/v3/projects/53402d39595a4e5ca2481fe7cbfcaa8a/users/989615a67c714c7d85ff4771aa202a11/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:56.545680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8fdcb-7908-4467-91f6-67b94d881b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53402d39595a4e5ca2481fe7cbfcaa8a, user_id=989615a67c714c7d85ff4771aa202a11, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:56.550984 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8fdcb-7908-4467-91f6-67b94d881b6b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:56.638169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 892/1763] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:56 2022] PUT /identity/v3/projects/53402d39595a4e5ca2481fe7cbfcaa8a/users/989615a67c714c7d85ff4771aa202a11/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:56.650139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280049c-2cc2-4992-848a-33303c445a2b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:56.650668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280049c-2cc2-4992-848a-33303c445a2b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:56.651079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280049c-2cc2-4992-848a-33303c445a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:56.703450 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c280049c-2cc2-4992-848a-33303c445a2b None None] MFA Rules not processed for user `989615a67c714c7d85ff4771aa202a11`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:56.705111 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c280049c-2cc2-4992-848a-33303c445a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:56.816695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 872/1764] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:56.821636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8fdcb-7908-4467-91f6-67b94d881b6b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:56.976993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8fdcb-7908-4467-91f6-67b94d881b6b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:56.998734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e749-5030-4652-9df7-643373b58688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:57.000744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e749-5030-4652-9df7-643373b58688 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:57.005859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e749-5030-4652-9df7-643373b58688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:57.005859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e749-5030-4652-9df7-643373b58688 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:57.005859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09e749-5030-4652-9df7-643373b58688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:57.005859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09e749-5030-4652-9df7-643373b58688 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:57.020660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280049c-2cc2-4992-848a-33303c445a2b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:57.022490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c280049c-2cc2-4992-848a-33303c445a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:57.067751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280049c-2cc2-4992-848a-33303c445a2b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:57.089973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:57.090639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:57.090958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:57.091188 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] PATH_INFO: `/v3/users/a049ac2694124b55bd342a74aa3ab559` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:57.097029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a049ac2694124b55bd342a74aa3ab559)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:57.113010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:57.154742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 893/1765] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:56 2022] POST /identity/v3/projects => generated 381 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:57.155777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e749-5030-4652-9df7-643373b58688 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:57.161191 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dd09e749-5030-4652-9df7-643373b58688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:57.417130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e749-5030-4652-9df7-643373b58688 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:57.424876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6cedd-35e0-489b-ad38-1f24e5e35ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:57.425591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6cedd-35e0-489b-ad38-1f24e5e35ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:57.426061 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6cedd-35e0-489b-ad38-1f24e5e35ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:57.426342 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6cedd-35e0-489b-ad38-1f24e5e35ab5 admin admin] PATH_INFO: `/v3/projects/208e8edf646b478fa677877ffa6fbc38` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:57.427610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6cedd-35e0-489b-ad38-1f24e5e35ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=208e8edf646b478fa677877ffa6fbc38)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:57.430256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6cedd-35e0-489b-ad38-1f24e5e35ab5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:57.436807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a049ac2694124b55bd342a74aa3ab559'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:57.441351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a049ac2694124b55bd342a74aa3ab559'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:57.518118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a049ac2694124b55bd342a74aa3ab559'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:57.564408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a049ac2694124b55bd342a74aa3ab559'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:57.571766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a049ac2694124b55bd342a74aa3ab559'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:57.632686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-add6cedd-35e0-489b-ad38-1f24e5e35ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208e8edf646b478fa677877ffa6fbc38', 'request_id': 'req-add6cedd-35e0-489b-ad38-1f24e5e35ab5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:57.646145 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-add6cedd-35e0-489b-ad38-1f24e5e35ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208e8edf646b478fa677877ffa6fbc38', 'request_id': 'req-add6cedd-35e0-489b-ad38-1f24e5e35ab5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:57.765412 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 873/1766] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:57 2022] DELETE /identity/v3/users/a049ac2694124b55bd342a74aa3ab559 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:57.768061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:57.774619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:57.878401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-add6cedd-35e0-489b-ad38-1f24e5e35ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208e8edf646b478fa677877ffa6fbc38', 'request_id': 'req-add6cedd-35e0-489b-ad38-1f24e5e35ab5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:57.928612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-add6cedd-35e0-489b-ad38-1f24e5e35ab5 admin admin] The token cache is being invalidate because project 208e8edf646b478fa677877ffa6fbc38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:57.936633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-add6cedd-35e0-489b-ad38-1f24e5e35ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:57.936633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-add6cedd-35e0-489b-ad38-1f24e5e35ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:57.950619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 894/1767] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:57 2022] DELETE /identity/v3/projects/208e8edf646b478fa677877ffa6fbc38 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:57.954329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47347af9-8afa-4dca-b8ae-ec9e9a01226a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:57.955129 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47347af9-8afa-4dca-b8ae-ec9e9a01226a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:57.959010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47347af9-8afa-4dca-b8ae-ec9e9a01226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:58.040758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-47347af9-8afa-4dca-b8ae-ec9e9a01226a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:58.042579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-47347af9-8afa-4dca-b8ae-ec9e9a01226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:58.091418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 895/1768] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:58.094491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d92719-2922-4430-904b-51a65b29af06 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:58.098330 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d92719-2922-4430-904b-51a65b29af06 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:58.098906 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d92719-2922-4430-904b-51a65b29af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:58.147152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77505f05-3f75-4d5c-a4c0-344314cebcdd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:58.152947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c2d92719-2922-4430-904b-51a65b29af06 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:58.163221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c2d92719-2922-4430-904b-51a65b29af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:58.164417 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb122b64-f8ac-4c15-be35-522fdd8feeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:58.165993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb122b64-f8ac-4c15-be35-522fdd8feeff admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:58.166690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb122b64-f8ac-4c15-be35-522fdd8feeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:58.167386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb122b64-f8ac-4c15-be35-522fdd8feeff admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:58.169969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb122b64-f8ac-4c15-be35-522fdd8feeff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:58.175511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb122b64-f8ac-4c15-be35-522fdd8feeff admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:58.181348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 896/1769] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:58.182950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d92719-2922-4430-904b-51a65b29af06 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:58.186403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c2d92719-2922-4430-904b-51a65b29af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:58.214544 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:58.338114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 874/1770] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:57 2022] POST /identity/v3/users => generated 297 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:58.339430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c541a6-502a-4b46-82d2-56effe8f8f92 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:58.339738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c541a6-502a-4b46-82d2-56effe8f8f92 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:58.340073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c541a6-502a-4b46-82d2-56effe8f8f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:58.345791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d92719-2922-4430-904b-51a65b29af06 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:58.366707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426f698-a1f6-49c1-994e-393b1a8500ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:58.367244 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426f698-a1f6-49c1-994e-393b1a8500ac service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:58.367645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426f698-a1f6-49c1-994e-393b1a8500ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:58.368163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426f698-a1f6-49c1-994e-393b1a8500ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:58.390021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426f698-a1f6-49c1-994e-393b1a8500ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:58.392038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426f698-a1f6-49c1-994e-393b1a8500ac service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:58.411860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 897/1771] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:58.412043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-29c541a6-502a-4b46-82d2-56effe8f8f92 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:58.415493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-29c541a6-502a-4b46-82d2-56effe8f8f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:58.424341 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426f698-a1f6-49c1-994e-393b1a8500ac service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:58.433057 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 875/1772] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:58.439206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c541a6-502a-4b46-82d2-56effe8f8f92 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:58.442397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4426f698-a1f6-49c1-994e-393b1a8500ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:58.461351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c541a6-502a-4b46-82d2-56effe8f8f92 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:58.474740 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fd795-5588-49e8-8ed2-5d957d478ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:58.475458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fd795-5588-49e8-8ed2-5d957d478ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:58.475790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fd795-5588-49e8-8ed2-5d957d478ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:58.476851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426f698-a1f6-49c1-994e-393b1a8500ac service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:58.477293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fd795-5588-49e8-8ed2-5d957d478ea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:58.478651 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fd795-5588-49e8-8ed2-5d957d478ea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:58.479152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fd795-5588-49e8-8ed2-5d957d478ea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:58.482756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fd795-5588-49e8-8ed2-5d957d478ea7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:58.490549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47446b13-f3b3-44ea-9d37-3d606933f6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:58.491688 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47446b13-f3b3-44ea-9d37-3d606933f6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:58.492285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47446b13-f3b3-44ea-9d37-3d606933f6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:58.492862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47446b13-f3b3-44ea-9d37-3d606933f6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:58.496700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47446b13-f3b3-44ea-9d37-3d606933f6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:58.500605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47446b13-f3b3-44ea-9d37-3d606933f6f5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:58.503930 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 876/1773] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:45:58.506563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fd795-5588-49e8-8ed2-5d957d478ea7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:58.524088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 898/1774] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:58.526609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47446b13-f3b3-44ea-9d37-3d606933f6f5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:58.527458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fd795-5588-49e8-8ed2-5d957d478ea7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:58.542698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d174f2-892e-4a7b-8843-76b1c14bfd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:58.544398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d174f2-892e-4a7b-8843-76b1c14bfd8e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:58.545290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d174f2-892e-4a7b-8843-76b1c14bfd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:58.546003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d174f2-892e-4a7b-8843-76b1c14bfd8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:58.546153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47446b13-f3b3-44ea-9d37-3d606933f6f5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:58.548132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d174f2-892e-4a7b-8843-76b1c14bfd8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:58.553166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d174f2-892e-4a7b-8843-76b1c14bfd8e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:58.555195 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e7d08-2a15-46f8-9968-a04f26697714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:58.556445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e7d08-2a15-46f8-9968-a04f26697714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:58.557006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e7d08-2a15-46f8-9968-a04f26697714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:58.557620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e7d08-2a15-46f8-9968-a04f26697714 admin admin] PATH_INFO: `/v3/projects/4a52fd0c4da24abb86e6e7e7c955f266/users/547ff43b287b408594e2b91eca19b1c0/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:58.638162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e7d08-2a15-46f8-9968-a04f26697714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a52fd0c4da24abb86e6e7e7c955f266, user_id=547ff43b287b408594e2b91eca19b1c0, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:58.646496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e7d08-2a15-46f8-9968-a04f26697714 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:58.771272 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 899/1775] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:58 2022] PUT /identity/v3/projects/4a52fd0c4da24abb86e6e7e7c955f266/users/547ff43b287b408594e2b91eca19b1c0/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:58.775645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 877/1776] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:58 2022] POST /identity/v3/projects => generated 379 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:45:58.778684 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e7d08-2a15-46f8-9968-a04f26697714 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:58.781776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d174f2-892e-4a7b-8843-76b1c14bfd8e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:58.985004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e7d08-2a15-46f8-9968-a04f26697714 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:58.986085 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d174f2-892e-4a7b-8843-76b1c14bfd8e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:59.002959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387b108-a286-4485-a85e-577fc1fbdfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:59.004079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387b108-a286-4485-a85e-577fc1fbdfe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:59.004648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387b108-a286-4485-a85e-577fc1fbdfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:59.006176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76629958-8459-46c2-8fa2-56fc5f3c11ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:59.006763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387b108-a286-4485-a85e-577fc1fbdfe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:59.007462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387b108-a286-4485-a85e-577fc1fbdfe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:59.009449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76629958-8459-46c2-8fa2-56fc5f3c11ad admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:59.009637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387b108-a286-4485-a85e-577fc1fbdfe1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:59.012692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76629958-8459-46c2-8fa2-56fc5f3c11ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:59.013849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76629958-8459-46c2-8fa2-56fc5f3c11ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:59.018241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76629958-8459-46c2-8fa2-56fc5f3c11ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:59.025180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76629958-8459-46c2-8fa2-56fc5f3c11ad admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:59.063875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 900/1777] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:59.068526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76629958-8459-46c2-8fa2-56fc5f3c11ad admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:59.108280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76629958-8459-46c2-8fa2-56fc5f3c11ad admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:59.125343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 878/1778] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:58 2022] POST /identity/v3/users => generated 290 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:59.127498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387b108-a286-4485-a85e-577fc1fbdfe1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:59.131031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3693c4-c16c-41c5-8c0d-486caf0b6988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:59.136254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3693c4-c16c-41c5-8c0d-486caf0b6988 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:59.137919 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3693c4-c16c-41c5-8c0d-486caf0b6988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:59.140004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3693c4-c16c-41c5-8c0d-486caf0b6988 admin admin] PATH_INFO: `/v3/projects/4a52fd0c4da24abb86e6e7e7c955f266/users/547ff43b287b408594e2b91eca19b1c0/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:59.150029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3693c4-c16c-41c5-8c0d-486caf0b6988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a52fd0c4da24abb86e6e7e7c955f266, user_id=547ff43b287b408594e2b91eca19b1c0, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:59.154650 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387b108-a286-4485-a85e-577fc1fbdfe1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:59.166521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3693c4-c16c-41c5-8c0d-486caf0b6988 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:59.166688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8c5d9-73f7-45cb-a437-80f88b68e904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:59.168900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c5d9-73f7-45cb-a437-80f88b68e904 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:59.169490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c5d9-73f7-45cb-a437-80f88b68e904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:59.170004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c5d9-73f7-45cb-a437-80f88b68e904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:59.171144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8c5d9-73f7-45cb-a437-80f88b68e904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:59.174799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8c5d9-73f7-45cb-a437-80f88b68e904 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:59.202450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 901/1779] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:59 2022] PUT /identity/v3/projects/4a52fd0c4da24abb86e6e7e7c955f266/users/547ff43b287b408594e2b91eca19b1c0/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:45:59.222356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3693c4-c16c-41c5-8c0d-486caf0b6988 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:59.222864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 879/1780] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:59.228378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91168551-aec9-4716-ba58-b42436254fe1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:59.228955 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91168551-aec9-4716-ba58-b42436254fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:59.229358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91168551-aec9-4716-ba58-b42436254fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:59.363148 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:59.367905 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-91168551-aec9-4716-ba58-b42436254fe1 None None] MFA Rules not processed for user `547ff43b287b408594e2b91eca19b1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:59.372832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-91168551-aec9-4716-ba58-b42436254fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:59.444998 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3693c4-c16c-41c5-8c0d-486caf0b6988 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:59.463578 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b0f1f-34fc-4f72-89c3-e4c3a3838788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:59.464313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b0f1f-34fc-4f72-89c3-e4c3a3838788 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:59.468053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b0f1f-34fc-4f72-89c3-e4c3a3838788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:59.468421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b0f1f-34fc-4f72-89c3-e4c3a3838788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:59.470730 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b0f1f-34fc-4f72-89c3-e4c3a3838788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:59.480629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b0f1f-34fc-4f72-89c3-e4c3a3838788 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:59.507827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 902/1781] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:59.512129 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b0f1f-34fc-4f72-89c3-e4c3a3838788 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:59.540176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b0f1f-34fc-4f72-89c3-e4c3a3838788 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:59.564230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7daf3-c4e6-4c0d-b263-7ef4ee8b315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:59.565577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7daf3-c4e6-4c0d-b263-7ef4ee8b315b admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:59.567793 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7daf3-c4e6-4c0d-b263-7ef4ee8b315b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:59.568359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7daf3-c4e6-4c0d-b263-7ef4ee8b315b admin admin] PATH_INFO: `/v3/projects/1ee49d4126864131bcf4f7198432b03c/users/fa6859d6823d43499ee2047849262d6c/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:59.639982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 880/1782] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:45:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:59.639982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91168551-aec9-4716-ba58-b42436254fe1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:59.639982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-91168551-aec9-4716-ba58-b42436254fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:59.642260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7daf3-c4e6-4c0d-b263-7ef4ee8b315b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee49d4126864131bcf4f7198432b03c, user_id=fa6859d6823d43499ee2047849262d6c, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:59.648910 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7daf3-c4e6-4c0d-b263-7ef4ee8b315b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:59.799485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 903/1783] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:59 2022] PUT /identity/v3/projects/1ee49d4126864131bcf4f7198432b03c/users/fa6859d6823d43499ee2047849262d6c/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:59.801416 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7daf3-c4e6-4c0d-b263-7ef4ee8b315b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:59.806833 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a9c7daf3-c4e6-4c0d-b263-7ef4ee8b315b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:59.834953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91168551-aec9-4716-ba58-b42436254fe1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:00.027159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f89169-e2e0-4bfa-9836-7b0a2677e628 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:00.028306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89169-e2e0-4bfa-9836-7b0a2677e628 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:00.028703 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89169-e2e0-4bfa-9836-7b0a2677e628 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:00.029384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89169-e2e0-4bfa-9836-7b0a2677e628 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:00.071296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7daf3-c4e6-4c0d-b263-7ef4ee8b315b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:00.071296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:00.071296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:00.071296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:00.072322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] PATH_INFO: `/v3/projects/9406b239405248c1bd3fea3427d96fc1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:00.072322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9406b239405248c1bd3fea3427d96fc1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:00.072322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:00.230388 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f89169-e2e0-4bfa-9836-7b0a2677e628 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:00.235325 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f89169-e2e0-4bfa-9836-7b0a2677e628 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:00.268416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 881/1784] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:00.273330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc575a9-9ee6-4358-a49f-8fa00daac4ab None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:00.273760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc575a9-9ee6-4358-a49f-8fa00daac4ab None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:00.274161 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc575a9-9ee6-4358-a49f-8fa00daac4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:00.351963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4cc575a9-9ee6-4358-a49f-8fa00daac4ab None None] MFA Rules not processed for user `fa6859d6823d43499ee2047849262d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:00.354423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4cc575a9-9ee6-4358-a49f-8fa00daac4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:00.408021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9406b239405248c1bd3fea3427d96fc1', 'request_id': 'req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:00.438505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9406b239405248c1bd3fea3427d96fc1', 'request_id': 'req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:00.489892 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9406b239405248c1bd3fea3427d96fc1', 'request_id': 'req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:00.546068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] The token cache is being invalidate because project 9406b239405248c1bd3fea3427d96fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:00.546068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:00.547658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:00.558078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 904/1785] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:59 2022] DELETE /identity/v3/projects/9406b239405248c1bd3fea3427d96fc1 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:00.563687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:00.567631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 882/1786] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:00.567875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:00.569002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc575a9-9ee6-4358-a49f-8fa00daac4ab None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:00.622932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:00.699762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0adc-bbe0-47bc-ad65-a62c0b1e0569 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:00.706012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54becc71-9549-4e11-9bbb-dbeeb707b1ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:00.706924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54becc71-9549-4e11-9bbb-dbeeb707b1ab service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:00.707229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54becc71-9549-4e11-9bbb-dbeeb707b1ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:00.707606 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54becc71-9549-4e11-9bbb-dbeeb707b1ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:00.709795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-54becc71-9549-4e11-9bbb-dbeeb707b1ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:00.717743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc575a9-9ee6-4358-a49f-8fa00daac4ab None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:00.723763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:00.725297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:00.725646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:00.725998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] PATH_INFO: `/v3/users/f4eb638fe6b247f689b4916a3e30e86a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:00.728089 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4eb638fe6b247f689b4916a3e30e86a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:00.731539 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:00.800374 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54becc71-9549-4e11-9bbb-dbeeb707b1ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:00.801916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54becc71-9549-4e11-9bbb-dbeeb707b1ab service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:00.823099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 905/1787] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:00.824870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54becc71-9549-4e11-9bbb-dbeeb707b1ab service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:00.828221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-54becc71-9549-4e11-9bbb-dbeeb707b1ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:00.848006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54becc71-9549-4e11-9bbb-dbeeb707b1ab service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:00.855379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705aa75d-bad4-4494-8d54-cbda28be23ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:00.856645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705aa75d-bad4-4494-8d54-cbda28be23ff admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:00.857222 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705aa75d-bad4-4494-8d54-cbda28be23ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:00.857665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705aa75d-bad4-4494-8d54-cbda28be23ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:00.858685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705aa75d-bad4-4494-8d54-cbda28be23ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:00.861462 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705aa75d-bad4-4494-8d54-cbda28be23ff admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:00.977477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 906/1788] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:00 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:00.983369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705aa75d-bad4-4494-8d54-cbda28be23ff admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:01.184036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4eb638fe6b247f689b4916a3e30e86a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:01.187558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4eb638fe6b247f689b4916a3e30e86a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:01.220688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4eb638fe6b247f689b4916a3e30e86a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:01.232638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4eb638fe6b247f689b4916a3e30e86a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:01.234258 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4eb638fe6b247f689b4916a3e30e86a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:01.270393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705aa75d-bad4-4494-8d54-cbda28be23ff admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:01.295359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff37a-fffc-4ea6-960c-3ba0312ec4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:01.298043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff37a-fffc-4ea6-960c-3ba0312ec4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:01.298043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff37a-fffc-4ea6-960c-3ba0312ec4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:01.298043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff37a-fffc-4ea6-960c-3ba0312ec4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:01.298688 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdff37a-fffc-4ea6-960c-3ba0312ec4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:01.303630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdff37a-fffc-4ea6-960c-3ba0312ec4e8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:01.369995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 883/1789] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:00 2022] DELETE /identity/v3/users/f4eb638fe6b247f689b4916a3e30e86a => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:01.450369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 907/1790] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:00 2022] POST /identity/v3/users => generated 296 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:01.456084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:01.458827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:01.721144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4bf0f-4cff-4804-aa28-5be6763f98fa admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:01.752640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e2308-0d54-48fe-a024-2cc23f99f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:01.753300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2308-0d54-48fe-a024-2cc23f99f1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:01.753611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2308-0d54-48fe-a024-2cc23f99f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:01.753971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2308-0d54-48fe-a024-2cc23f99f1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:01.754855 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e2308-0d54-48fe-a024-2cc23f99f1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:01.756734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e2308-0d54-48fe-a024-2cc23f99f1c0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:01.791566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 884/1791] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:01.799829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff37a-fffc-4ea6-960c-3ba0312ec4e8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:01.845917 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff37a-fffc-4ea6-960c-3ba0312ec4e8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:01.861389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993107fd-72f6-470e-8e63-b8cca9b0b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:01.863393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993107fd-72f6-470e-8e63-b8cca9b0b765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:01.864397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993107fd-72f6-470e-8e63-b8cca9b0b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:01.865357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993107fd-72f6-470e-8e63-b8cca9b0b765 admin admin] PATH_INFO: `/v3/projects/b89f970f893749a090608ffe6d59c47e/users/af9a0ace2cb145f7b9e8ca8eb95ed64d/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:01.893334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993107fd-72f6-470e-8e63-b8cca9b0b765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89f970f893749a090608ffe6d59c47e, user_id=af9a0ace2cb145f7b9e8ca8eb95ed64d, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:01.897687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993107fd-72f6-470e-8e63-b8cca9b0b765 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:02.022742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 908/1792] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:01 2022] PUT /identity/v3/projects/b89f970f893749a090608ffe6d59c47e/users/af9a0ace2cb145f7b9e8ca8eb95ed64d/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:02.029289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e2308-0d54-48fe-a024-2cc23f99f1c0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:02.044023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:02.053935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5b66-715f-47e2-9c0a-9d4b5d3cbb4e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:02.054495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5b66-715f-47e2-9c0a-9d4b5d3cbb4e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:02.054989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5b66-715f-47e2-9c0a-9d4b5d3cbb4e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:02.058500 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 909/1793] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:46:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:46:02.063402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e2308-0d54-48fe-a024-2cc23f99f1c0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:02.083438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08801801-dd5d-4ab8-84c2-75a7e690b004 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:02.083622 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08801801-dd5d-4ab8-84c2-75a7e690b004 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:02.087956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08801801-dd5d-4ab8-84c2-75a7e690b004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:02.165816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-08801801-dd5d-4ab8-84c2-75a7e690b004 None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:02.174437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-08801801-dd5d-4ab8-84c2-75a7e690b004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:02.329533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9ef2-4cf3-4e04-816a-069e289dda3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:02.330641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9ef2-4cf3-4e04-816a-069e289dda3a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:02.331152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9ef2-4cf3-4e04-816a-069e289dda3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:02.331603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9ef2-4cf3-4e04-816a-069e289dda3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:02.333141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c9ef2-4cf3-4e04-816a-069e289dda3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:02.357945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c9ef2-4cf3-4e04-816a-069e289dda3a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:02.430884 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 885/1794] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:02.435461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9ef2-4cf3-4e04-816a-069e289dda3a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:02.487368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9ef2-4cf3-4e04-816a-069e289dda3a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:02.492765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 910/1795] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:46:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:02.505913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2371635-53f9-4de3-87b3-460adc81e8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:02.505913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2371635-53f9-4de3-87b3-460adc81e8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:02.505913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2371635-53f9-4de3-87b3-460adc81e8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:02.505913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2371635-53f9-4de3-87b3-460adc81e8ed admin admin] PATH_INFO: `/v3/projects/b89f970f893749a090608ffe6d59c47e/users/af9a0ace2cb145f7b9e8ca8eb95ed64d/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:02.508377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2371635-53f9-4de3-87b3-460adc81e8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89f970f893749a090608ffe6d59c47e, user_id=af9a0ace2cb145f7b9e8ca8eb95ed64d, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:02.513611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2371635-53f9-4de3-87b3-460adc81e8ed admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:02.533726 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 886/1796] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:02 2022] PUT /identity/v3/projects/b89f970f893749a090608ffe6d59c47e/users/af9a0ace2cb145f7b9e8ca8eb95ed64d/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:02.562506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4e85f-cdca-4a67-8fe6-440aa9269fda None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:02.568729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4e85f-cdca-4a67-8fe6-440aa9269fda None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:02.568729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4e85f-cdca-4a67-8fe6-440aa9269fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:02.641295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5ab4e85f-cdca-4a67-8fe6-440aa9269fda None None] MFA Rules not processed for user `af9a0ace2cb145f7b9e8ca8eb95ed64d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:02.649534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5ab4e85f-cdca-4a67-8fe6-440aa9269fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:02.654662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:02.678441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2371635-53f9-4de3-87b3-460adc81e8ed admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:02.682522 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f2371635-53f9-4de3-87b3-460adc81e8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:02.892822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2371635-53f9-4de3-87b3-460adc81e8ed admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:02.913003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9ba1c-5013-433d-854f-f5c2168b83f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:02.913871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9ba1c-5013-433d-854f-f5c2168b83f1 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:02.914305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9ba1c-5013-433d-854f-f5c2168b83f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:02.914585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9ba1c-5013-433d-854f-f5c2168b83f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:02.933279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 911/1797] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:02.976145 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4e85f-cdca-4a67-8fe6-440aa9269fda None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:02.978664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9ba1c-5013-433d-854f-f5c2168b83f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:02.980665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5ab4e85f-cdca-4a67-8fe6-440aa9269fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:02.983157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9ba1c-5013-433d-854f-f5c2168b83f1 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:03.034974 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 887/1798] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:03.127590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:03.233974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4e85f-cdca-4a67-8fe6-440aa9269fda None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:03.254243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d6c03-eee7-433e-977f-74d607a6fa97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:03.256251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d6c03-eee7-433e-977f-74d607a6fa97 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:03.256883 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d6c03-eee7-433e-977f-74d607a6fa97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:03.257725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d6c03-eee7-433e-977f-74d607a6fa97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:03.272273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-085d6c03-eee7-433e-977f-74d607a6fa97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:03.325260 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9ba1c-5013-433d-854f-f5c2168b83f1 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:03.330223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-60a9ba1c-5013-433d-854f-f5c2168b83f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:03.569468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d6c03-eee7-433e-977f-74d607a6fa97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:03.578255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d6c03-eee7-433e-977f-74d607a6fa97 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:03.605756 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 912/1799] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:03.638430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9ba1c-5013-433d-854f-f5c2168b83f1 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:03.650168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:03.651497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:03.651970 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:03.652471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f admin admin] PATH_INFO: `/v3/projects/6786dad055c14af59af86a406547bddf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:03.653982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6786dad055c14af59af86a406547bddf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:03.656621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:03.887330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6786dad055c14af59af86a406547bddf', 'request_id': 'req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:03.907757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6786dad055c14af59af86a406547bddf', 'request_id': 'req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:04.005700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6786dad055c14af59af86a406547bddf', 'request_id': 'req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:04.057231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:04.065306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f admin admin] The token cache is being invalidate because project 6786dad055c14af59af86a406547bddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:04.069332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:04.069332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b438d098-74ed-4f3e-aeb3-b3f5fff61d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:04.080661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 888/1800] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:03 2022] DELETE /identity/v3/projects/6786dad055c14af59af86a406547bddf => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:04.081134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3be5f-1ca6-43f9-90fa-a34bf14bedd5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:04.081845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3be5f-1ca6-43f9-90fa-a34bf14bedd5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:04.082136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3be5f-1ca6-43f9-90fa-a34bf14bedd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:04.141474 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-eca3be5f-1ca6-43f9-90fa-a34bf14bedd5 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:04.144690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-eca3be5f-1ca6-43f9-90fa-a34bf14bedd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:04.433117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 913/1801] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:04.446374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8ac9c-24b6-49f2-ac92-1d89a0f06517 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:04.447217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8ac9c-24b6-49f2-ac92-1d89a0f06517 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:04.447217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8ac9c-24b6-49f2-ac92-1d89a0f06517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:04.527015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-47e8ac9c-24b6-49f2-ac92-1d89a0f06517 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:04.529330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-47e8ac9c-24b6-49f2-ac92-1d89a0f06517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:04.567463 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 889/1802] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:04.573845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3be5f-1ca6-43f9-90fa-a34bf14bedd5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:04.596077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3be5f-1ca6-43f9-90fa-a34bf14bedd5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:04.609924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9638da-9abe-4bcf-bf4a-91e32870db36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:04.611174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9638da-9abe-4bcf-bf4a-91e32870db36 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:04.611823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9638da-9abe-4bcf-bf4a-91e32870db36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:04.612830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9638da-9abe-4bcf-bf4a-91e32870db36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:04.614561 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9638da-9abe-4bcf-bf4a-91e32870db36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:04.615238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9638da-9abe-4bcf-bf4a-91e32870db36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:04.619000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9638da-9abe-4bcf-bf4a-91e32870db36 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:04.652000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 914/1803] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:46:04.657607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8ac9c-24b6-49f2-ac92-1d89a0f06517 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:04.688654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8ac9c-24b6-49f2-ac92-1d89a0f06517 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:04.734387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a2302-eb68-41b8-9623-f40c340d634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:04.737373 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2302-eb68-41b8-9623-f40c340d634b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:04.737685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2302-eb68-41b8-9623-f40c340d634b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:04.737963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2302-eb68-41b8-9623-f40c340d634b admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:04.738973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a2302-eb68-41b8-9623-f40c340d634b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:04.741536 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a2302-eb68-41b8-9623-f40c340d634b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:05.013902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 890/1804] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:04 2022] POST /identity/v3/projects => generated 359 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:05.021732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9638da-9abe-4bcf-bf4a-91e32870db36 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:05.047229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9638da-9abe-4bcf-bf4a-91e32870db36 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:05.201030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7cf27-7570-432e-b59c-466e3670a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:05.202186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7cf27-7570-432e-b59c-466e3670a2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:05.203155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7cf27-7570-432e-b59c-466e3670a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:05.203488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7cf27-7570-432e-b59c-466e3670a2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:05.204648 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7cf27-7570-432e-b59c-466e3670a2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:05.209504 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7cf27-7570-432e-b59c-466e3670a2e7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:05.360143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 915/1805] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:05 2022] POST /identity/v3/users => generated 280 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:05.366157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a2302-eb68-41b8-9623-f40c340d634b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:05.388673 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a2302-eb68-41b8-9623-f40c340d634b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:05.404772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdcac8-342d-400e-8357-fa5362d69819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:05.407743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdcac8-342d-400e-8357-fa5362d69819 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:05.408611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdcac8-342d-400e-8357-fa5362d69819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:05.409412 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdcac8-342d-400e-8357-fa5362d69819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:05.411180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdcac8-342d-400e-8357-fa5362d69819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:05.414486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdcac8-342d-400e-8357-fa5362d69819 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:05.437390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 891/1806] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:05.442506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7cf27-7570-432e-b59c-466e3670a2e7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:05.462507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7cf27-7570-432e-b59c-466e3670a2e7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:05.471189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6519ed0-970e-43ee-99a6-7715cd086696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:05.472814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6519ed0-970e-43ee-99a6-7715cd086696 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:05.473401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6519ed0-970e-43ee-99a6-7715cd086696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:05.474142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6519ed0-970e-43ee-99a6-7715cd086696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:05.475607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6519ed0-970e-43ee-99a6-7715cd086696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:05.479135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6519ed0-970e-43ee-99a6-7715cd086696 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:05.508254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 916/1807] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:46:05.512049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdcac8-342d-400e-8357-fa5362d69819 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:05.532001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdcac8-342d-400e-8357-fa5362d69819 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:05.541692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744b972-ac66-4350-a49b-38897ab63bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:05.544954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744b972-ac66-4350-a49b-38897ab63bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:05.544954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744b972-ac66-4350-a49b-38897ab63bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:05.544954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744b972-ac66-4350-a49b-38897ab63bc7 admin admin] PATH_INFO: `/v3/projects/03399617fc154052b8f2b9f05c0d128d/users/94515c562c3e469e827c569dfe6e2151/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:05.581257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744b972-ac66-4350-a49b-38897ab63bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03399617fc154052b8f2b9f05c0d128d, user_id=94515c562c3e469e827c569dfe6e2151, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:05.631081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744b972-ac66-4350-a49b-38897ab63bc7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:05.726069 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 892/1808] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:05 2022] PUT /identity/v3/projects/03399617fc154052b8f2b9f05c0d128d/users/94515c562c3e469e827c569dfe6e2151/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:05.750014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51d26e-316b-43d3-9f19-c7e7dd06bc18 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:05.751121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51d26e-316b-43d3-9f19-c7e7dd06bc18 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:05.752201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51d26e-316b-43d3-9f19-c7e7dd06bc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:05.825145 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2d51d26e-316b-43d3-9f19-c7e7dd06bc18 None None] MFA Rules not processed for user `94515c562c3e469e827c569dfe6e2151`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:05.827808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2d51d26e-316b-43d3-9f19-c7e7dd06bc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:06.073283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 917/1809] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:06.478421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744b972-ac66-4350-a49b-38897ab63bc7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:06.482501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5744b972-ac66-4350-a49b-38897ab63bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:06.604447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744b972-ac66-4350-a49b-38897ab63bc7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:06.618416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f8a1b-e4f8-4788-aa71-3b7e3e3f0147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:06.619781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f8a1b-e4f8-4788-aa71-3b7e3e3f0147 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:06.620792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f8a1b-e4f8-4788-aa71-3b7e3e3f0147 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:06.621631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f8a1b-e4f8-4788-aa71-3b7e3e3f0147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:06.625253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7b3f8a1b-e4f8-4788-aa71-3b7e3e3f0147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:06.677519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:06.813826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f8a1b-e4f8-4788-aa71-3b7e3e3f0147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:06.820925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f8a1b-e4f8-4788-aa71-3b7e3e3f0147 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:06.836501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 893/1810] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:07.206776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51d26e-316b-43d3-9f19-c7e7dd06bc18 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:07.223362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51d26e-316b-43d3-9f19-c7e7dd06bc18 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:07.231918 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30029a3-f3c9-4002-9bff-ddcfcc8232eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:07.232845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30029a3-f3c9-4002-9bff-ddcfcc8232eb service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:07.233142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30029a3-f3c9-4002-9bff-ddcfcc8232eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:07.233637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30029a3-f3c9-4002-9bff-ddcfcc8232eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:07.252552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30029a3-f3c9-4002-9bff-ddcfcc8232eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:07.255226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30029a3-f3c9-4002-9bff-ddcfcc8232eb service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:07.275819 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 918/1811] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:46:07.304336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f8a1b-e4f8-4788-aa71-3b7e3e3f0147 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:07.450494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f8a1b-e4f8-4788-aa71-3b7e3e3f0147 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:07.458523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:07.462886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:07.462886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:07.462886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] PATH_INFO: `/v3/users/94515c562c3e469e827c569dfe6e2151` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:07.462886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94515c562c3e469e827c569dfe6e2151)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:07.464858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:07.758037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94515c562c3e469e827c569dfe6e2151'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:07.760546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94515c562c3e469e827c569dfe6e2151'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:07.786019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94515c562c3e469e827c569dfe6e2151'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:07.797670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94515c562c3e469e827c569dfe6e2151'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:07.798940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94515c562c3e469e827c569dfe6e2151'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:07.971803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 894/1812] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:07 2022] DELETE /identity/v3/users/94515c562c3e469e827c569dfe6e2151 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:07.979371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badbcf3-584b-4c3e-b843-e8d8f13e8f68 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:07.980213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badbcf3-584b-4c3e-b843-e8d8f13e8f68 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:07.980494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badbcf3-584b-4c3e-b843-e8d8f13e8f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:08.024800 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2badbcf3-584b-4c3e-b843-e8d8f13e8f68 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:08.027867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2badbcf3-584b-4c3e-b843-e8d8f13e8f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:08.157681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 919/1813] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:08.173501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:08.177320 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:08.307502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779e02b-7876-4858-9828-9a18c60d8453 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:08.321990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a3d12-5162-4957-9948-eb7e71f2abfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:08.324930 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a3d12-5162-4957-9948-eb7e71f2abfb service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:08.326533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a3d12-5162-4957-9948-eb7e71f2abfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:08.328587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a3d12-5162-4957-9948-eb7e71f2abfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:08.377250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a3d12-5162-4957-9948-eb7e71f2abfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:08.381391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a3d12-5162-4957-9948-eb7e71f2abfb service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:08.428631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 895/1814] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:08.777441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:09.363030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badbcf3-584b-4c3e-b843-e8d8f13e8f68 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:09.367696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2badbcf3-584b-4c3e-b843-e8d8f13e8f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:09.388501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badbcf3-584b-4c3e-b843-e8d8f13e8f68 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:09.413317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d66f79-1837-44dd-a25d-01c4a6ba561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:09.414779 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d66f79-1837-44dd-a25d-01c4a6ba561b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:09.418375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d66f79-1837-44dd-a25d-01c4a6ba561b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:09.418939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d66f79-1837-44dd-a25d-01c4a6ba561b admin admin] PATH_INFO: `/v3/projects/03399617fc154052b8f2b9f05c0d128d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:09.420758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d66f79-1837-44dd-a25d-01c4a6ba561b admin admin] RBAC: Authorizing `identity:delete_project(project_id=03399617fc154052b8f2b9f05c0d128d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:09.429213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d66f79-1837-44dd-a25d-01c4a6ba561b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:09.695522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-63d66f79-1837-44dd-a25d-01c4a6ba561b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03399617fc154052b8f2b9f05c0d128d', 'request_id': 'req-63d66f79-1837-44dd-a25d-01c4a6ba561b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:09.712148 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-63d66f79-1837-44dd-a25d-01c4a6ba561b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03399617fc154052b8f2b9f05c0d128d', 'request_id': 'req-63d66f79-1837-44dd-a25d-01c4a6ba561b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:09.875937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-63d66f79-1837-44dd-a25d-01c4a6ba561b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03399617fc154052b8f2b9f05c0d128d', 'request_id': 'req-63d66f79-1837-44dd-a25d-01c4a6ba561b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:09.913117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-63d66f79-1837-44dd-a25d-01c4a6ba561b admin admin] The token cache is being invalidate because project 03399617fc154052b8f2b9f05c0d128d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:09.913117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-63d66f79-1837-44dd-a25d-01c4a6ba561b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:09.914482 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-63d66f79-1837-44dd-a25d-01c4a6ba561b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:09.917466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 920/1815] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:09 2022] DELETE /identity/v3/projects/03399617fc154052b8f2b9f05c0d128d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:09.933766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9d5b-6553-4b64-a8d8-3d07bfd15078 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:09.934812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9d5b-6553-4b64-a8d8-3d07bfd15078 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:09.935319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9d5b-6553-4b64-a8d8-3d07bfd15078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:09.987362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-05bf9d5b-6553-4b64-a8d8-3d07bfd15078 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:09.990927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05bf9d5b-6553-4b64-a8d8-3d07bfd15078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:10.167314 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 896/1816] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:10.180560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b27edf-413f-4b15-8c96-09834ce3c8a8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:10.181058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b27edf-413f-4b15-8c96-09834ce3c8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:10.181544 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b27edf-413f-4b15-8c96-09834ce3c8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:10.227888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b2b27edf-413f-4b15-8c96-09834ce3c8a8 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:10.230591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b2b27edf-413f-4b15-8c96-09834ce3c8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:10.255960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 921/1817] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:10.261995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9d5b-6553-4b64-a8d8-3d07bfd15078 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:10.295048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9d5b-6553-4b64-a8d8-3d07bfd15078 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:10.314096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaabee-a0ec-4cfc-b3ff-a2e6cbbea671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:10.315160 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaabee-a0ec-4cfc-b3ff-a2e6cbbea671 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:10.315485 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaabee-a0ec-4cfc-b3ff-a2e6cbbea671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:10.315860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaabee-a0ec-4cfc-b3ff-a2e6cbbea671 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:10.316880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaabee-a0ec-4cfc-b3ff-a2e6cbbea671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:10.317445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaabee-a0ec-4cfc-b3ff-a2e6cbbea671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:10.321305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaabee-a0ec-4cfc-b3ff-a2e6cbbea671 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:10.350720 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 897/1818] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:46:10.352586 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b27edf-413f-4b15-8c96-09834ce3c8a8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:10.383052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b27edf-413f-4b15-8c96-09834ce3c8a8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:10.397685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04551a-60fe-45c7-9596-d029c47dca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:10.399295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04551a-60fe-45c7-9596-d029c47dca4d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:10.404716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04551a-60fe-45c7-9596-d029c47dca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:10.404716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04551a-60fe-45c7-9596-d029c47dca4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:10.404716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04551a-60fe-45c7-9596-d029c47dca4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:10.407981 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04551a-60fe-45c7-9596-d029c47dca4d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:10.661896 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 922/1819] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:10 2022] POST /identity/v3/projects => generated 385 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:10.666828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaabee-a0ec-4cfc-b3ff-a2e6cbbea671 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:10.684194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaabee-a0ec-4cfc-b3ff-a2e6cbbea671 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:10.786706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3a576-0a98-4744-9191-e0d9fe966f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:10.787392 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3a576-0a98-4744-9191-e0d9fe966f3b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:10.787816 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3a576-0a98-4744-9191-e0d9fe966f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:10.788415 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3a576-0a98-4744-9191-e0d9fe966f3b admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:10.789288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3a576-0a98-4744-9191-e0d9fe966f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:10.791592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3a576-0a98-4744-9191-e0d9fe966f3b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:10.933089 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 898/1820] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:10 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:10.942711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04551a-60fe-45c7-9596-d029c47dca4d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:10.975383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04551a-60fe-45c7-9596-d029c47dca4d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:10.989841 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1709b0-4633-47aa-8d88-59d270560b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:10.990876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1709b0-4633-47aa-8d88-59d270560b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:10.992552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1709b0-4633-47aa-8d88-59d270560b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:10.992552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1709b0-4633-47aa-8d88-59d270560b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:10.993219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1709b0-4633-47aa-8d88-59d270560b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:10.996523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1709b0-4633-47aa-8d88-59d270560b0c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:11.024663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 923/1821] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:11.035762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3a576-0a98-4744-9191-e0d9fe966f3b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:11.072300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3a576-0a98-4744-9191-e0d9fe966f3b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:11.084406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26deac1-83b4-4835-9c40-438f82b7e4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:11.086297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26deac1-83b4-4835-9c40-438f82b7e4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:11.087098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26deac1-83b4-4835-9c40-438f82b7e4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:11.087955 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26deac1-83b4-4835-9c40-438f82b7e4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:11.089590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26deac1-83b4-4835-9c40-438f82b7e4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:11.092555 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26deac1-83b4-4835-9c40-438f82b7e4c2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:11.137842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 899/1822] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:11.142884 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1709b0-4633-47aa-8d88-59d270560b0c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:11.189016 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1709b0-4633-47aa-8d88-59d270560b0c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:11.213613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a441d-a1a1-44a8-83b8-5b3e200f36fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:11.221154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a441d-a1a1-44a8-83b8-5b3e200f36fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:11.223912 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a441d-a1a1-44a8-83b8-5b3e200f36fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:11.225659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a441d-a1a1-44a8-83b8-5b3e200f36fb admin admin] PATH_INFO: `/v3/projects/b92426e5c5cc48eb921f708527c21ad0/users/8ba7ba5d5abe40448f2944744f8fcab5/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:11.291179 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a441d-a1a1-44a8-83b8-5b3e200f36fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92426e5c5cc48eb921f708527c21ad0, user_id=8ba7ba5d5abe40448f2944744f8fcab5, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:11.306370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a441d-a1a1-44a8-83b8-5b3e200f36fb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:11.479370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 924/1823] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:11 2022] PUT /identity/v3/projects/b92426e5c5cc48eb921f708527c21ad0/users/8ba7ba5d5abe40448f2944744f8fcab5/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:11.502025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5a7d1-2170-44ad-a94c-6a6caa8306f3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:11.502025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5a7d1-2170-44ad-a94c-6a6caa8306f3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:11.502375 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5a7d1-2170-44ad-a94c-6a6caa8306f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:11.543357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ddb5a7d1-2170-44ad-a94c-6a6caa8306f3 None None] MFA Rules not processed for user `8ba7ba5d5abe40448f2944744f8fcab5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:11.545428 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ddb5a7d1-2170-44ad-a94c-6a6caa8306f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:11.676908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 900/1824] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:11.700508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a441d-a1a1-44a8-83b8-5b3e200f36fb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:11.704023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fe2a441d-a1a1-44a8-83b8-5b3e200f36fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:11.838443 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a441d-a1a1-44a8-83b8-5b3e200f36fb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:11.846014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d5255-ee76-44bd-96d3-209113fbde60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:11.847082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d5255-ee76-44bd-96d3-209113fbde60 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:11.847603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d5255-ee76-44bd-96d3-209113fbde60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:11.848127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d5255-ee76-44bd-96d3-209113fbde60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:11.876452 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d5255-ee76-44bd-96d3-209113fbde60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:11.876452 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d5255-ee76-44bd-96d3-209113fbde60 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:11.895155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 925/1825] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:12.429134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:13.877887 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5a7d1-2170-44ad-a94c-6a6caa8306f3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:13.881657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ddb5a7d1-2170-44ad-a94c-6a6caa8306f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:14.041203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5a7d1-2170-44ad-a94c-6a6caa8306f3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:14.052917 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:14.054572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:14.055217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:14.055880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] PATH_INFO: `/v3/users/fa6859d6823d43499ee2047849262d6c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:14.071977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6859d6823d43499ee2047849262d6c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:14.076062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:14.333892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:14.417143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6859d6823d43499ee2047849262d6c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:14.419011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6859d6823d43499ee2047849262d6c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:14.448924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6859d6823d43499ee2047849262d6c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:14.460909 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6859d6823d43499ee2047849262d6c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:14.462026 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6859d6823d43499ee2047849262d6c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:14.619392 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 901/1826] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:13 2022] DELETE /identity/v3/users/fa6859d6823d43499ee2047849262d6c => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:14.627010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b985e-2a09-46f7-bc41-3a5720bae38b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:14.627868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b985e-2a09-46f7-bc41-3a5720bae38b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:14.628021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b985e-2a09-46f7-bc41-3a5720bae38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:14.657428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2a6b985e-2a09-46f7-bc41-3a5720bae38b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:14.658788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2a6b985e-2a09-46f7-bc41-3a5720bae38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:14.780518 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 926/1827] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:14.801999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:14.812533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:14.975890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7b848-21ef-41cc-a4b7-d9ea696d9d7f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:14.987767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511de1af-9d7e-46ae-8677-609ca87ef575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:14.990950 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511de1af-9d7e-46ae-8677-609ca87ef575 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:14.991451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511de1af-9d7e-46ae-8677-609ca87ef575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:14.992036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511de1af-9d7e-46ae-8677-609ca87ef575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:15.012254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511de1af-9d7e-46ae-8677-609ca87ef575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:15.017879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511de1af-9d7e-46ae-8677-609ca87ef575 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:15.039429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 902/1828] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:15.684685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b985e-2a09-46f7-bc41-3a5720bae38b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:15.688198 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2a6b985e-2a09-46f7-bc41-3a5720bae38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:15.750552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b985e-2a09-46f7-bc41-3a5720bae38b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:15.762078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:15.763576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:15.764294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:15.765711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] PATH_INFO: `/v3/users/989615a67c714c7d85ff4771aa202a11` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:15.769028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] RBAC: Authorizing `identity:delete_user(user_id=989615a67c714c7d85ff4771aa202a11)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:15.774669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:15.986255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511de1af-9d7e-46ae-8677-609ca87ef575 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:15.988765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-511de1af-9d7e-46ae-8677-609ca87ef575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:16.026059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511de1af-9d7e-46ae-8677-609ca87ef575 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:16.039674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35b72c-e3fb-49fd-8bd9-0f8923030d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:16.040698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35b72c-e3fb-49fd-8bd9-0f8923030d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:16.041195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35b72c-e3fb-49fd-8bd9-0f8923030d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:16.041620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35b72c-e3fb-49fd-8bd9-0f8923030d7a admin admin] PATH_INFO: `/v3/users/8ba7ba5d5abe40448f2944744f8fcab5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:16.043299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35b72c-e3fb-49fd-8bd9-0f8923030d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba7ba5d5abe40448f2944744f8fcab5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:16.046793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35b72c-e3fb-49fd-8bd9-0f8923030d7a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:16.181596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989615a67c714c7d85ff4771aa202a11'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.197294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989615a67c714c7d85ff4771aa202a11'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.316032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989615a67c714c7d85ff4771aa202a11'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.319100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989615a67c714c7d85ff4771aa202a11'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.319100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989615a67c714c7d85ff4771aa202a11'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.342012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 927/1829] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:15 2022] DELETE /identity/v3/users/989615a67c714c7d85ff4771aa202a11 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:16.344164 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:16.355271 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:16.375863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ce35b72c-e3fb-49fd-8bd9-0f8923030d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba7ba5d5abe40448f2944744f8fcab5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.376862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ce35b72c-e3fb-49fd-8bd9-0f8923030d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba7ba5d5abe40448f2944744f8fcab5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.397975 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ce35b72c-e3fb-49fd-8bd9-0f8923030d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba7ba5d5abe40448f2944744f8fcab5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.410252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ce35b72c-e3fb-49fd-8bd9-0f8923030d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba7ba5d5abe40448f2944744f8fcab5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.411363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ce35b72c-e3fb-49fd-8bd9-0f8923030d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba7ba5d5abe40448f2944744f8fcab5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.484054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99744b3-ddf3-4ca4-b4f1-57408a6c263a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:16.492232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:16.493092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:16.493448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:16.493732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] PATH_INFO: `/v3/projects/1ee49d4126864131bcf4f7198432b03c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:16.495748 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee49d4126864131bcf4f7198432b03c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:16.498571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:16.514602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 903/1830] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:15 2022] DELETE /identity/v3/users/8ba7ba5d5abe40448f2944744f8fcab5 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:16.517141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57817b6-2ab0-47e0-9f92-4e1ac15485f1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:16.519369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57817b6-2ab0-47e0-9f92-4e1ac15485f1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:16.519369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57817b6-2ab0-47e0-9f92-4e1ac15485f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:16.548542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e57817b6-2ab0-47e0-9f92-4e1ac15485f1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:16.550358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e57817b6-2ab0-47e0-9f92-4e1ac15485f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:16.572778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:16.643062 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee49d4126864131bcf4f7198432b03c', 'request_id': 'req-a7fb0753-4d53-4bd7-b588-e31a16b62d23'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.650741 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee49d4126864131bcf4f7198432b03c', 'request_id': 'req-a7fb0753-4d53-4bd7-b588-e31a16b62d23'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.667832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 904/1831] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:16.677374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7380c-bb4c-48ed-9dad-be634c23f1a1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:16.677942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7380c-bb4c-48ed-9dad-be634c23f1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:16.678299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7380c-bb4c-48ed-9dad-be634c23f1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:16.708250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6da7380c-bb4c-48ed-9dad-be634c23f1a1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:16.710237 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6da7380c-bb4c-48ed-9dad-be634c23f1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:16.767493 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee49d4126864131bcf4f7198432b03c', 'request_id': 'req-a7fb0753-4d53-4bd7-b588-e31a16b62d23'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.770235 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:16.784296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] The token cache is being invalidate because project 1ee49d4126864131bcf4f7198432b03c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:16.785939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.786532 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:16.788441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 928/1832] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:16 2022] DELETE /identity/v3/projects/1ee49d4126864131bcf4f7198432b03c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:16.789293 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:16.791416 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:16.851641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 905/1833] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:16.851641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7380c-bb4c-48ed-9dad-be634c23f1a1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:16.851956 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6da7380c-bb4c-48ed-9dad-be634c23f1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:16.866429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7380c-bb4c-48ed-9dad-be634c23f1a1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:16.872009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:16.872747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:16.873087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:16.873423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] PATH_INFO: `/v3/users/af9a0ace2cb145f7b9e8ca8eb95ed64d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:16.875353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9a0ace2cb145f7b9e8ca8eb95ed64d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:16.877495 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:16.903647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb0753-4d53-4bd7-b588-e31a16b62d23 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:16.911054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff985c18-a14f-41fb-bb76-5d5c20763139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:16.912269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff985c18-a14f-41fb-bb76-5d5c20763139 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:16.912834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff985c18-a14f-41fb-bb76-5d5c20763139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:16.913420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff985c18-a14f-41fb-bb76-5d5c20763139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:16.916270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ff985c18-a14f-41fb-bb76-5d5c20763139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:16.931180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff985c18-a14f-41fb-bb76-5d5c20763139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:16.932832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff985c18-a14f-41fb-bb76-5d5c20763139 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:16.945253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 929/1834] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:16.946333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff985c18-a14f-41fb-bb76-5d5c20763139 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:16.961955 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff985c18-a14f-41fb-bb76-5d5c20763139 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:16.971891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bb49d-8598-4b9d-be75-d914b11cab2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:16.976829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bb49d-8598-4b9d-be75-d914b11cab2d service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:16.976829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bb49d-8598-4b9d-be75-d914b11cab2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:16.976829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bb49d-8598-4b9d-be75-d914b11cab2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:16.994159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bb49d-8598-4b9d-be75-d914b11cab2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:16.997379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bb49d-8598-4b9d-be75-d914b11cab2d service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:17.020242 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 930/1835] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:17.319706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9a0ace2cb145f7b9e8ca8eb95ed64d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:17.339023 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9a0ace2cb145f7b9e8ca8eb95ed64d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:17.382055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9a0ace2cb145f7b9e8ca8eb95ed64d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:17.403070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9a0ace2cb145f7b9e8ca8eb95ed64d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:17.407803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9a0ace2cb145f7b9e8ca8eb95ed64d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:17.627842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 906/1836] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:16 2022] DELETE /identity/v3/users/af9a0ace2cb145f7b9e8ca8eb95ed64d => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:17.818489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bb49d-8598-4b9d-be75-d914b11cab2d service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:17.821548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-010bb49d-8598-4b9d-be75-d914b11cab2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:17.846731 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bb49d-8598-4b9d-be75-d914b11cab2d service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:17.998667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:18.003604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:18.004140 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:18.005333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] PATH_INFO: `/v3/projects/53402d39595a4e5ca2481fe7cbfcaa8a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:18.007908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=53402d39595a4e5ca2481fe7cbfcaa8a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:18.012255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:18.288003 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53402d39595a4e5ca2481fe7cbfcaa8a', 'request_id': 'req-a34d9962-9af3-42ce-80e3-069bfc6e8bef'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:18.297606 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53402d39595a4e5ca2481fe7cbfcaa8a', 'request_id': 'req-a34d9962-9af3-42ce-80e3-069bfc6e8bef'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:18.428189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53402d39595a4e5ca2481fe7cbfcaa8a', 'request_id': 'req-a34d9962-9af3-42ce-80e3-069bfc6e8bef'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:18.484190 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] The token cache is being invalidate because project 53402d39595a4e5ca2481fe7cbfcaa8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:18.484972 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:18.488848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:18.494772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 931/1837] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:17 2022] DELETE /identity/v3/projects/53402d39595a4e5ca2481fe7cbfcaa8a => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:18.499938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:18.508146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:18.548717 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2716d-3aae-4402-99cd-9d2498ea7b6f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:18.647422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:18.678266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:18.679638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:18.680284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:18.681699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] PATH_INFO: `/v3/users/547ff43b287b408594e2b91eca19b1c0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:18.687749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:18.688933 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547ff43b287b408594e2b91eca19b1c0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:18.689419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:18.693046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:18.714699 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d9962-9af3-42ce-80e3-069bfc6e8bef admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:18.728945 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a0a8c-1407-4724-a19f-937d0d1f8966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:18.730012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a0a8c-1407-4724-a19f-937d0d1f8966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:18.730508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a0a8c-1407-4724-a19f-937d0d1f8966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:18.730990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a0a8c-1407-4724-a19f-937d0d1f8966 admin admin] PATH_INFO: `/v3/projects/b92426e5c5cc48eb921f708527c21ad0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:18.737120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a0a8c-1407-4724-a19f-937d0d1f8966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92426e5c5cc48eb921f708527c21ad0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:18.740725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a0a8c-1407-4724-a19f-937d0d1f8966 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:19.066980 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547ff43b287b408594e2b91eca19b1c0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.068810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547ff43b287b408594e2b91eca19b1c0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.087874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e91a0a8c-1407-4724-a19f-937d0d1f8966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92426e5c5cc48eb921f708527c21ad0', 'request_id': 'req-e91a0a8c-1407-4724-a19f-937d0d1f8966'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.105745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547ff43b287b408594e2b91eca19b1c0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.111680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e91a0a8c-1407-4724-a19f-937d0d1f8966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92426e5c5cc48eb921f708527c21ad0', 'request_id': 'req-e91a0a8c-1407-4724-a19f-937d0d1f8966'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.127316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547ff43b287b408594e2b91eca19b1c0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.128451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547ff43b287b408594e2b91eca19b1c0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.251157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e91a0a8c-1407-4724-a19f-937d0d1f8966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92426e5c5cc48eb921f708527c21ad0', 'request_id': 'req-e91a0a8c-1407-4724-a19f-937d0d1f8966'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.282287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e91a0a8c-1407-4724-a19f-937d0d1f8966 admin admin] The token cache is being invalidate because project b92426e5c5cc48eb921f708527c21ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:19.283140 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e91a0a8c-1407-4724-a19f-937d0d1f8966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.284353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e91a0a8c-1407-4724-a19f-937d0d1f8966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.287812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 932/1838] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:18 2022] DELETE /identity/v3/projects/b92426e5c5cc48eb921f708527c21ad0 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:19.298311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74fe0b-36ec-420c-82ef-129a46e786fe None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:19.299146 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74fe0b-36ec-420c-82ef-129a46e786fe None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:19.299789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74fe0b-36ec-420c-82ef-129a46e786fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:19.329495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9a74fe0b-36ec-420c-82ef-129a46e786fe None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:19.331267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9a74fe0b-36ec-420c-82ef-129a46e786fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:19.402466 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 907/1839] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:18 2022] DELETE /identity/v3/users/547ff43b287b408594e2b91eca19b1c0 => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:19.407956 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:19.410300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:19.449859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 933/1840] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:19.462986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981d67a-73d6-4175-af28-0d8624cae9b1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:19.463493 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981d67a-73d6-4175-af28-0d8624cae9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:19.465714 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981d67a-73d6-4175-af28-0d8624cae9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:19.503492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1981d67a-73d6-4175-af28-0d8624cae9b1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:19.504831 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1981d67a-73d6-4175-af28-0d8624cae9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:19.550447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729afbd2-e987-40f7-9479-636294ade0a5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:19.557006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0bec9-548a-4dd4-99c8-480f82076392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:19.557758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0bec9-548a-4dd4-99c8-480f82076392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:19.558348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0bec9-548a-4dd4-99c8-480f82076392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:19.559142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0bec9-548a-4dd4-99c8-480f82076392 admin admin] PATH_INFO: `/v3/projects/b89f970f893749a090608ffe6d59c47e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:19.561521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0bec9-548a-4dd4-99c8-480f82076392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89f970f893749a090608ffe6d59c47e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:19.566186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0bec9-548a-4dd4-99c8-480f82076392 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:19.643162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 934/1841] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:19.644547 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981d67a-73d6-4175-af28-0d8624cae9b1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:19.674907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981d67a-73d6-4175-af28-0d8624cae9b1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:19.688276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc325fce-f947-45c9-a3f3-cd011852d422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:19.691055 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc325fce-f947-45c9-a3f3-cd011852d422 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:19.692185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc325fce-f947-45c9-a3f3-cd011852d422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:19.695441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc325fce-f947-45c9-a3f3-cd011852d422 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:19.696202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc325fce-f947-45c9-a3f3-cd011852d422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:19.696515 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc325fce-f947-45c9-a3f3-cd011852d422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:19.698295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc325fce-f947-45c9-a3f3-cd011852d422 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:19.726777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-58b0bec9-548a-4dd4-99c8-480f82076392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89f970f893749a090608ffe6d59c47e', 'request_id': 'req-58b0bec9-548a-4dd4-99c8-480f82076392'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.739559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-58b0bec9-548a-4dd4-99c8-480f82076392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89f970f893749a090608ffe6d59c47e', 'request_id': 'req-58b0bec9-548a-4dd4-99c8-480f82076392'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.754628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 935/1842] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:46:19.755876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc325fce-f947-45c9-a3f3-cd011852d422 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:19.769064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc325fce-f947-45c9-a3f3-cd011852d422 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:19.844431 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-58b0bec9-548a-4dd4-99c8-480f82076392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89f970f893749a090608ffe6d59c47e', 'request_id': 'req-58b0bec9-548a-4dd4-99c8-480f82076392'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.863508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-58b0bec9-548a-4dd4-99c8-480f82076392 admin admin] The token cache is being invalidate because project b89f970f893749a090608ffe6d59c47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:19.864320 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-58b0bec9-548a-4dd4-99c8-480f82076392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.866139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-58b0bec9-548a-4dd4-99c8-480f82076392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:19.868714 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 908/1843] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:19 2022] DELETE /identity/v3/projects/b89f970f893749a090608ffe6d59c47e => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:19.876503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f75413-c253-4ebb-bfc3-90301a638448 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:19.878891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f75413-c253-4ebb-bfc3-90301a638448 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:19.879619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f75413-c253-4ebb-bfc3-90301a638448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:19.900344 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f048c3-777f-45ab-919e-ad2d2f558d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:19.941795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f048c3-777f-45ab-919e-ad2d2f558d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:19.941795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f048c3-777f-45ab-919e-ad2d2f558d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:19.941795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f048c3-777f-45ab-919e-ad2d2f558d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:19.941795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f048c3-777f-45ab-919e-ad2d2f558d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:19.941795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f048c3-777f-45ab-919e-ad2d2f558d0b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:19.948938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f7f75413-c253-4ebb-bfc3-90301a638448 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:19.951060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f7f75413-c253-4ebb-bfc3-90301a638448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:19.980330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 909/1844] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:19.999491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ddbb6-9e19-4823-84cc-45dc682bf6c7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:19.999491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ddbb6-9e19-4823-84cc-45dc682bf6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:19.999491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ddbb6-9e19-4823-84cc-45dc682bf6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:20.033220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-634ddbb6-9e19-4823-84cc-45dc682bf6c7 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:20.040690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-634ddbb6-9e19-4823-84cc-45dc682bf6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:20.055464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:20.055836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 910/1845] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:20.063490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ddbb6-9e19-4823-84cc-45dc682bf6c7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:20.084139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ddbb6-9e19-4823-84cc-45dc682bf6c7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:20.105615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ef9f0-32ec-4948-9d73-937a936f52e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:20.111007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 936/1846] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:19 2022] POST /identity/v3/projects => generated 371 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:20.111808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ef9f0-32ec-4948-9d73-937a936f52e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:20.111808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ef9f0-32ec-4948-9d73-937a936f52e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:20.111808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ef9f0-32ec-4948-9d73-937a936f52e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:20.111808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ef9f0-32ec-4948-9d73-937a936f52e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:20.111808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ef9f0-32ec-4948-9d73-937a936f52e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:20.113996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f048c3-777f-45ab-919e-ad2d2f558d0b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:20.114738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ef9f0-32ec-4948-9d73-937a936f52e2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:20.117372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-68f048c3-777f-45ab-919e-ad2d2f558d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:20.142940 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 911/1847] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:46:20.147124 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ef9f0-32ec-4948-9d73-937a936f52e2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:20.154521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a6ef9f0-32ec-4948-9d73-937a936f52e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:20.199378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ef9f0-32ec-4948-9d73-937a936f52e2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:20.371845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f048c3-777f-45ab-919e-ad2d2f558d0b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:20.402508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9acfd-45bb-4688-b417-2a5aa60b2c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:20.403915 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9acfd-45bb-4688-b417-2a5aa60b2c66 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:20.404494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9acfd-45bb-4688-b417-2a5aa60b2c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:20.405685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9acfd-45bb-4688-b417-2a5aa60b2c66 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:20.407296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9acfd-45bb-4688-b417-2a5aa60b2c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:20.411528 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9acfd-45bb-4688-b417-2a5aa60b2c66 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:20.449259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:20.454445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:20.455036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:20.455503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] PATH_INFO: `/v3/projects/4a52fd0c4da24abb86e6e7e7c955f266` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:20.471636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a52fd0c4da24abb86e6e7e7c955f266)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:20.481249 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:20.635454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 937/1848] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:20 2022] POST /identity/v3/users => generated 286 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:20.635454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9acfd-45bb-4688-b417-2a5aa60b2c66 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:20.726418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9acfd-45bb-4688-b417-2a5aa60b2c66 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:20.726418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce671e4-f80b-4722-91e8-29b05a967fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:20.726418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce671e4-f80b-4722-91e8-29b05a967fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:20.726418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce671e4-f80b-4722-91e8-29b05a967fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:20.728466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce671e4-f80b-4722-91e8-29b05a967fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:20.728466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce671e4-f80b-4722-91e8-29b05a967fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:20.728466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce671e4-f80b-4722-91e8-29b05a967fd6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:20.957688 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 938/1849] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:20 2022] POST /identity/v3/projects => generated 381 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:20.959645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce671e4-f80b-4722-91e8-29b05a967fd6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:20.987271 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a52fd0c4da24abb86e6e7e7c955f266', 'request_id': 'req-33b480d2-2e14-4361-896a-bfb8e19d65ef'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:20.998329 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a52fd0c4da24abb86e6e7e7c955f266', 'request_id': 'req-33b480d2-2e14-4361-896a-bfb8e19d65ef'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:21.079778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce671e4-f80b-4722-91e8-29b05a967fd6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:21.087892 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd56a0-9563-420b-a62e-8ffd658e7359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:21.089007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd56a0-9563-420b-a62e-8ffd658e7359 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:21.089599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd56a0-9563-420b-a62e-8ffd658e7359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:21.090328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd56a0-9563-420b-a62e-8ffd658e7359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:21.091894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd56a0-9563-420b-a62e-8ffd658e7359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:21.095218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd56a0-9563-420b-a62e-8ffd658e7359 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:21.125040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 939/1850] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:21.128076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd56a0-9563-420b-a62e-8ffd658e7359 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:21.148984 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd56a0-9563-420b-a62e-8ffd658e7359 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:21.159926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9768d8-0ca1-435f-810f-0132bba8ab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:21.160942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9768d8-0ca1-435f-810f-0132bba8ab00 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:21.161343 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9768d8-0ca1-435f-810f-0132bba8ab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:21.161815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9768d8-0ca1-435f-810f-0132bba8ab00 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:21.163125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9768d8-0ca1-435f-810f-0132bba8ab00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:21.167214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9768d8-0ca1-435f-810f-0132bba8ab00 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:21.181751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a52fd0c4da24abb86e6e7e7c955f266', 'request_id': 'req-33b480d2-2e14-4361-896a-bfb8e19d65ef'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:21.209234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] The token cache is being invalidate because project 4a52fd0c4da24abb86e6e7e7c955f266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:21.209624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:21.210348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:21.213820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 912/1851] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:20 2022] DELETE /identity/v3/projects/4a52fd0c4da24abb86e6e7e7c955f266 => generated 0 bytes in 1068 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:21.214895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:21.217102 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:21.359064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 940/1852] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:21 2022] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:21.361465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cdb6e-698d-4a2f-9fa5-98e4a36f1e5d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:21.362189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cdb6e-698d-4a2f-9fa5-98e4a36f1e5d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:21.362689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cdb6e-698d-4a2f-9fa5-98e4a36f1e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:21.408080 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b480d2-2e14-4361-896a-bfb8e19d65ef admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:21.418210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bd6cdb6e-698d-4a2f-9fa5-98e4a36f1e5d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:21.428334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bd6cdb6e-698d-4a2f-9fa5-98e4a36f1e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:21.429474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb3257-fea6-4afd-a727-f9bebf445d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:21.431996 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb3257-fea6-4afd-a727-f9bebf445d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:21.432501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb3257-fea6-4afd-a727-f9bebf445d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:21.432986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb3257-fea6-4afd-a727-f9bebf445d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:21.438246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb3257-fea6-4afd-a727-f9bebf445d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:21.447231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb3257-fea6-4afd-a727-f9bebf445d59 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:21.453142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 941/1853] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:21.456407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cdb6e-698d-4a2f-9fa5-98e4a36f1e5d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:21.462736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bd6cdb6e-698d-4a2f-9fa5-98e4a36f1e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:21.487298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cdb6e-698d-4a2f-9fa5-98e4a36f1e5d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:21.495368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e938771-b9f0-4156-9707-72638e168024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:21.496961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e938771-b9f0-4156-9707-72638e168024 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:21.497248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e938771-b9f0-4156-9707-72638e168024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:21.497854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e938771-b9f0-4156-9707-72638e168024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:21.499201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e938771-b9f0-4156-9707-72638e168024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:21.500091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 913/1854] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:21.502471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193394b-a65d-4b0e-83cc-f8f6626a730e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:21.502916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193394b-a65d-4b0e-83cc-f8f6626a730e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:21.503078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e938771-b9f0-4156-9707-72638e168024 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:21.503356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193394b-a65d-4b0e-83cc-f8f6626a730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:21.544815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 942/1855] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:21.546815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e938771-b9f0-4156-9707-72638e168024 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:21.585941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e938771-b9f0-4156-9707-72638e168024 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:21.590059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c193394b-a65d-4b0e-83cc-f8f6626a730e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:21.598246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c193394b-a65d-4b0e-83cc-f8f6626a730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:21.605360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f2dc-3992-46aa-a0a6-2a5b46c1b999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:21.606328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f2dc-3992-46aa-a0a6-2a5b46c1b999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:21.606796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f2dc-3992-46aa-a0a6-2a5b46c1b999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:21.607253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f2dc-3992-46aa-a0a6-2a5b46c1b999 admin admin] PATH_INFO: `/v3/projects/e9560961934e44dea70e5466761fff56/users/7ce2b798833249db9cc0ff000c779ec3/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:21.633263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 914/1856] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:21.637131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193394b-a65d-4b0e-83cc-f8f6626a730e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:21.658652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604f2dc-3992-46aa-a0a6-2a5b46c1b999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9560961934e44dea70e5466761fff56, user_id=7ce2b798833249db9cc0ff000c779ec3, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:21.664164 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604f2dc-3992-46aa-a0a6-2a5b46c1b999 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:21.672530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193394b-a65d-4b0e-83cc-f8f6626a730e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:21.683124 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547ccf0-4135-4ef4-bd5a-23d5ae62fca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:21.684173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547ccf0-4135-4ef4-bd5a-23d5ae62fca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:21.684672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547ccf0-4135-4ef4-bd5a-23d5ae62fca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:21.685175 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547ccf0-4135-4ef4-bd5a-23d5ae62fca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:21.686936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547ccf0-4135-4ef4-bd5a-23d5ae62fca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:21.691164 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:21.693919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547ccf0-4135-4ef4-bd5a-23d5ae62fca2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:21.724149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 915/1857] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:21.728343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547ccf0-4135-4ef4-bd5a-23d5ae62fca2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:21.738131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547ccf0-4135-4ef4-bd5a-23d5ae62fca2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:21.756006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c3d3f-c246-4bcb-9398-95905ff7d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:21.756752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c3d3f-c246-4bcb-9398-95905ff7d411 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:21.757078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c3d3f-c246-4bcb-9398-95905ff7d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:21.757520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c3d3f-c246-4bcb-9398-95905ff7d411 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:21.758380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c3d3f-c246-4bcb-9398-95905ff7d411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:21.758715 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c3d3f-c246-4bcb-9398-95905ff7d411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:21.767956 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c3d3f-c246-4bcb-9398-95905ff7d411 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:21.800748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 916/1858] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:46:21.802835 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c3d3f-c246-4bcb-9398-95905ff7d411 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:21.809663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 943/1859] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:21 2022] PUT /identity/v3/projects/e9560961934e44dea70e5466761fff56/users/7ce2b798833249db9cc0ff000c779ec3/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:21.811341 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f2dc-3992-46aa-a0a6-2a5b46c1b999 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:21.843623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c3d3f-c246-4bcb-9398-95905ff7d411 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:21.994143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f2dc-3992-46aa-a0a6-2a5b46c1b999 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:22.001917 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bf7bb-27ff-42a1-b854-6ab90c5c9441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:22.003772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bf7bb-27ff-42a1-b854-6ab90c5c9441 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:22.004509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bf7bb-27ff-42a1-b854-6ab90c5c9441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:22.005728 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bf7bb-27ff-42a1-b854-6ab90c5c9441 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:22.007521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bf7bb-27ff-42a1-b854-6ab90c5c9441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:22.013131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bf7bb-27ff-42a1-b854-6ab90c5c9441 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:22.032372 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e1d95-5a0b-4495-a5f0-17199965a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:22.033909 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e1d95-5a0b-4495-a5f0-17199965a823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:22.034552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e1d95-5a0b-4495-a5f0-17199965a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:22.035146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e1d95-5a0b-4495-a5f0-17199965a823 admin admin] PATH_INFO: `/v3/projects/b8351ec2e63744a6ac345a06de6475af/users/302183a2a4cb4bb1af33f70cfd874777/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:22.069820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e1d95-5a0b-4495-a5f0-17199965a823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8351ec2e63744a6ac345a06de6475af, user_id=302183a2a4cb4bb1af33f70cfd874777, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:22.069820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e1d95-5a0b-4495-a5f0-17199965a823 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:22.164492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 944/1860] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:21 2022] POST /identity/v3/projects => generated 383 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:22.173692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0af524-3367-4efd-ad9e-84d27e272b36 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:22.173692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0af524-3367-4efd-ad9e-84d27e272b36 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:22.173692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0af524-3367-4efd-ad9e-84d27e272b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:22.216014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-cf0af524-3367-4efd-ad9e-84d27e272b36 None None] MFA Rules not processed for user `7ce2b798833249db9cc0ff000c779ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:22.219320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cf0af524-3367-4efd-ad9e-84d27e272b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:22.252243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 917/1861] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:21 2022] PUT /identity/v3/projects/b8351ec2e63744a6ac345a06de6475af/users/302183a2a4cb4bb1af33f70cfd874777/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:22.253520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e1d95-5a0b-4495-a5f0-17199965a823 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:22.355693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 945/1862] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:22.355693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea24722-d4af-4a20-a752-65ac10fb92e0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:22.355693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea24722-d4af-4a20-a752-65ac10fb92e0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:22.358139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea24722-d4af-4a20-a752-65ac10fb92e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:22.398874 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e1d95-5a0b-4495-a5f0-17199965a823 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:22.411549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783aaecb-617d-4f52-b4e0-5e73840ac4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:22.414112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783aaecb-617d-4f52-b4e0-5e73840ac4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:22.414442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7ea24722-d4af-4a20-a752-65ac10fb92e0 None None] MFA Rules not processed for user `302183a2a4cb4bb1af33f70cfd874777`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:22.414618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783aaecb-617d-4f52-b4e0-5e73840ac4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:22.414618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783aaecb-617d-4f52-b4e0-5e73840ac4f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:22.415066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783aaecb-617d-4f52-b4e0-5e73840ac4f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:22.415312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7ea24722-d4af-4a20-a752-65ac10fb92e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:22.417539 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783aaecb-617d-4f52-b4e0-5e73840ac4f6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:22.523314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 946/1863] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:22.524706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea24722-d4af-4a20-a752-65ac10fb92e0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:22.526514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7ea24722-d4af-4a20-a752-65ac10fb92e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:22.584866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 918/1864] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:22 2022] POST /identity/v3/users => generated 292 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:22.584866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783aaecb-617d-4f52-b4e0-5e73840ac4f6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:22.601602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783aaecb-617d-4f52-b4e0-5e73840ac4f6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:22.609998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50708f39-fde9-4559-b018-4643c196d712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:22.610659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50708f39-fde9-4559-b018-4643c196d712 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:22.610932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50708f39-fde9-4559-b018-4643c196d712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:22.611206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50708f39-fde9-4559-b018-4643c196d712 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:22.612255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50708f39-fde9-4559-b018-4643c196d712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:22.615229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea24722-d4af-4a20-a752-65ac10fb92e0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:22.615443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50708f39-fde9-4559-b018-4643c196d712 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:22.620706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2895c75-488e-47dc-a194-89310bbc0256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:22.621571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2895c75-488e-47dc-a194-89310bbc0256 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:22.621948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2895c75-488e-47dc-a194-89310bbc0256 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:22.622158 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2895c75-488e-47dc-a194-89310bbc0256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:22.723114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2895c75-488e-47dc-a194-89310bbc0256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:22.725924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2895c75-488e-47dc-a194-89310bbc0256 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:22.743655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 947/1865] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:22.745060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2895c75-488e-47dc-a194-89310bbc0256 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:22.766371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2895c75-488e-47dc-a194-89310bbc0256 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:22.775666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 919/1866] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:22 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:22.776695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50708f39-fde9-4559-b018-4643c196d712 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:22.792834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49304734-bf62-4e89-950a-3e1caea194a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:22.793944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49304734-bf62-4e89-950a-3e1caea194a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:22.803053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49304734-bf62-4e89-950a-3e1caea194a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:22.803053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49304734-bf62-4e89-950a-3e1caea194a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:22.803053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49304734-bf62-4e89-950a-3e1caea194a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:22.803053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49304734-bf62-4e89-950a-3e1caea194a2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:22.853157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 948/1867] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:22.855516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49304734-bf62-4e89-950a-3e1caea194a2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:22.875989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49304734-bf62-4e89-950a-3e1caea194a2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:22.892210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50708f39-fde9-4559-b018-4643c196d712 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:22.898643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598b85a-e94c-4080-8617-c176d512ff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:22.899618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598b85a-e94c-4080-8617-c176d512ff30 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:22.900084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598b85a-e94c-4080-8617-c176d512ff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:22.900838 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598b85a-e94c-4080-8617-c176d512ff30 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:22.901638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598b85a-e94c-4080-8617-c176d512ff30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:22.904146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598b85a-e94c-4080-8617-c176d512ff30 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:22.982392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a87a2-fb9b-4ace-b105-f48f21e8a87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:22.985031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a87a2-fb9b-4ace-b105-f48f21e8a87d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:22.985520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a87a2-fb9b-4ace-b105-f48f21e8a87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:22.985978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a87a2-fb9b-4ace-b105-f48f21e8a87d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:22.987194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a87a2-fb9b-4ace-b105-f48f21e8a87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:22.990885 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a87a2-fb9b-4ace-b105-f48f21e8a87d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:23.015868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 949/1868] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:23.022845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a87a2-fb9b-4ace-b105-f48f21e8a87d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:23.028578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 920/1869] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:22 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:23.042411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598b85a-e94c-4080-8617-c176d512ff30 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:23.046777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a87a2-fb9b-4ace-b105-f48f21e8a87d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:23.052444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bae27b-de6f-4748-9758-69d8ec454a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:23.053313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bae27b-de6f-4748-9758-69d8ec454a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:23.053699 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bae27b-de6f-4748-9758-69d8ec454a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:23.054069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bae27b-de6f-4748-9758-69d8ec454a58 admin admin] PATH_INFO: `/v3/projects/8f3cedc9b3f3476d923c0feba995fb4c/users/a2d861415aaa43919e92880b09a26344/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:23.063335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598b85a-e94c-4080-8617-c176d512ff30 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:23.075041 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bae27b-de6f-4748-9758-69d8ec454a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3cedc9b3f3476d923c0feba995fb4c, user_id=a2d861415aaa43919e92880b09a26344, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:23.081161 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ad905-1e37-4cb1-97c7-8f47d0d701f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:23.082125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ad905-1e37-4cb1-97c7-8f47d0d701f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:23.082518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ad905-1e37-4cb1-97c7-8f47d0d701f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:23.082891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ad905-1e37-4cb1-97c7-8f47d0d701f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:23.083830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ad905-1e37-4cb1-97c7-8f47d0d701f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:23.084237 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bae27b-de6f-4748-9758-69d8ec454a58 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:23.085838 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ad905-1e37-4cb1-97c7-8f47d0d701f3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:23.102908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 921/1870] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:23.110130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ad905-1e37-4cb1-97c7-8f47d0d701f3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:23.126584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ad905-1e37-4cb1-97c7-8f47d0d701f3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:23.134328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19468e-c15b-487a-b89f-af23d9c24692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:23.135020 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19468e-c15b-487a-b89f-af23d9c24692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:23.135319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19468e-c15b-487a-b89f-af23d9c24692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:23.135576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19468e-c15b-487a-b89f-af23d9c24692 admin admin] PATH_INFO: `/v3/projects/136cb08bac4e4acf8e291f9823d5e067/users/645533df9015444d88b8607421fa4a28/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:23.165838 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19468e-c15b-487a-b89f-af23d9c24692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136cb08bac4e4acf8e291f9823d5e067, user_id=645533df9015444d88b8607421fa4a28, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:23.167279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19468e-c15b-487a-b89f-af23d9c24692 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:23.258794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 950/1871] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:23 2022] PUT /identity/v3/projects/8f3cedc9b3f3476d923c0feba995fb4c/users/a2d861415aaa43919e92880b09a26344/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:23.273103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6284-1b40-46df-a0f5-d90087583fc3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:23.275477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6284-1b40-46df-a0f5-d90087583fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:23.276823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6284-1b40-46df-a0f5-d90087583fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:23.295385 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 922/1872] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:23 2022] PUT /identity/v3/projects/136cb08bac4e4acf8e291f9823d5e067/users/645533df9015444d88b8607421fa4a28/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:23.301671 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19468e-c15b-487a-b89f-af23d9c24692 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:23.352625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8f6b6284-1b40-46df-a0f5-d90087583fc3 None None] MFA Rules not processed for user `a2d861415aaa43919e92880b09a26344`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:23.356023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8f6b6284-1b40-46df-a0f5-d90087583fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:23.506191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:23.510876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19468e-c15b-487a-b89f-af23d9c24692 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:23.519235 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d274ecc-bb03-411c-b054-fb764dc58361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:23.520106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d274ecc-bb03-411c-b054-fb764dc58361 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:23.520697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d274ecc-bb03-411c-b054-fb764dc58361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:23.520697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d274ecc-bb03-411c-b054-fb764dc58361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:23.521368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d274ecc-bb03-411c-b054-fb764dc58361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:23.523035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d274ecc-bb03-411c-b054-fb764dc58361 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:23.526968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 951/1873] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:23.536739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b6284-1b40-46df-a0f5-d90087583fc3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:23.549797 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 923/1874] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:23.553221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d274ecc-bb03-411c-b054-fb764dc58361 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:23.557521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b6284-1b40-46df-a0f5-d90087583fc3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:23.573266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d274ecc-bb03-411c-b054-fb764dc58361 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:23.578062 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cee069-703d-438a-aa35-506ea67dc386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:23.578662 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cee069-703d-438a-aa35-506ea67dc386 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:23.578662 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cee069-703d-438a-aa35-506ea67dc386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:23.578959 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cee069-703d-438a-aa35-506ea67dc386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:23.580488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cee069-703d-438a-aa35-506ea67dc386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:23.582811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cee069-703d-438a-aa35-506ea67dc386 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:23.583011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66698730-39fe-4977-ab6e-3ee6b7036601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:23.583903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66698730-39fe-4977-ab6e-3ee6b7036601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:23.584662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66698730-39fe-4977-ab6e-3ee6b7036601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:23.584662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66698730-39fe-4977-ab6e-3ee6b7036601 admin admin] PATH_INFO: `/v3/projects/136cb08bac4e4acf8e291f9823d5e067/users/645533df9015444d88b8607421fa4a28/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:23.586969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66698730-39fe-4977-ab6e-3ee6b7036601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136cb08bac4e4acf8e291f9823d5e067, user_id=645533df9015444d88b8607421fa4a28, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:23.592225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66698730-39fe-4977-ab6e-3ee6b7036601 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:23.625275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 924/1875] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:23 2022] PUT /identity/v3/projects/136cb08bac4e4acf8e291f9823d5e067/users/645533df9015444d88b8607421fa4a28/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:23.649869 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a529a8-a666-4a74-a9cb-294b1761f334 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:23.649869 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a529a8-a666-4a74-a9cb-294b1761f334 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:23.649869 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a529a8-a666-4a74-a9cb-294b1761f334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:23.711384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-91a529a8-a666-4a74-a9cb-294b1761f334 None None] MFA Rules not processed for user `645533df9015444d88b8607421fa4a28`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:23.713281 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-91a529a8-a666-4a74-a9cb-294b1761f334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:23.781811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 952/1876] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:23 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:23.783182 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cee069-703d-438a-aa35-506ea67dc386 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:23.924037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 925/1877] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:23.942473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a529a8-a666-4a74-a9cb-294b1761f334 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:23.944264 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-91a529a8-a666-4a74-a9cb-294b1761f334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:23.964135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cee069-703d-438a-aa35-506ea67dc386 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:23.971265 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00417a7-f4c9-44be-92fd-3dcad6f37d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:23.975169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00417a7-f4c9-44be-92fd-3dcad6f37d85 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:23.978087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00417a7-f4c9-44be-92fd-3dcad6f37d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:23.988832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00417a7-f4c9-44be-92fd-3dcad6f37d85 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:23.988832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00417a7-f4c9-44be-92fd-3dcad6f37d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:23.988832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00417a7-f4c9-44be-92fd-3dcad6f37d85 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:24.052216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a529a8-a666-4a74-a9cb-294b1761f334 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:24.146650 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a186d-b8ef-4a83-9449-19d1d1582d59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:24.147443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a186d-b8ef-4a83-9449-19d1d1582d59 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:24.147751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a186d-b8ef-4a83-9449-19d1d1582d59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:24.148030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a186d-b8ef-4a83-9449-19d1d1582d59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:24.193952 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 953/1878] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:23 2022] POST /identity/v3/users => generated 297 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:24.205463 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00417a7-f4c9-44be-92fd-3dcad6f37d85 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:24.224540 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00417a7-f4c9-44be-92fd-3dcad6f37d85 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:24.236535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e777ba-b6b7-4e1c-b0f4-7c5eb31c3323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:24.237472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e777ba-b6b7-4e1c-b0f4-7c5eb31c3323 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:24.237924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e777ba-b6b7-4e1c-b0f4-7c5eb31c3323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:24.238347 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e777ba-b6b7-4e1c-b0f4-7c5eb31c3323 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:24.239264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e777ba-b6b7-4e1c-b0f4-7c5eb31c3323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:24.241693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e777ba-b6b7-4e1c-b0f4-7c5eb31c3323 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:24.264640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 954/1879] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:46:24.269482 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e777ba-b6b7-4e1c-b0f4-7c5eb31c3323 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:24.289637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e777ba-b6b7-4e1c-b0f4-7c5eb31c3323 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:24.296453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64434fa6-661f-4739-b403-2a7405456906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:24.297642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64434fa6-661f-4739-b403-2a7405456906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:24.298098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64434fa6-661f-4739-b403-2a7405456906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:24.298472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64434fa6-661f-4739-b403-2a7405456906 admin admin] PATH_INFO: `/v3/projects/29eee31dd37f44f684819499c0826427/users/3df2d03c2a7b45dd98c4b424da8418c9/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:24.303408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a186d-b8ef-4a83-9449-19d1d1582d59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:24.309297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a186d-b8ef-4a83-9449-19d1d1582d59 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:24.322277 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64434fa6-661f-4739-b403-2a7405456906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29eee31dd37f44f684819499c0826427, user_id=3df2d03c2a7b45dd98c4b424da8418c9, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:24.326369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64434fa6-661f-4739-b403-2a7405456906 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:24.336646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 926/1880] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:46:24.368204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:24.456162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 955/1881] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:24 2022] PUT /identity/v3/projects/29eee31dd37f44f684819499c0826427/users/3df2d03c2a7b45dd98c4b424da8418c9/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:24.460655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a186d-b8ef-4a83-9449-19d1d1582d59 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:24.478208 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a186d-b8ef-4a83-9449-19d1d1582d59 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:24.591779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a829dfb-eafa-417b-bf39-751e6656f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:24.592286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a829dfb-eafa-417b-bf39-751e6656f953 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:24.592890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a829dfb-eafa-417b-bf39-751e6656f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:24.594087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a829dfb-eafa-417b-bf39-751e6656f953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:24.595503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a829dfb-eafa-417b-bf39-751e6656f953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:24.598681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a829dfb-eafa-417b-bf39-751e6656f953 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:24.629145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 927/1882] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:24.630562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64434fa6-661f-4739-b403-2a7405456906 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:24.654361 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64434fa6-661f-4739-b403-2a7405456906 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:24.666441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c06e3f-bd23-48bf-8e63-981ba0a9b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:24.668021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c06e3f-bd23-48bf-8e63-981ba0a9b5df admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:24.668634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c06e3f-bd23-48bf-8e63-981ba0a9b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:24.668977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c06e3f-bd23-48bf-8e63-981ba0a9b5df admin admin] PATH_INFO: `/v3/projects/29eee31dd37f44f684819499c0826427/users/3df2d03c2a7b45dd98c4b424da8418c9/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:24.672837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c06e3f-bd23-48bf-8e63-981ba0a9b5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=29eee31dd37f44f684819499c0826427, user_id=3df2d03c2a7b45dd98c4b424da8418c9, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:24.676135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c06e3f-bd23-48bf-8e63-981ba0a9b5df admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:24.700927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 956/1883] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:24 2022] PUT /identity/v3/projects/29eee31dd37f44f684819499c0826427/users/3df2d03c2a7b45dd98c4b424da8418c9/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:24.706199 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276a947-f51a-4ae4-ab41-796cb72cdbcd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:24.706389 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276a947-f51a-4ae4-ab41-796cb72cdbcd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:24.706665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276a947-f51a-4ae4-ab41-796cb72cdbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:24.768353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f276a947-f51a-4ae4-ab41-796cb72cdbcd None None] MFA Rules not processed for user `3df2d03c2a7b45dd98c4b424da8418c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:24.769515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f276a947-f51a-4ae4-ab41-796cb72cdbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:24.931771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 928/1884] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:24.959772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c06e3f-bd23-48bf-8e63-981ba0a9b5df admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:25.056057 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c06e3f-bd23-48bf-8e63-981ba0a9b5df admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:25.062207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee7537-5fdf-40c3-b11d-569eb11f1feb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:25.063517 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee7537-5fdf-40c3-b11d-569eb11f1feb service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:25.063854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee7537-5fdf-40c3-b11d-569eb11f1feb service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:25.064290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee7537-5fdf-40c3-b11d-569eb11f1feb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:25.080422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee7537-5fdf-40c3-b11d-569eb11f1feb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:25.081920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee7537-5fdf-40c3-b11d-569eb11f1feb service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:25.095949 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 957/1885] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:25.368360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276a947-f51a-4ae4-ab41-796cb72cdbcd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:25.381984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276a947-f51a-4ae4-ab41-796cb72cdbcd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:25.386037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a1567-7011-4c0f-8363-5b9c499488bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:25.386858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a1567-7011-4c0f-8363-5b9c499488bf service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:25.387187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a1567-7011-4c0f-8363-5b9c499488bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:25.387453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a1567-7011-4c0f-8363-5b9c499488bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:25.486808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a1567-7011-4c0f-8363-5b9c499488bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:25.489581 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a1567-7011-4c0f-8363-5b9c499488bf service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:25.506505 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 929/1886] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:25.690142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72e6fc-43f5-4eac-8489-6d8586943b59 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:25.691116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72e6fc-43f5-4eac-8489-6d8586943b59 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:25.691512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72e6fc-43f5-4eac-8489-6d8586943b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:25.728350 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4b72e6fc-43f5-4eac-8489-6d8586943b59 None None] MFA Rules not processed for user `7ce2b798833249db9cc0ff000c779ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:25.730178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4b72e6fc-43f5-4eac-8489-6d8586943b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:25.857203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 958/1887] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:26.161816 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:26.195793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a1567-7011-4c0f-8363-5b9c499488bf service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:26.366317 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a1567-7011-4c0f-8363-5b9c499488bf service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:26.384420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33323093-7b9c-40d4-a9ad-4d99527b35b7 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645533df9015444d88b8607421fa4a28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '136cb08bac4e4acf8e291f9823d5e067', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:26.386934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33323093-7b9c-40d4-a9ad-4d99527b35b7 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:26.390814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33323093-7b9c-40d4-a9ad-4d99527b35b7 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:26.391683 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33323093-7b9c-40d4-a9ad-4d99527b35b7 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:26.393154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33323093-7b9c-40d4-a9ad-4d99527b35b7 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:26.394013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33323093-7b9c-40d4-a9ad-4d99527b35b7 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:26.396594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33323093-7b9c-40d4-a9ad-4d99527b35b7 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:26.417988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 930/1888] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:46:26.424327 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72e6fc-43f5-4eac-8489-6d8586943b59 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:26.450265 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72e6fc-43f5-4eac-8489-6d8586943b59 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:26.460013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be674bc6-753f-4077-b0ec-01582946f8b8 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645533df9015444d88b8607421fa4a28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '136cb08bac4e4acf8e291f9823d5e067', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:26.460748 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674bc6-753f-4077-b0ec-01582946f8b8 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:26.461029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674bc6-753f-4077-b0ec-01582946f8b8 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:26.461486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674bc6-753f-4077-b0ec-01582946f8b8 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:26.462386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be674bc6-753f-4077-b0ec-01582946f8b8 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:26.465304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be674bc6-753f-4077-b0ec-01582946f8b8 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:26.652928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 959/1889] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:26 2022] POST /identity/v3/projects => generated 354 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:26.658451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33323093-7b9c-40d4-a9ad-4d99527b35b7 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:26.682750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33323093-7b9c-40d4-a9ad-4d99527b35b7 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:26.830868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374064d-ed2f-4be1-9e1e-35dbd803aba0 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645533df9015444d88b8607421fa4a28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '136cb08bac4e4acf8e291f9823d5e067', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:26.831556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374064d-ed2f-4be1-9e1e-35dbd803aba0 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:26.831976 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374064d-ed2f-4be1-9e1e-35dbd803aba0 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:26.832352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374064d-ed2f-4be1-9e1e-35dbd803aba0 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:26.833225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374064d-ed2f-4be1-9e1e-35dbd803aba0 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:26.833676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374064d-ed2f-4be1-9e1e-35dbd803aba0 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:26.836758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374064d-ed2f-4be1-9e1e-35dbd803aba0 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:26.855186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 931/1890] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:46:26.955926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be674bc6-753f-4077-b0ec-01582946f8b8 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:26.966623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374064d-ed2f-4be1-9e1e-35dbd803aba0 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:26.973958 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be674bc6-753f-4077-b0ec-01582946f8b8 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:26.981244 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645533df9015444d88b8607421fa4a28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '136cb08bac4e4acf8e291f9823d5e067', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:26.982209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:26.983005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:26.984594 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] PATH_INFO: `/v3/projects/b8b5f78cf2ec4eeb8d425887e0d014df` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:26.986634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b8b5f78cf2ec4eeb8d425887e0d014df)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:26.990962 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:27.109985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374064d-ed2f-4be1-9e1e-35dbd803aba0 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:27.125683 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:27.126844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:27.127297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:27.127845 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] PATH_INFO: `/v3/users/a2d861415aaa43919e92880b09a26344` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:27.129597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d861415aaa43919e92880b09a26344)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:27.132513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:27.208854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b5f78cf2ec4eeb8d425887e0d014df', 'request_id': 'req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:27.221558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b5f78cf2ec4eeb8d425887e0d014df', 'request_id': 'req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:27.357068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b5f78cf2ec4eeb8d425887e0d014df', 'request_id': 'req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:27.379031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] The token cache is being invalidate because project b8b5f78cf2ec4eeb8d425887e0d014df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:27.379410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:27.380556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8e13db9d-0b03-42a1-b955-1f6a50bd9f08 tempest-VolumeQuotaClassesTest-1762472059 tempest-VolumeQuotaClassesTest-1762472059-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:27.383133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 960/1891] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:26 2022] DELETE /identity/v3/projects/b8b5f78cf2ec4eeb8d425887e0d014df => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:27.477913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d861415aaa43919e92880b09a26344'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:27.479604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d861415aaa43919e92880b09a26344'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:27.506876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d861415aaa43919e92880b09a26344'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:27.526269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d861415aaa43919e92880b09a26344'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:27.528369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d861415aaa43919e92880b09a26344'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:27.544738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:27.654489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 932/1892] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:26 2022] DELETE /identity/v3/users/a2d861415aaa43919e92880b09a26344 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:27.658814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aab8a1-3c5d-43a1-9822-a31d74d0608b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:27.659286 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aab8a1-3c5d-43a1-9822-a31d74d0608b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:27.659704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aab8a1-3c5d-43a1-9822-a31d74d0608b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:27.691930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c7aab8a1-3c5d-43a1-9822-a31d74d0608b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:27.691930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c7aab8a1-3c5d-43a1-9822-a31d74d0608b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:27.788496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 961/1893] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:27.805437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:27.807813 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:27.933519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8b9a7-0a60-41ca-924a-aced83ddb760 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:27.939297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff46c4-13a7-40be-a99a-f63da89a1cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:27.940491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff46c4-13a7-40be-a99a-f63da89a1cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:27.940982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff46c4-13a7-40be-a99a-f63da89a1cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:27.941462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff46c4-13a7-40be-a99a-f63da89a1cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:27.958679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff46c4-13a7-40be-a99a-f63da89a1cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:27.960213 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff46c4-13a7-40be-a99a-f63da89a1cb9 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:27.972622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 933/1894] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:28.480324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aab8a1-3c5d-43a1-9822-a31d74d0608b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:28.483945 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c7aab8a1-3c5d-43a1-9822-a31d74d0608b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:28.504447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aab8a1-3c5d-43a1-9822-a31d74d0608b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:28.515566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afff38-b53a-4413-83bf-764095012e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:28.517843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afff38-b53a-4413-83bf-764095012e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:28.517843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afff38-b53a-4413-83bf-764095012e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:28.517843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afff38-b53a-4413-83bf-764095012e43 admin admin] PATH_INFO: `/v3/users/302183a2a4cb4bb1af33f70cfd874777` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:28.519747 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afff38-b53a-4413-83bf-764095012e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302183a2a4cb4bb1af33f70cfd874777)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:28.524341 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afff38-b53a-4413-83bf-764095012e43 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:28.710635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff46c4-13a7-40be-a99a-f63da89a1cb9 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:28.711864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-53ff46c4-13a7-40be-a99a-f63da89a1cb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:28.750555 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff46c4-13a7-40be-a99a-f63da89a1cb9 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:28.762345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:28.763591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:28.764848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:28.765336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] PATH_INFO: `/v3/projects/8f3cedc9b3f3476d923c0feba995fb4c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:28.770326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:28.772732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3cedc9b3f3476d923c0feba995fb4c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:28.779539 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:28.831169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-55afff38-b53a-4413-83bf-764095012e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302183a2a4cb4bb1af33f70cfd874777'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:28.831169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-55afff38-b53a-4413-83bf-764095012e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302183a2a4cb4bb1af33f70cfd874777'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:28.968587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-55afff38-b53a-4413-83bf-764095012e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302183a2a4cb4bb1af33f70cfd874777'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:28.969818 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-55afff38-b53a-4413-83bf-764095012e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302183a2a4cb4bb1af33f70cfd874777'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:28.970795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-55afff38-b53a-4413-83bf-764095012e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302183a2a4cb4bb1af33f70cfd874777'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:28.992768 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 962/1895] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:28 2022] DELETE /identity/v3/users/302183a2a4cb4bb1af33f70cfd874777 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:29.000553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4250765-a98a-4d35-a676-0b576b0f59e1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:29.001066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4250765-a98a-4d35-a676-0b576b0f59e1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:29.003080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4250765-a98a-4d35-a676-0b576b0f59e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:29.040310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d4250765-a98a-4d35-a676-0b576b0f59e1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:29.042668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d4250765-a98a-4d35-a676-0b576b0f59e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:29.055181 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3cedc9b3f3476d923c0feba995fb4c', 'request_id': 'req-28e5578d-adce-4f51-b419-25b766f059dd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:29.072737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3cedc9b3f3476d923c0feba995fb4c', 'request_id': 'req-28e5578d-adce-4f51-b419-25b766f059dd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:29.141482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3cedc9b3f3476d923c0feba995fb4c', 'request_id': 'req-28e5578d-adce-4f51-b419-25b766f059dd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:29.143691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 963/1896] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:29.177120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4250765-a98a-4d35-a676-0b576b0f59e1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:29.180268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d4250765-a98a-4d35-a676-0b576b0f59e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:29.181443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] The token cache is being invalidate because project 8f3cedc9b3f3476d923c0feba995fb4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:29.182217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:29.183564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:29.187815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 934/1897] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:28 2022] DELETE /identity/v3/projects/8f3cedc9b3f3476d923c0feba995fb4c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:29.203442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:29.222509 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:29.260471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5578d-adce-4f51-b419-25b766f059dd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:29.319016 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4250765-a98a-4d35-a676-0b576b0f59e1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:29.321332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:29.322335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:29.329789 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:29.329789 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] PATH_INFO: `/v3/users/3df2d03c2a7b45dd98c4b424da8418c9` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:29.329789 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df2d03c2a7b45dd98c4b424da8418c9)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:29.330441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549b803-91eb-4e3a-a939-dbd66cb5c23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:29.330441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549b803-91eb-4e3a-a939-dbd66cb5c23e service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:29.330441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549b803-91eb-4e3a-a939-dbd66cb5c23e service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:29.330441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549b803-91eb-4e3a-a939-dbd66cb5c23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:29.332060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:29.333175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d549b803-91eb-4e3a-a939-dbd66cb5c23e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:29.393395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549b803-91eb-4e3a-a939-dbd66cb5c23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:29.395682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549b803-91eb-4e3a-a939-dbd66cb5c23e service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:29.432743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 964/1898] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:29.701737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df2d03c2a7b45dd98c4b424da8418c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:29.702811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df2d03c2a7b45dd98c4b424da8418c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:29.722414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df2d03c2a7b45dd98c4b424da8418c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:29.734497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df2d03c2a7b45dd98c4b424da8418c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:29.735382 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df2d03c2a7b45dd98c4b424da8418c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:29.863791 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 935/1899] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:29 2022] DELETE /identity/v3/users/3df2d03c2a7b45dd98c4b424da8418c9 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:30.253032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:30.733340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549b803-91eb-4e3a-a939-dbd66cb5c23e service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:30.765855 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549b803-91eb-4e3a-a939-dbd66cb5c23e service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:30.867868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f195cb-7062-423a-8483-98c81b569e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:30.868994 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f195cb-7062-423a-8483-98c81b569e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:30.869519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f195cb-7062-423a-8483-98c81b569e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:30.869999 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f195cb-7062-423a-8483-98c81b569e7a admin admin] PATH_INFO: `/v3/projects/29eee31dd37f44f684819499c0826427` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:30.872451 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f195cb-7062-423a-8483-98c81b569e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=29eee31dd37f44f684819499c0826427)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:30.885469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f195cb-7062-423a-8483-98c81b569e7a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:31.063421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39f195cb-7062-423a-8483-98c81b569e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29eee31dd37f44f684819499c0826427', 'request_id': 'req-39f195cb-7062-423a-8483-98c81b569e7a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:31.073628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39f195cb-7062-423a-8483-98c81b569e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29eee31dd37f44f684819499c0826427', 'request_id': 'req-39f195cb-7062-423a-8483-98c81b569e7a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:31.263550 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:31.266270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:31.284243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c94623-c04b-4185-bfa0-3b2feafb4ca6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:31.288281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39f195cb-7062-423a-8483-98c81b569e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29eee31dd37f44f684819499c0826427', 'request_id': 'req-39f195cb-7062-423a-8483-98c81b569e7a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:31.306077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39f195cb-7062-423a-8483-98c81b569e7a admin admin] The token cache is being invalidate because project 29eee31dd37f44f684819499c0826427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:31.306804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39f195cb-7062-423a-8483-98c81b569e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:31.308044 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39f195cb-7062-423a-8483-98c81b569e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:31.317106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 965/1900] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:30 2022] DELETE /identity/v3/projects/29eee31dd37f44f684819499c0826427 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:31.319694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d4073-9770-4fc4-94a1-1eeda1fa7592 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:31.320531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d4073-9770-4fc4-94a1-1eeda1fa7592 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:31.320927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d4073-9770-4fc4-94a1-1eeda1fa7592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:31.368929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dd6d4073-9770-4fc4-94a1-1eeda1fa7592 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:31.371215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dd6d4073-9770-4fc4-94a1-1eeda1fa7592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:31.425134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:31.425998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:31.426493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:31.426903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] PATH_INFO: `/v3/users/18f49d8b1b8845efbeaba3e6d92c7bae` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:31.428961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f49d8b1b8845efbeaba3e6d92c7bae)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:31.432587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:31.517039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 966/1901] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:31.518504 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d4073-9770-4fc4-94a1-1eeda1fa7592 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:31.521570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dd6d4073-9770-4fc4-94a1-1eeda1fa7592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:31.541167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d4073-9770-4fc4-94a1-1eeda1fa7592 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:31.547045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:31.550204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:31.551336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:31.551919 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:31.555348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1 admin admin] PATH_INFO: `/v3/projects/b8351ec2e63744a6ac345a06de6475af` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:31.555348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8351ec2e63744a6ac345a06de6475af)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:31.557786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:31.784103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f49d8b1b8845efbeaba3e6d92c7bae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:31.784870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f49d8b1b8845efbeaba3e6d92c7bae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:31.807989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8351ec2e63744a6ac345a06de6475af', 'request_id': 'req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:31.809299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f49d8b1b8845efbeaba3e6d92c7bae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:31.831860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8351ec2e63744a6ac345a06de6475af', 'request_id': 'req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:31.837704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f49d8b1b8845efbeaba3e6d92c7bae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:31.843741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f49d8b1b8845efbeaba3e6d92c7bae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:32.035115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8351ec2e63744a6ac345a06de6475af', 'request_id': 'req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:32.058593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1 admin admin] The token cache is being invalidate because project b8351ec2e63744a6ac345a06de6475af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:32.059659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:32.061104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8f1ed6c9-8665-4e6f-a144-09c9463d26e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:32.069392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 967/1902] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:31 2022] DELETE /identity/v3/projects/b8351ec2e63744a6ac345a06de6475af => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:32.072243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ac0f3-3262-463e-9dea-e95879e5b80b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:32.075296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ac0f3-3262-463e-9dea-e95879e5b80b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:32.075296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ac0f3-3262-463e-9dea-e95879e5b80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:32.107249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c82ac0f3-3262-463e-9dea-e95879e5b80b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:32.110125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c82ac0f3-3262-463e-9dea-e95879e5b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:32.160092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 936/1903] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:31 2022] DELETE /identity/v3/users/18f49d8b1b8845efbeaba3e6d92c7bae => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:32.162564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:32.166037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:32.261898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 968/1904] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:32.264374 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116a559-c560-4109-a9d2-0149cf87011c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:32.265270 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116a559-c560-4109-a9d2-0149cf87011c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:32.266821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116a559-c560-4109-a9d2-0149cf87011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:32.312163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8116a559-c560-4109-a9d2-0149cf87011c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:32.313669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f46f29-25af-42d2-8f0d-59258e472d3f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:32.314147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8116a559-c560-4109-a9d2-0149cf87011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:32.323461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:32.325117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:32.325742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:32.326329 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] PATH_INFO: `/v3/users/645533df9015444d88b8607421fa4a28` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:32.326615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 969/1905] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:32.328072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116a559-c560-4109-a9d2-0149cf87011c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:32.329688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=645533df9015444d88b8607421fa4a28)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:32.334742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:32.345325 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116a559-c560-4109-a9d2-0149cf87011c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:32.353860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1de7ba-7fea-4a82-836c-7dfa22146887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:32.355288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1de7ba-7fea-4a82-836c-7dfa22146887 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:32.355288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1de7ba-7fea-4a82-836c-7dfa22146887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:32.355795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1de7ba-7fea-4a82-836c-7dfa22146887 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:32.356639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1de7ba-7fea-4a82-836c-7dfa22146887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:32.357111 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1de7ba-7fea-4a82-836c-7dfa22146887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:32.360157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1de7ba-7fea-4a82-836c-7dfa22146887 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:32.382051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 970/1906] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:46:32.383268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1de7ba-7fea-4a82-836c-7dfa22146887 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:32.389964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9d1de7ba-7fea-4a82-836c-7dfa22146887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:32.488245 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1de7ba-7fea-4a82-836c-7dfa22146887 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:32.500882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5372c4-7612-43aa-a5cf-ff9f6b20a7ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:32.502263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5372c4-7612-43aa-a5cf-ff9f6b20a7ad service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:32.502772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5372c4-7612-43aa-a5cf-ff9f6b20a7ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:32.503362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5372c4-7612-43aa-a5cf-ff9f6b20a7ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:32.522337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5372c4-7612-43aa-a5cf-ff9f6b20a7ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:32.524106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5372c4-7612-43aa-a5cf-ff9f6b20a7ad service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:32.539809 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 971/1907] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:32.549439 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5372c4-7612-43aa-a5cf-ff9f6b20a7ad service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:32.574598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5372c4-7612-43aa-a5cf-ff9f6b20a7ad service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:32.584113 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19780f94-9e48-4a8a-9b28-744ca46474d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:32.585027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19780f94-9e48-4a8a-9b28-744ca46474d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:32.585388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19780f94-9e48-4a8a-9b28-744ca46474d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:32.585770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19780f94-9e48-4a8a-9b28-744ca46474d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:32.587127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19780f94-9e48-4a8a-9b28-744ca46474d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:32.589605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19780f94-9e48-4a8a-9b28-744ca46474d3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:32.706462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645533df9015444d88b8607421fa4a28'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:32.707655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645533df9015444d88b8607421fa4a28'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:32.726982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645533df9015444d88b8607421fa4a28'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:32.737362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645533df9015444d88b8607421fa4a28'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:32.738139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645533df9015444d88b8607421fa4a28'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:32.816545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 972/1908] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:32 2022] POST /identity/v3/projects => generated 385 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:32.822689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19780f94-9e48-4a8a-9b28-744ca46474d3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:32.836503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 937/1909] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:32 2022] DELETE /identity/v3/users/645533df9015444d88b8607421fa4a28 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:32.841321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-19780f94-9e48-4a8a-9b28-744ca46474d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:32.976030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19780f94-9e48-4a8a-9b28-744ca46474d3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:33.032371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:33.103392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56c0d3-891e-4aa9-9888-d0593d0255b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:33.105971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56c0d3-891e-4aa9-9888-d0593d0255b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:33.107112 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56c0d3-891e-4aa9-9888-d0593d0255b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:33.108610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56c0d3-891e-4aa9-9888-d0593d0255b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:33.109932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56c0d3-891e-4aa9-9888-d0593d0255b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:33.114167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56c0d3-891e-4aa9-9888-d0593d0255b0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:33.198031 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:33.312037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 973/1910] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:32 2022] POST /identity/v3/users => generated 293 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:33.317326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:33.339603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73246ba9-f457-4617-9802-faaa03ec7c02 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:33.364654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d40d8-9031-42ad-a294-7a4f4dc511b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:33.366418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d40d8-9031-42ad-a294-7a4f4dc511b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:33.366418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d40d8-9031-42ad-a294-7a4f4dc511b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:33.366828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d40d8-9031-42ad-a294-7a4f4dc511b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:33.368566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d40d8-9031-42ad-a294-7a4f4dc511b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:33.374327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d40d8-9031-42ad-a294-7a4f4dc511b8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:33.402573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 938/1911] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:33.410734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56c0d3-891e-4aa9-9888-d0593d0255b0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:33.434993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56c0d3-891e-4aa9-9888-d0593d0255b0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:33.441508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a0e10-2d3a-4af1-b43c-1bbb80f0a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:33.442121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a0e10-2d3a-4af1-b43c-1bbb80f0a234 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:33.442399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a0e10-2d3a-4af1-b43c-1bbb80f0a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:33.442705 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a0e10-2d3a-4af1-b43c-1bbb80f0a234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:33.443318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a0e10-2d3a-4af1-b43c-1bbb80f0a234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:33.445096 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a0e10-2d3a-4af1-b43c-1bbb80f0a234 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:33.463768 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 974/1912] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:33.466189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d40d8-9031-42ad-a294-7a4f4dc511b8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:33.479140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d40d8-9031-42ad-a294-7a4f4dc511b8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:33.488450 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e524f4-9796-4977-b7bc-8d4d21f8cdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:33.489291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e524f4-9796-4977-b7bc-8d4d21f8cdb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:33.489834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e524f4-9796-4977-b7bc-8d4d21f8cdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:33.490163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e524f4-9796-4977-b7bc-8d4d21f8cdb7 admin admin] PATH_INFO: `/v3/projects/806ac9e6e5084f619dcf41962c3e8625/users/9c9f84c12c4049eebe2db84098f129c3/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:33.523310 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e524f4-9796-4977-b7bc-8d4d21f8cdb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806ac9e6e5084f619dcf41962c3e8625, user_id=9c9f84c12c4049eebe2db84098f129c3, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:33.530705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e524f4-9796-4977-b7bc-8d4d21f8cdb7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:33.613149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a0e10-2d3a-4af1-b43c-1bbb80f0a234 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:33.619947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-255a0e10-2d3a-4af1-b43c-1bbb80f0a234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:33.641939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 939/1913] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:33 2022] PUT /identity/v3/projects/806ac9e6e5084f619dcf41962c3e8625/users/9c9f84c12c4049eebe2db84098f129c3/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:33.650866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a0e10-2d3a-4af1-b43c-1bbb80f0a234 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:33.668829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c01cf8-4bb4-4f64-b9f4-55e19005b191 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:33.671375 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c01cf8-4bb4-4f64-b9f4-55e19005b191 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:33.672141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c01cf8-4bb4-4f64-b9f4-55e19005b191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:33.783354 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-59c01cf8-4bb4-4f64-b9f4-55e19005b191 None None] MFA Rules not processed for user `9c9f84c12c4049eebe2db84098f129c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:33.785557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-59c01cf8-4bb4-4f64-b9f4-55e19005b191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:33.898899 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:33.901219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:33.907335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:33.910313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] PATH_INFO: `/v3/projects/769d68e93e874bd7a5a6e4fe04da84fc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:33.920836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] RBAC: Authorizing `identity:delete_project(project_id=769d68e93e874bd7a5a6e4fe04da84fc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:33.935274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:34.110889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 940/1914] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:34.119900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c01cf8-4bb4-4f64-b9f4-55e19005b191 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:34.144599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c01cf8-4bb4-4f64-b9f4-55e19005b191 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:34.159834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd63970-0663-4147-88d7-4a781a11217a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:34.160794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd63970-0663-4147-88d7-4a781a11217a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:34.161251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd63970-0663-4147-88d7-4a781a11217a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:34.161726 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd63970-0663-4147-88d7-4a781a11217a admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:34.162857 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd63970-0663-4147-88d7-4a781a11217a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:34.173104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd63970-0663-4147-88d7-4a781a11217a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:34.222528 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769d68e93e874bd7a5a6e4fe04da84fc', 'request_id': 'req-fe0696c8-0a62-468c-895d-cad87607216b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:34.232973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769d68e93e874bd7a5a6e4fe04da84fc', 'request_id': 'req-fe0696c8-0a62-468c-895d-cad87607216b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:34.325603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 941/1915] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:34 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:34.330679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd63970-0663-4147-88d7-4a781a11217a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:34.334098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769d68e93e874bd7a5a6e4fe04da84fc', 'request_id': 'req-fe0696c8-0a62-468c-895d-cad87607216b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:34.348634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5fd63970-0663-4147-88d7-4a781a11217a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:34.372593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] The token cache is being invalidate because project 769d68e93e874bd7a5a6e4fe04da84fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:34.373953 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:34.375596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:34.383339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 975/1916] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:33 2022] DELETE /identity/v3/projects/769d68e93e874bd7a5a6e4fe04da84fc => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:34.383339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:34.395836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:34.534900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd63970-0663-4147-88d7-4a781a11217a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:34.549144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:34.549977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:34.550365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:34.550741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] PATH_INFO: `/v3/projects/136cb08bac4e4acf8e291f9823d5e067` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:34.552306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=136cb08bac4e4acf8e291f9823d5e067)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:34.554467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:34.637712 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0696c8-0a62-468c-895d-cad87607216b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:34.648430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea28d2d-e052-4149-8a07-4f4cd3b048d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:34.649804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea28d2d-e052-4149-8a07-4f4cd3b048d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:34.650353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea28d2d-e052-4149-8a07-4f4cd3b048d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:34.651098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea28d2d-e052-4149-8a07-4f4cd3b048d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:34.653484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea28d2d-e052-4149-8a07-4f4cd3b048d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:34.659073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea28d2d-e052-4149-8a07-4f4cd3b048d9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:34.734029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136cb08bac4e4acf8e291f9823d5e067', 'request_id': 'req-799b25da-6b7e-48a0-90e7-4f8bf7891f51'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:34.756264 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136cb08bac4e4acf8e291f9823d5e067', 'request_id': 'req-799b25da-6b7e-48a0-90e7-4f8bf7891f51'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:34.790319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 976/1917] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:34 2022] POST /identity/v3/users => generated 299 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:34.792126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea28d2d-e052-4149-8a07-4f4cd3b048d9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:34.801061 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5ea28d2d-e052-4149-8a07-4f4cd3b048d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:34.834316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea28d2d-e052-4149-8a07-4f4cd3b048d9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:34.853029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136cb08bac4e4acf8e291f9823d5e067', 'request_id': 'req-799b25da-6b7e-48a0-90e7-4f8bf7891f51'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:34.895259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] The token cache is being invalidate because project 136cb08bac4e4acf8e291f9823d5e067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:34.895684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:34.901259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:34.910308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 942/1918] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:34 2022] DELETE /identity/v3/projects/136cb08bac4e4acf8e291f9823d5e067 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:34.919266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:34.927669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:34.968997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:35.011912 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:35.013138 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:35.013654 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:35.014410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] PATH_INFO: `/v3/users/5f3c1ddb79f44c2786de52dc7cde5972` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:35.016966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3c1ddb79f44c2786de52dc7cde5972)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:35.021626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:35.149752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b25da-6b7e-48a0-90e7-4f8bf7891f51 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:35.157253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feafa04-39e2-46b0-8eab-7751ad4d8a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:35.157997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feafa04-39e2-46b0-8eab-7751ad4d8a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:35.158342 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feafa04-39e2-46b0-8eab-7751ad4d8a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:35.158682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feafa04-39e2-46b0-8eab-7751ad4d8a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:35.159467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feafa04-39e2-46b0-8eab-7751ad4d8a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:35.161249 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feafa04-39e2-46b0-8eab-7751ad4d8a4e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:35.178106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 943/1919] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:35.181982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a72c2-b244-4e82-a0af-fc905d9fcc07 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:35.181982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a72c2-b244-4e82-a0af-fc905d9fcc07 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:35.181982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a72c2-b244-4e82-a0af-fc905d9fcc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:35.205824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:35.223503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e94a72c2-b244-4e82-a0af-fc905d9fcc07 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:35.226875 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e94a72c2-b244-4e82-a0af-fc905d9fcc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:35.249771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 944/1920] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:35.250996 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a72c2-b244-4e82-a0af-fc905d9fcc07 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:35.266007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a72c2-b244-4e82-a0af-fc905d9fcc07 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:35.275371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443fff7-bad1-4be6-b83d-beb9a564e84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:35.277171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443fff7-bad1-4be6-b83d-beb9a564e84f admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:35.277171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443fff7-bad1-4be6-b83d-beb9a564e84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:35.277649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443fff7-bad1-4be6-b83d-beb9a564e84f admin admin] PATH_INFO: `/v3/projects/88eb9e95b7d74fb282593afac9663fa0/users/2e7b062185624536a188064754853f1f/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:35.325868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443fff7-bad1-4be6-b83d-beb9a564e84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88eb9e95b7d74fb282593afac9663fa0, user_id=2e7b062185624536a188064754853f1f, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:35.328801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443fff7-bad1-4be6-b83d-beb9a564e84f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:35.421049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3c1ddb79f44c2786de52dc7cde5972'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:35.450173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3c1ddb79f44c2786de52dc7cde5972'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:35.641522 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 945/1921] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:35 2022] PUT /identity/v3/projects/88eb9e95b7d74fb282593afac9663fa0/users/2e7b062185624536a188064754853f1f/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:35.643235 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bfad7-c8ef-46ae-8b1e-0570cceae06e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:35.643606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bfad7-c8ef-46ae-8b1e-0570cceae06e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:35.643932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bfad7-c8ef-46ae-8b1e-0570cceae06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:35.665098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3c1ddb79f44c2786de52dc7cde5972'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:35.671926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3c1ddb79f44c2786de52dc7cde5972'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:35.671926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3c1ddb79f44c2786de52dc7cde5972'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:35.672847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a62bfad7-c8ef-46ae-8b1e-0570cceae06e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:35.674254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a62bfad7-c8ef-46ae-8b1e-0570cceae06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:35.703194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 977/1922] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:34 2022] DELETE /identity/v3/users/5f3c1ddb79f44c2786de52dc7cde5972 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:35.705115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:35.707222 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:35.798440 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 946/1923] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:35.802592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bfad7-c8ef-46ae-8b1e-0570cceae06e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:35.834939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bfad7-c8ef-46ae-8b1e-0570cceae06e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:35.852441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0286c3e-1840-4d74-981e-06444b673fba admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:35.852695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acf329-3d00-463a-be75-f2e28d927e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:35.853579 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acf329-3d00-463a-be75-f2e28d927e31 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:35.856154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acf329-3d00-463a-be75-f2e28d927e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:35.856750 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acf329-3d00-463a-be75-f2e28d927e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:35.858100 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acf329-3d00-463a-be75-f2e28d927e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:35.858667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acf329-3d00-463a-be75-f2e28d927e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:35.864813 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acf329-3d00-463a-be75-f2e28d927e31 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:35.867819 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca70e5-5b84-4197-9021-07c2d8f30d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:35.872982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca70e5-5b84-4197-9021-07c2d8f30d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:35.872982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca70e5-5b84-4197-9021-07c2d8f30d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:35.872982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca70e5-5b84-4197-9021-07c2d8f30d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:35.883000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca70e5-5b84-4197-9021-07c2d8f30d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:35.888426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 947/1924] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:46:35.893497 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca70e5-5b84-4197-9021-07c2d8f30d2a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:35.897259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acf329-3d00-463a-be75-f2e28d927e31 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:35.919577 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acf329-3d00-463a-be75-f2e28d927e31 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:35.930498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbae483-65ed-4103-9865-84b236cc8247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:35.931660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbae483-65ed-4103-9865-84b236cc8247 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:35.932309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbae483-65ed-4103-9865-84b236cc8247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:35.932896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbae483-65ed-4103-9865-84b236cc8247 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:35.934365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbae483-65ed-4103-9865-84b236cc8247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:35.940413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 978/1925] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:35.943206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca70e5-5b84-4197-9021-07c2d8f30d2a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:35.944230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbae483-65ed-4103-9865-84b236cc8247 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:35.972045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca70e5-5b84-4197-9021-07c2d8f30d2a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:35.982189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330850a-9719-4f62-b733-9f72f42c67ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:35.984952 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330850a-9719-4f62-b733-9f72f42c67ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:35.985795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330850a-9719-4f62-b733-9f72f42c67ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:35.986526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330850a-9719-4f62-b733-9f72f42c67ce admin admin] PATH_INFO: `/v3/projects/88eb9e95b7d74fb282593afac9663fa0/users/2e7b062185624536a188064754853f1f/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:35.994670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330850a-9719-4f62-b733-9f72f42c67ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=88eb9e95b7d74fb282593afac9663fa0, user_id=2e7b062185624536a188064754853f1f, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:36.003374 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330850a-9719-4f62-b733-9f72f42c67ce admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:36.051387 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 979/1926] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:35 2022] PUT /identity/v3/projects/88eb9e95b7d74fb282593afac9663fa0/users/2e7b062185624536a188064754853f1f/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:36.051387 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8563a76-a919-45f0-9861-84df54716b7d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:36.051387 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8563a76-a919-45f0-9861-84df54716b7d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:36.051947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8563a76-a919-45f0-9861-84df54716b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:36.124816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a8563a76-a919-45f0-9861-84df54716b7d None None] MFA Rules not processed for user `2e7b062185624536a188064754853f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:36.127302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a8563a76-a919-45f0-9861-84df54716b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:36.161889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 948/1927] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:35 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:36.169167 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbae483-65ed-4103-9865-84b236cc8247 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:36.321154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 980/1928] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:36.367255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8563a76-a919-45f0-9861-84df54716b7d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:36.369394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a8563a76-a919-45f0-9861-84df54716b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:36.418387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbae483-65ed-4103-9865-84b236cc8247 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:36.429661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c9d8a-75d8-41a9-a070-65d39213f850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:36.431376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c9d8a-75d8-41a9-a070-65d39213f850 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:36.432790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c9d8a-75d8-41a9-a070-65d39213f850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:36.433498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c9d8a-75d8-41a9-a070-65d39213f850 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:36.434647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c9d8a-75d8-41a9-a070-65d39213f850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:36.435355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:36.442028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c9d8a-75d8-41a9-a070-65d39213f850 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:36.520849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8563a76-a919-45f0-9861-84df54716b7d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:36.616508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 949/1929] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:36 2022] POST /identity/v3/users => generated 286 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:36.622709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c9d8a-75d8-41a9-a070-65d39213f850 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:36.636914 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2278d57-fbe9-4aad-a481-2e01e8e147c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:36.637420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278d57-fbe9-4aad-a481-2e01e8e147c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:36.637604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278d57-fbe9-4aad-a481-2e01e8e147c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:36.637912 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278d57-fbe9-4aad-a481-2e01e8e147c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:36.645726 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d2278d57-fbe9-4aad-a481-2e01e8e147c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:36.647403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c9d8a-75d8-41a9-a070-65d39213f850 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:36.658408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91a307-0aa0-4b63-b487-9d2251d878bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:36.659603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91a307-0aa0-4b63-b487-9d2251d878bd admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:36.660118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91a307-0aa0-4b63-b487-9d2251d878bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:36.660288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91a307-0aa0-4b63-b487-9d2251d878bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:36.661201 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91a307-0aa0-4b63-b487-9d2251d878bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:36.668000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91a307-0aa0-4b63-b487-9d2251d878bd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:36.696996 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 950/1930] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:36.696996 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91a307-0aa0-4b63-b487-9d2251d878bd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:36.713237 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91a307-0aa0-4b63-b487-9d2251d878bd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:36.723432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb42ad5-0d01-4cb0-9fd8-fd29322ac7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:36.724112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb42ad5-0d01-4cb0-9fd8-fd29322ac7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:36.724447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb42ad5-0d01-4cb0-9fd8-fd29322ac7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:36.724653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb42ad5-0d01-4cb0-9fd8-fd29322ac7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:36.725532 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb42ad5-0d01-4cb0-9fd8-fd29322ac7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:36.730319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb42ad5-0d01-4cb0-9fd8-fd29322ac7a6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:36.749528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 951/1931] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:36.754841 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb42ad5-0d01-4cb0-9fd8-fd29322ac7a6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:36.770808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb42ad5-0d01-4cb0-9fd8-fd29322ac7a6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:36.778840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1eddb8-2fcb-4dae-9963-22138d12d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:36.780652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eddb8-2fcb-4dae-9963-22138d12d6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:36.780959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eddb8-2fcb-4dae-9963-22138d12d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:36.781706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eddb8-2fcb-4dae-9963-22138d12d6d7 admin admin] PATH_INFO: `/v3/projects/e271d2351ea24f7eb3a6edf2f89dd17e/users/2b38cc0d7c5d43008599050a0d64989c/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:36.811590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1eddb8-2fcb-4dae-9963-22138d12d6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e271d2351ea24f7eb3a6edf2f89dd17e, user_id=2b38cc0d7c5d43008599050a0d64989c, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:36.817957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1eddb8-2fcb-4dae-9963-22138d12d6d7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:36.821777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2278d57-fbe9-4aad-a481-2e01e8e147c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:36.823757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2278d57-fbe9-4aad-a481-2e01e8e147c6 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:36.858081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 981/1932] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:37.034168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 952/1933] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:36 2022] PUT /identity/v3/projects/e271d2351ea24f7eb3a6edf2f89dd17e/users/2b38cc0d7c5d43008599050a0d64989c/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:37.039702 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa365696-6fb9-4192-bcb2-400ad0c29268 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:37.040627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa365696-6fb9-4192-bcb2-400ad0c29268 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:37.041366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa365696-6fb9-4192-bcb2-400ad0c29268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:37.099489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-fa365696-6fb9-4192-bcb2-400ad0c29268 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:37.101486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fa365696-6fb9-4192-bcb2-400ad0c29268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:37.251665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 982/1934] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:37.272928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1eddb8-2fcb-4dae-9963-22138d12d6d7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:37.276636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9d1eddb8-2fcb-4dae-9963-22138d12d6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:37.440050 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1eddb8-2fcb-4dae-9963-22138d12d6d7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:37.448693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149366-0aca-48a4-9f93-16460f5d5549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:37.452711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149366-0aca-48a4-9f93-16460f5d5549 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:37.452711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149366-0aca-48a4-9f93-16460f5d5549 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:37.452711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149366-0aca-48a4-9f93-16460f5d5549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:37.469082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0149366-0aca-48a4-9f93-16460f5d5549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:37.471221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0149366-0aca-48a4-9f93-16460f5d5549 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:37.489143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 953/1935] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:46:37.506313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:37.626834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:37.826344 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa365696-6fb9-4192-bcb2-400ad0c29268 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:37.830711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fa365696-6fb9-4192-bcb2-400ad0c29268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:37.851488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa365696-6fb9-4192-bcb2-400ad0c29268 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:37.863783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:37.865422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:37.866381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:37.867810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da admin admin] PATH_INFO: `/v3/projects/287b810edf5d487297a8931cc8fa1131` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:37.870924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da admin admin] RBAC: Authorizing `identity:delete_project(project_id=287b810edf5d487297a8931cc8fa1131)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:37.882535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:38.141508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '287b810edf5d487297a8931cc8fa1131', 'request_id': 'req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:38.163500 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '287b810edf5d487297a8931cc8fa1131', 'request_id': 'req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:38.307685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '287b810edf5d487297a8931cc8fa1131', 'request_id': 'req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:38.371635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da admin admin] The token cache is being invalidate because project 287b810edf5d487297a8931cc8fa1131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:38.372553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:38.374327 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bdc468ae-9ac3-4d4f-8cee-1096aaba11da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:38.377717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 983/1936] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:37 2022] DELETE /identity/v3/projects/287b810edf5d487297a8931cc8fa1131 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:38.386247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be5c80-e253-41da-8003-d15e703916e9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:38.386812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be5c80-e253-41da-8003-d15e703916e9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:38.387254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be5c80-e253-41da-8003-d15e703916e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:38.430392 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-12be5c80-e253-41da-8003-d15e703916e9 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:38.433077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-12be5c80-e253-41da-8003-d15e703916e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:38.574830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 954/1937] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:38.588118 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02439f8-3002-4bd0-9c87-b56e43594262 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:38.588118 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02439f8-3002-4bd0-9c87-b56e43594262 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:38.588118 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02439f8-3002-4bd0-9c87-b56e43594262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:38.635999 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d02439f8-3002-4bd0-9c87-b56e43594262 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:38.638154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d02439f8-3002-4bd0-9c87-b56e43594262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:38.665477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 984/1938] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:38.673361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be5c80-e253-41da-8003-d15e703916e9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:38.698233 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be5c80-e253-41da-8003-d15e703916e9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:38.705749 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b5183-a0d3-4ec8-a078-d917d3d6f3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:38.706506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b5183-a0d3-4ec8-a078-d917d3d6f3cf admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:38.706788 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b5183-a0d3-4ec8-a078-d917d3d6f3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:38.707055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b5183-a0d3-4ec8-a078-d917d3d6f3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:38.708133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b5183-a0d3-4ec8-a078-d917d3d6f3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:38.709530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b5183-a0d3-4ec8-a078-d917d3d6f3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:38.712411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b5183-a0d3-4ec8-a078-d917d3d6f3cf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:38.734838 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 955/1939] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:46:38.739970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02439f8-3002-4bd0-9c87-b56e43594262 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:38.780706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02439f8-3002-4bd0-9c87-b56e43594262 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:38.792971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0a184-e083-4875-915a-f831de9b983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:38.792971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0a184-e083-4875-915a-f831de9b983c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:38.793333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0a184-e083-4875-915a-f831de9b983c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:38.794064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0a184-e083-4875-915a-f831de9b983c admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:38.796302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0a184-e083-4875-915a-f831de9b983c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:38.800211 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0a184-e083-4875-915a-f831de9b983c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:38.956035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b5183-a0d3-4ec8-a078-d917d3d6f3cf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:38.961712 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 985/1940] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:38 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:38.983639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b5183-a0d3-4ec8-a078-d917d3d6f3cf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:39.117397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8a7c9-ebdf-42f8-b023-5ac604786059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:39.118632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8a7c9-ebdf-42f8-b023-5ac604786059 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:39.119217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8a7c9-ebdf-42f8-b023-5ac604786059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:39.119884 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8a7c9-ebdf-42f8-b023-5ac604786059 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:39.121604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8a7c9-ebdf-42f8-b023-5ac604786059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:39.130708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8a7c9-ebdf-42f8-b023-5ac604786059 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:39.316791 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 956/1941] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:38 2022] POST /identity/v3/users => generated 282 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:39.331360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0a184-e083-4875-915a-f831de9b983c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:39.347925 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0a184-e083-4875-915a-f831de9b983c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:39.360199 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658227cc-2a8f-47b3-b479-772933bb5fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:39.361443 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658227cc-2a8f-47b3-b479-772933bb5fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:39.362959 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658227cc-2a8f-47b3-b479-772933bb5fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:39.363463 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658227cc-2a8f-47b3-b479-772933bb5fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:39.364379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658227cc-2a8f-47b3-b479-772933bb5fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:39.366791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658227cc-2a8f-47b3-b479-772933bb5fd5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:39.390062 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 986/1942] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:39.399340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8a7c9-ebdf-42f8-b023-5ac604786059 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:39.412181 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8a7c9-ebdf-42f8-b023-5ac604786059 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:39.418830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9906ea-e718-4aa4-af98-d7a4a05134ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:39.419461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9906ea-e718-4aa4-af98-d7a4a05134ad admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:39.419771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9906ea-e718-4aa4-af98-d7a4a05134ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:39.420154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9906ea-e718-4aa4-af98-d7a4a05134ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:39.420819 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9906ea-e718-4aa4-af98-d7a4a05134ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:39.422654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9906ea-e718-4aa4-af98-d7a4a05134ad admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:39.437390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 957/1943] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:39.448605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658227cc-2a8f-47b3-b479-772933bb5fd5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:39.463264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658227cc-2a8f-47b3-b479-772933bb5fd5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:39.470797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02251ee4-dc8e-4a62-82c6-9e42f01a8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:39.472065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02251ee4-dc8e-4a62-82c6-9e42f01a8547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:39.472539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02251ee4-dc8e-4a62-82c6-9e42f01a8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:39.472933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02251ee4-dc8e-4a62-82c6-9e42f01a8547 admin admin] PATH_INFO: `/v3/projects/0bbfc2f748dd45d783cae25d18348047/users/3b7d59bebfa546e981461165c05b7b55/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:39.530695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02251ee4-dc8e-4a62-82c6-9e42f01a8547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bbfc2f748dd45d783cae25d18348047, user_id=3b7d59bebfa546e981461165c05b7b55, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:39.534840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02251ee4-dc8e-4a62-82c6-9e42f01a8547 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:39.635312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960433f8-6f33-4eb9-8d17-004b120da2ab None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:39.637049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960433f8-6f33-4eb9-8d17-004b120da2ab None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:39.637049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960433f8-6f33-4eb9-8d17-004b120da2ab None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:39.645403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 987/1944] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:39 2022] PUT /identity/v3/projects/0bbfc2f748dd45d783cae25d18348047/users/3b7d59bebfa546e981461165c05b7b55/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:39.646659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 958/1945] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:46:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:46:39.656415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d384ee-389f-4cf4-81ee-f8cced4e86bb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:39.656991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d384ee-389f-4cf4-81ee-f8cced4e86bb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:39.657146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb1cb6-69ab-4028-ba5d-aad3810e27a6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:39.657304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d384ee-389f-4cf4-81ee-f8cced4e86bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:39.658354 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb1cb6-69ab-4028-ba5d-aad3810e27a6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:39.658905 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb1cb6-69ab-4028-ba5d-aad3810e27a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:39.695959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-67cb1cb6-69ab-4028-ba5d-aad3810e27a6 None None] MFA Rules not processed for user `8ebfb233b2504463a4ee9202b5a3ab50`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:39.703796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-67cb1cb6-69ab-4028-ba5d-aad3810e27a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:39.727839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e6d384ee-389f-4cf4-81ee-f8cced4e86bb None None] MFA Rules not processed for user `3b7d59bebfa546e981461165c05b7b55`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:39.733468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e6d384ee-389f-4cf4-81ee-f8cced4e86bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:39.847809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 959/1946] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:46:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:39.866820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb1cb6-69ab-4028-ba5d-aad3810e27a6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:39.869933 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-67cb1cb6-69ab-4028-ba5d-aad3810e27a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:39.872608 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:39.893699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb1cb6-69ab-4028-ba5d-aad3810e27a6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:39.903429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b2967-8e3c-4080-b5de-c846e7fd4e58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebfb233b2504463a4ee9202b5a3ab50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:39.904602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b2967-8e3c-4080-b5de-c846e7fd4e58 service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:39.905099 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b2967-8e3c-4080-b5de-c846e7fd4e58 service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:39.905581 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b2967-8e3c-4080-b5de-c846e7fd4e58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:39.907924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 988/1947] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:39.913706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d384ee-389f-4cf4-81ee-f8cced4e86bb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:39.953897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b2967-8e3c-4080-b5de-c846e7fd4e58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:39.960363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b2967-8e3c-4080-b5de-c846e7fd4e58 service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:40.007996 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 960/1948] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:40.035076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b2967-8e3c-4080-b5de-c846e7fd4e58 service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:40.037576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-625b2967-8e3c-4080-b5de-c846e7fd4e58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:40.051164 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d384ee-389f-4cf4-81ee-f8cced4e86bb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:40.059340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fd9b0-94b6-4fb9-a417-89fe0b9d88c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:40.060696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fd9b0-94b6-4fb9-a417-89fe0b9d88c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:40.061412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fd9b0-94b6-4fb9-a417-89fe0b9d88c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:40.061855 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fd9b0-94b6-4fb9-a417-89fe0b9d88c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:40.063180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fd9b0-94b6-4fb9-a417-89fe0b9d88c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:40.066266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fd9b0-94b6-4fb9-a417-89fe0b9d88c9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:40.096130 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b2967-8e3c-4080-b5de-c846e7fd4e58 service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:40.111565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:40.112596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:40.113190 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:40.113502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] PATH_INFO: `/v3/users/53775327011e435a8a08edcb90f01db3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:40.125990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53775327011e435a8a08edcb90f01db3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:40.129289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:40.274909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 989/1949] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:39 2022] POST /identity/v3/projects => generated 363 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:40.275152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1650-f045-4426-9a34-fb20b6716c3c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:40.275558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1650-f045-4426-9a34-fb20b6716c3c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:40.276184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1650-f045-4426-9a34-fb20b6716c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:40.317120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2ffe1650-f045-4426-9a34-fb20b6716c3c None None] MFA Rules not processed for user `2b38cc0d7c5d43008599050a0d64989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:40.318377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2ffe1650-f045-4426-9a34-fb20b6716c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:40.464922 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 990/1950] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:40.466909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1650-f045-4426-9a34-fb20b6716c3c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:40.487591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53775327011e435a8a08edcb90f01db3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:40.487591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53775327011e435a8a08edcb90f01db3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:40.506882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53775327011e435a8a08edcb90f01db3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:40.523159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53775327011e435a8a08edcb90f01db3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:40.524657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53775327011e435a8a08edcb90f01db3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:40.571021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:40.588264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1650-f045-4426-9a34-fb20b6716c3c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:40.599502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd76eed-f83e-472d-a6c9-d581f0bc76b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:40.600669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd76eed-f83e-472d-a6c9-d581f0bc76b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:40.601142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd76eed-f83e-472d-a6c9-d581f0bc76b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:40.601776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd76eed-f83e-472d-a6c9-d581f0bc76b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:40.602900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd76eed-f83e-472d-a6c9-d581f0bc76b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:40.606994 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd76eed-f83e-472d-a6c9-d581f0bc76b0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:40.626815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 961/1951] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:40 2022] DELETE /identity/v3/users/53775327011e435a8a08edcb90f01db3 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:40.628155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:40.630900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:40.795991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 991/1952] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:40 2022] POST /identity/v3/users => generated 288 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:40.796408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c98381-a91e-422b-a6c6-7cf7692cd960 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:40.805562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd76eed-f83e-472d-a6c9-d581f0bc76b0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:40.805562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4fd76eed-f83e-472d-a6c9-d581f0bc76b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:40.806426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aad3d1-25cb-4e6f-8458-25b3724a03f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:40.807755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aad3d1-25cb-4e6f-8458-25b3724a03f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:40.808240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aad3d1-25cb-4e6f-8458-25b3724a03f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:40.808722 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aad3d1-25cb-4e6f-8458-25b3724a03f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:40.810028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aad3d1-25cb-4e6f-8458-25b3724a03f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:40.814684 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aad3d1-25cb-4e6f-8458-25b3724a03f5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:40.832485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd76eed-f83e-472d-a6c9-d581f0bc76b0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:40.842815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914ba5-2b79-4f88-a612-f35ec6bf8ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:40.851396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914ba5-2b79-4f88-a612-f35ec6bf8ddd admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:40.851396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914ba5-2b79-4f88-a612-f35ec6bf8ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:40.851396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914ba5-2b79-4f88-a612-f35ec6bf8ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:40.851396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4914ba5-2b79-4f88-a612-f35ec6bf8ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:40.851396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4914ba5-2b79-4f88-a612-f35ec6bf8ddd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:40.876004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 992/1953] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:40.879697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914ba5-2b79-4f88-a612-f35ec6bf8ddd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:40.898398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914ba5-2b79-4f88-a612-f35ec6bf8ddd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:40.909857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3827484-5a09-4d1f-b0ec-a07de2e0f096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:40.912886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827484-5a09-4d1f-b0ec-a07de2e0f096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:40.912886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827484-5a09-4d1f-b0ec-a07de2e0f096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:40.912886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827484-5a09-4d1f-b0ec-a07de2e0f096 admin admin] PATH_INFO: `/v3/projects/15a53df9a32d4cb0beac427f58977ba2/users/9a17e9f425e14d14abc163acc3166367/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:40.937616 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3827484-5a09-4d1f-b0ec-a07de2e0f096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a53df9a32d4cb0beac427f58977ba2, user_id=9a17e9f425e14d14abc163acc3166367, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:40.942458 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3827484-5a09-4d1f-b0ec-a07de2e0f096 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:41.023012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 962/1954] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:40 2022] POST /identity/v3/projects => generated 371 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:41.028365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aad3d1-25cb-4e6f-8458-25b3724a03f5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:41.097024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 993/1955] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:40 2022] PUT /identity/v3/projects/15a53df9a32d4cb0beac427f58977ba2/users/9a17e9f425e14d14abc163acc3166367/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:41.104280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3827484-5a09-4d1f-b0ec-a07de2e0f096 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:41.142281 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aad3d1-25cb-4e6f-8458-25b3724a03f5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:41.229401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9e4c2-fcc6-45e6-91c0-0fd266a5696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:41.230872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9e4c2-fcc6-45e6-91c0-0fd266a5696f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:41.231044 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9e4c2-fcc6-45e6-91c0-0fd266a5696f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:41.231550 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9e4c2-fcc6-45e6-91c0-0fd266a5696f admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:41.232972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9e4c2-fcc6-45e6-91c0-0fd266a5696f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:41.236676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9e4c2-fcc6-45e6-91c0-0fd266a5696f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:41.241275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3827484-5a09-4d1f-b0ec-a07de2e0f096 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:41.258255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2ad58-b7a6-410f-bb21-894e977cabe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:41.259861 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2ad58-b7a6-410f-bb21-894e977cabe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:41.260440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2ad58-b7a6-410f-bb21-894e977cabe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:41.260630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2ad58-b7a6-410f-bb21-894e977cabe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:41.261943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2ad58-b7a6-410f-bb21-894e977cabe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:41.266509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2ad58-b7a6-410f-bb21-894e977cabe0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:41.291963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 994/1956] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:41.295466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2ad58-b7a6-410f-bb21-894e977cabe0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:41.305254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f5a2ad58-b7a6-410f-bb21-894e977cabe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:41.327420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2ad58-b7a6-410f-bb21-894e977cabe0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:41.335553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:41.336772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:41.337274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:41.337977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] PATH_INFO: `/v3/projects/86078f10d6a8435cb7fe63394c82295b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:41.340143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86078f10d6a8435cb7fe63394c82295b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:41.350201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:41.397331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 963/1957] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:41 2022] POST /identity/v3/users => generated 292 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:41.398293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9e4c2-fcc6-45e6-91c0-0fd266a5696f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:41.423247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9e4c2-fcc6-45e6-91c0-0fd266a5696f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:41.430777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1044249-69ab-4df9-8e02-95bc94d991e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:41.431485 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1044249-69ab-4df9-8e02-95bc94d991e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:41.431834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1044249-69ab-4df9-8e02-95bc94d991e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:41.432109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1044249-69ab-4df9-8e02-95bc94d991e4 admin admin] PATH_INFO: `/v3/projects/15a53df9a32d4cb0beac427f58977ba2/users/9a17e9f425e14d14abc163acc3166367/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:41.434677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1044249-69ab-4df9-8e02-95bc94d991e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a53df9a32d4cb0beac427f58977ba2, user_id=9a17e9f425e14d14abc163acc3166367, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:41.438145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1044249-69ab-4df9-8e02-95bc94d991e4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:41.453829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 964/1958] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:41 2022] PUT /identity/v3/projects/15a53df9a32d4cb0beac427f58977ba2/users/9a17e9f425e14d14abc163acc3166367/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:41.465464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1044249-69ab-4df9-8e02-95bc94d991e4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:41.600774 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1044249-69ab-4df9-8e02-95bc94d991e4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:41.616206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86078f10d6a8435cb7fe63394c82295b', 'request_id': 'req-e85103cc-ddde-4002-8b79-1569907e06e6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:41.632692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86078f10d6a8435cb7fe63394c82295b', 'request_id': 'req-e85103cc-ddde-4002-8b79-1569907e06e6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:41.721041 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a5ade-8833-481b-834c-321e67322903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:41.722125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a5ade-8833-481b-834c-321e67322903 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:41.722591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a5ade-8833-481b-834c-321e67322903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:41.723052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a5ade-8833-481b-834c-321e67322903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:41.724260 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a5ade-8833-481b-834c-321e67322903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:41.727854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a5ade-8833-481b-834c-321e67322903 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:41.731611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86078f10d6a8435cb7fe63394c82295b', 'request_id': 'req-e85103cc-ddde-4002-8b79-1569907e06e6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:41.750254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 965/1959] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:41.751626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cba6b-b9f5-4a08-a782-f79aa46dcf42 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:41.752033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cba6b-b9f5-4a08-a782-f79aa46dcf42 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:41.752384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cba6b-b9f5-4a08-a782-f79aa46dcf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:41.767263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] The token cache is being invalidate because project 86078f10d6a8435cb7fe63394c82295b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:41.767263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:41.767837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:41.771420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 995/1960] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:41 2022] DELETE /identity/v3/projects/86078f10d6a8435cb7fe63394c82295b => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:41.772682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:41.778711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:41.807264 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-be7cba6b-b9f5-4a08-a782-f79aa46dcf42 None None] MFA Rules not processed for user `9a17e9f425e14d14abc163acc3166367`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:41.808137 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85103cc-ddde-4002-8b79-1569907e06e6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:41.808720 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-be7cba6b-b9f5-4a08-a782-f79aa46dcf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:41.854290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02853fdd-19a4-401a-a9a7-9679fcb5c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:41.859700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02853fdd-19a4-401a-a9a7-9679fcb5c532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:41.860126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02853fdd-19a4-401a-a9a7-9679fcb5c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:41.860369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02853fdd-19a4-401a-a9a7-9679fcb5c532 admin admin] PATH_INFO: `/v3/projects/9a306c9f165048d2a312b2a47db5446b/users/7636eca685e04d3a8e6daa2ed120f7ab/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:41.954276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02853fdd-19a4-401a-a9a7-9679fcb5c532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a306c9f165048d2a312b2a47db5446b, user_id=7636eca685e04d3a8e6daa2ed120f7ab, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:41.960462 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02853fdd-19a4-401a-a9a7-9679fcb5c532 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:42.016110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 966/1961] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:42.018413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c378-13d3-46eb-85ad-faa720ae4ece None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:42.018838 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c378-13d3-46eb-85ad-faa720ae4ece None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:42.019944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c378-13d3-46eb-85ad-faa720ae4ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:42.051537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2659c378-13d3-46eb-85ad-faa720ae4ece None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:42.053635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2659c378-13d3-46eb-85ad-faa720ae4ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:42.068258 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 967/1962] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:42.079345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c378-13d3-46eb-85ad-faa720ae4ece None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:42.079345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2659c378-13d3-46eb-85ad-faa720ae4ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:42.084229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 996/1963] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:41 2022] PUT /identity/v3/projects/9a306c9f165048d2a312b2a47db5446b/users/7636eca685e04d3a8e6daa2ed120f7ab/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:42.093676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f008d-8ace-4662-8b83-66a01c9adb04 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:42.094291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f008d-8ace-4662-8b83-66a01c9adb04 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:42.094841 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f008d-8ace-4662-8b83-66a01c9adb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:42.136990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-af7f008d-8ace-4662-8b83-66a01c9adb04 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:42.140044 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-af7f008d-8ace-4662-8b83-66a01c9adb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:42.215445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c378-13d3-46eb-85ad-faa720ae4ece None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:42.270957 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 997/1964] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:42.277504 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f008d-8ace-4662-8b83-66a01c9adb04 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:42.296607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f008d-8ace-4662-8b83-66a01c9adb04 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:42.305833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aad577-26d6-469d-8337-7b7d70aceb78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:42.310262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aad577-26d6-469d-8337-7b7d70aceb78 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:42.310262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aad577-26d6-469d-8337-7b7d70aceb78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:42.310262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aad577-26d6-469d-8337-7b7d70aceb78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:42.310758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8c6f5-b585-499b-83ea-9cee0d6be8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:42.310758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8c6f5-b585-499b-83ea-9cee0d6be8ab admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:42.310758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8c6f5-b585-499b-83ea-9cee0d6be8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:42.310758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8c6f5-b585-499b-83ea-9cee0d6be8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:42.311367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8c6f5-b585-499b-83ea-9cee0d6be8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:42.316206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8c6f5-b585-499b-83ea-9cee0d6be8ab admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:42.335839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 998/1965] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:42.337381 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8c6f5-b585-499b-83ea-9cee0d6be8ab admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:42.357035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8c6f5-b585-499b-83ea-9cee0d6be8ab admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:42.365425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd25af0-3c1a-4bf8-855e-1f4a3cece1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:42.366410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd25af0-3c1a-4bf8-855e-1f4a3cece1cd admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:42.366843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd25af0-3c1a-4bf8-855e-1f4a3cece1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:42.367269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd25af0-3c1a-4bf8-855e-1f4a3cece1cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:42.368204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd25af0-3c1a-4bf8-855e-1f4a3cece1cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:42.368726 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd25af0-3c1a-4bf8-855e-1f4a3cece1cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:42.371909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd25af0-3c1a-4bf8-855e-1f4a3cece1cd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:42.400644 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 999/1966] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:46:42.401339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd25af0-3c1a-4bf8-855e-1f4a3cece1cd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:42.414332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd25af0-3c1a-4bf8-855e-1f4a3cece1cd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:42.421300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc377a-e3da-4975-9827-95f250c04ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:42.427329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc377a-e3da-4975-9827-95f250c04ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:42.427329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc377a-e3da-4975-9827-95f250c04ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:42.427329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc377a-e3da-4975-9827-95f250c04ef1 admin admin] PATH_INFO: `/v3/projects/9a306c9f165048d2a312b2a47db5446b/users/7636eca685e04d3a8e6daa2ed120f7ab/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:42.427329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc377a-e3da-4975-9827-95f250c04ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a306c9f165048d2a312b2a47db5446b, user_id=7636eca685e04d3a8e6daa2ed120f7ab, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:42.428768 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc377a-e3da-4975-9827-95f250c04ef1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:42.428902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aad577-26d6-469d-8337-7b7d70aceb78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:42.431821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aad577-26d6-469d-8337-7b7d70aceb78 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:42.442195 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1000/1967] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:42 2022] PUT /identity/v3/projects/9a306c9f165048d2a312b2a47db5446b/users/7636eca685e04d3a8e6daa2ed120f7ab/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:42.442774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc377a-e3da-4975-9827-95f250c04ef1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:42.447173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 968/1968] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:42.546795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc377a-e3da-4975-9827-95f250c04ef1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:42.554623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052612de-b384-4afa-885b-bc9fa24ddec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:42.555436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052612de-b384-4afa-885b-bc9fa24ddec4 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:42.555864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052612de-b384-4afa-885b-bc9fa24ddec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:42.556209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052612de-b384-4afa-885b-bc9fa24ddec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:42.556969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052612de-b384-4afa-885b-bc9fa24ddec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:42.559555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052612de-b384-4afa-885b-bc9fa24ddec4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:42.728194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1001/1969] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:42 2022] POST /identity/v3/projects => generated 369 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:42.729138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aad577-26d6-469d-8337-7b7d70aceb78 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:42.750305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aad577-26d6-469d-8337-7b7d70aceb78 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:42.827810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052612de-b384-4afa-885b-bc9fa24ddec4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:42.831356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-052612de-b384-4afa-885b-bc9fa24ddec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:42.908922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32593d3e-7de7-4a59-abf6-44bf49a836b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:42.909732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32593d3e-7de7-4a59-abf6-44bf49a836b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:42.910209 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32593d3e-7de7-4a59-abf6-44bf49a836b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:42.911529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32593d3e-7de7-4a59-abf6-44bf49a836b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:42.913204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32593d3e-7de7-4a59-abf6-44bf49a836b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:42.918048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32593d3e-7de7-4a59-abf6-44bf49a836b6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:42.970859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052612de-b384-4afa-885b-bc9fa24ddec4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:42.977141 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339006d0-3db5-481d-8c69-bc169caa55ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:42.978690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339006d0-3db5-481d-8c69-bc169caa55ac service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:42.979173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339006d0-3db5-481d-8c69-bc169caa55ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:42.979791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339006d0-3db5-481d-8c69-bc169caa55ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:42.983510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-339006d0-3db5-481d-8c69-bc169caa55ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:43.085342 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339006d0-3db5-481d-8c69-bc169caa55ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:43.086804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339006d0-3db5-481d-8c69-bc169caa55ac service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:43.101301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1002/1970] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:43.128650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:43.138202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 969/1971] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:42 2022] POST /identity/v3/users => generated 285 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:43.143843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339006d0-3db5-481d-8c69-bc169caa55ac service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:43.161396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339006d0-3db5-481d-8c69-bc169caa55ac service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:43.174989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50a32e-228b-4343-bec4-c6d6ab431483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:43.182227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50a32e-228b-4343-bec4-c6d6ab431483 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:43.182227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50a32e-228b-4343-bec4-c6d6ab431483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:43.182227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50a32e-228b-4343-bec4-c6d6ab431483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:43.182227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50a32e-228b-4343-bec4-c6d6ab431483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:43.184438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50a32e-228b-4343-bec4-c6d6ab431483 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:43.213355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1003/1972] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:43.221895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32593d3e-7de7-4a59-abf6-44bf49a836b6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:43.259761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32593d3e-7de7-4a59-abf6-44bf49a836b6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:43.279074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f74781-dcf5-44e5-9d8c-4896df475f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:43.280719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f74781-dcf5-44e5-9d8c-4896df475f9a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:43.281216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f74781-dcf5-44e5-9d8c-4896df475f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:43.281712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f74781-dcf5-44e5-9d8c-4896df475f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:43.282936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f74781-dcf5-44e5-9d8c-4896df475f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:43.286179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f74781-dcf5-44e5-9d8c-4896df475f9a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:43.316119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 970/1973] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:43.322941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50a32e-228b-4343-bec4-c6d6ab431483 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:43.345368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50a32e-228b-4343-bec4-c6d6ab431483 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:43.352013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa835040-ead1-4037-b871-20945be4e5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:43.352812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa835040-ead1-4037-b871-20945be4e5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:43.353335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa835040-ead1-4037-b871-20945be4e5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:43.353789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa835040-ead1-4037-b871-20945be4e5ba admin admin] PATH_INFO: `/v3/projects/cf3ace774c68465e8dc70f689d0ed355/users/4a1259b859ca4d718a9522f7f77cc93b/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:43.387190 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa835040-ead1-4037-b871-20945be4e5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3ace774c68465e8dc70f689d0ed355, user_id=4a1259b859ca4d718a9522f7f77cc93b, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:43.391224 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa835040-ead1-4037-b871-20945be4e5ba admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:43.572440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1004/1974] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:43 2022] PUT /identity/v3/projects/cf3ace774c68465e8dc70f689d0ed355/users/4a1259b859ca4d718a9522f7f77cc93b/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:43.591524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d9b7b-7516-43de-93c8-2f2ccd0d634e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:43.592569 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d9b7b-7516-43de-93c8-2f2ccd0d634e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:43.593037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d9b7b-7516-43de-93c8-2f2ccd0d634e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:43.650876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8b2d9b7b-7516-43de-93c8-2f2ccd0d634e None None] MFA Rules not processed for user `4a1259b859ca4d718a9522f7f77cc93b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:43.653512 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8b2d9b7b-7516-43de-93c8-2f2ccd0d634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:43.777515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 971/1975] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:43.801562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa835040-ead1-4037-b871-20945be4e5ba admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:43.804119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-aa835040-ead1-4037-b871-20945be4e5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:44.008356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa835040-ead1-4037-b871-20945be4e5ba admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:44.036156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2423a-1878-40d0-acf5-fbaa1584e9e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:44.036156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2423a-1878-40d0-acf5-fbaa1584e9e9 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:44.036156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2423a-1878-40d0-acf5-fbaa1584e9e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:44.036156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2423a-1878-40d0-acf5-fbaa1584e9e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:44.085286 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2423a-1878-40d0-acf5-fbaa1584e9e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:44.091382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2423a-1878-40d0-acf5-fbaa1584e9e9 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:44.125406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1005/1976] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:44.180165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d9b7b-7516-43de-93c8-2f2ccd0d634e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:44.329772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d9b7b-7516-43de-93c8-2f2ccd0d634e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:44.344152 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74767b-a755-49b0-a727-2cb31003b49e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:44.346123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74767b-a755-49b0-a727-2cb31003b49e service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:44.346872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74767b-a755-49b0-a727-2cb31003b49e service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:44.347557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74767b-a755-49b0-a727-2cb31003b49e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:44.351474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6d74767b-a755-49b0-a727-2cb31003b49e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:44.515128 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74767b-a755-49b0-a727-2cb31003b49e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:44.522047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:44.522047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74767b-a755-49b0-a727-2cb31003b49e service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:44.544483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2423a-1878-40d0-acf5-fbaa1584e9e9 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:44.555896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 972/1977] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:44.680978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2423a-1878-40d0-acf5-fbaa1584e9e9 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:44.692576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221cefa-f404-44af-8c73-481f5f3bd79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:44.699759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221cefa-f404-44af-8c73-481f5f3bd79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:44.699759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221cefa-f404-44af-8c73-481f5f3bd79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:44.699759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221cefa-f404-44af-8c73-481f5f3bd79c admin admin] PATH_INFO: `/v3/users/4a1259b859ca4d718a9522f7f77cc93b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:44.699759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221cefa-f404-44af-8c73-481f5f3bd79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1259b859ca4d718a9522f7f77cc93b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:44.699759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221cefa-f404-44af-8c73-481f5f3bd79c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:44.969185 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca47d4c-73d9-4dce-b87d-29e940585a05 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:44.969723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca47d4c-73d9-4dce-b87d-29e940585a05 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:44.970241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca47d4c-73d9-4dce-b87d-29e940585a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:45.026565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7ca47d4c-73d9-4dce-b87d-29e940585a05 None None] MFA Rules not processed for user `7636eca685e04d3a8e6daa2ed120f7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:45.028781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7ca47d4c-73d9-4dce-b87d-29e940585a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:45.076185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4221cefa-f404-44af-8c73-481f5f3bd79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1259b859ca4d718a9522f7f77cc93b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:45.106212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4221cefa-f404-44af-8c73-481f5f3bd79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1259b859ca4d718a9522f7f77cc93b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:45.198576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:45.212966 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 973/1978] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:45.231502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ac83-e8c2-4b61-8474-4e76a4e73072 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:45.236814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4221cefa-f404-44af-8c73-481f5f3bd79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1259b859ca4d718a9522f7f77cc93b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:45.236814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4221cefa-f404-44af-8c73-481f5f3bd79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1259b859ca4d718a9522f7f77cc93b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:45.236814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4221cefa-f404-44af-8c73-481f5f3bd79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1259b859ca4d718a9522f7f77cc93b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:45.237494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ac83-e8c2-4b61-8474-4e76a4e73072 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:45.237494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ac83-e8c2-4b61-8474-4e76a4e73072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:45.285540 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7247ac83-e8c2-4b61-8474-4e76a4e73072 None None] MFA Rules not processed for user `2b38cc0d7c5d43008599050a0d64989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:45.289276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7247ac83-e8c2-4b61-8474-4e76a4e73072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:45.301544 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1006/1979] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:44 2022] DELETE /identity/v3/users/4a1259b859ca4d718a9522f7f77cc93b => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:45.305818 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e7104-08a1-46de-81ff-c10a80ab33aa None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:45.306130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e7104-08a1-46de-81ff-c10a80ab33aa None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:45.306396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e7104-08a1-46de-81ff-c10a80ab33aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:45.385436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-fb4e7104-08a1-46de-81ff-c10a80ab33aa None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:45.387073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fb4e7104-08a1-46de-81ff-c10a80ab33aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:45.536627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1007/1980] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:45.547008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 974/1981] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:45.568727 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e7104-08a1-46de-81ff-c10a80ab33aa None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:45.570629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fb4e7104-08a1-46de-81ff-c10a80ab33aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:45.610817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247ac83-e8c2-4b61-8474-4e76a4e73072 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:45.614384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7247ac83-e8c2-4b61-8474-4e76a4e73072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:45.708296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e7104-08a1-46de-81ff-c10a80ab33aa None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:45.717004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1315344-a880-4c86-8e40-7a7ab77adc37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:45.717819 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1315344-a880-4c86-8e40-7a7ab77adc37 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:45.718388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1315344-a880-4c86-8e40-7a7ab77adc37 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:45.718944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1315344-a880-4c86-8e40-7a7ab77adc37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:45.721401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c1315344-a880-4c86-8e40-7a7ab77adc37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:45.781802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247ac83-e8c2-4b61-8474-4e76a4e73072 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:45.848068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1315344-a880-4c86-8e40-7a7ab77adc37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:45.850052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1315344-a880-4c86-8e40-7a7ab77adc37 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:45.876713 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1008/1982] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:45.914852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91b7fd-6d11-4ee7-b5cf-c11448a62cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:45.916162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91b7fd-6d11-4ee7-b5cf-c11448a62cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:45.916741 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91b7fd-6d11-4ee7-b5cf-c11448a62cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:45.917168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91b7fd-6d11-4ee7-b5cf-c11448a62cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:45.937787 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91b7fd-6d11-4ee7-b5cf-c11448a62cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:45.940568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91b7fd-6d11-4ee7-b5cf-c11448a62cf7 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:45.955201 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 975/1983] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:46:46.945912 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:46.959138 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1315344-a880-4c86-8e40-7a7ab77adc37 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:46.961686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c1315344-a880-4c86-8e40-7a7ab77adc37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:47.000704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1315344-a880-4c86-8e40-7a7ab77adc37 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:47.012371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4a367-9102-4339-81eb-2f444487b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:47.014580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4a367-9102-4339-81eb-2f444487b98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:47.015430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4a367-9102-4339-81eb-2f444487b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:47.016004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4a367-9102-4339-81eb-2f444487b98d admin admin] PATH_INFO: `/v3/projects/cf3ace774c68465e8dc70f689d0ed355` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:47.032555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4a367-9102-4339-81eb-2f444487b98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3ace774c68465e8dc70f689d0ed355)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:47.040534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4a367-9102-4339-81eb-2f444487b98d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:47.288262 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39b4a367-9102-4339-81eb-2f444487b98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3ace774c68465e8dc70f689d0ed355', 'request_id': 'req-39b4a367-9102-4339-81eb-2f444487b98d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:47.315478 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39b4a367-9102-4339-81eb-2f444487b98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3ace774c68465e8dc70f689d0ed355', 'request_id': 'req-39b4a367-9102-4339-81eb-2f444487b98d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:47.492744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39b4a367-9102-4339-81eb-2f444487b98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3ace774c68465e8dc70f689d0ed355', 'request_id': 'req-39b4a367-9102-4339-81eb-2f444487b98d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:47.510546 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39b4a367-9102-4339-81eb-2f444487b98d admin admin] The token cache is being invalidate because project cf3ace774c68465e8dc70f689d0ed355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:47.510951 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39b4a367-9102-4339-81eb-2f444487b98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:47.511995 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39b4a367-9102-4339-81eb-2f444487b98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:47.514305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1009/1984] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:46 2022] DELETE /identity/v3/projects/cf3ace774c68465e8dc70f689d0ed355 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:47.521507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156764a4-773a-4387-8641-bde00752e3f0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:47.521911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156764a4-773a-4387-8641-bde00752e3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:47.522452 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156764a4-773a-4387-8641-bde00752e3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:47.528484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:47.564222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-156764a4-773a-4387-8641-bde00752e3f0 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:47.566034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-156764a4-773a-4387-8641-bde00752e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:47.667377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 976/1985] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:47.679863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797706a7-7679-45c8-848e-2a6b032fc597 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:47.680378 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797706a7-7679-45c8-848e-2a6b032fc597 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:47.680844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797706a7-7679-45c8-848e-2a6b032fc597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:47.714600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-797706a7-7679-45c8-848e-2a6b032fc597 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:47.716141 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-797706a7-7679-45c8-848e-2a6b032fc597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:47.727327 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1010/1986] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:47.732799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156764a4-773a-4387-8641-bde00752e3f0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:47.746949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156764a4-773a-4387-8641-bde00752e3f0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:47.755590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af099d-6655-4dc3-b47d-9e7074bcfaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:47.765444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af099d-6655-4dc3-b47d-9e7074bcfaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:47.765444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af099d-6655-4dc3-b47d-9e7074bcfaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:47.765444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af099d-6655-4dc3-b47d-9e7074bcfaf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:47.765444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af099d-6655-4dc3-b47d-9e7074bcfaf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:47.765444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af099d-6655-4dc3-b47d-9e7074bcfaf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:47.765444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af099d-6655-4dc3-b47d-9e7074bcfaf4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:47.779873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 977/1987] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:46:47.783743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797706a7-7679-45c8-848e-2a6b032fc597 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:47.801076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797706a7-7679-45c8-848e-2a6b032fc597 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:47.816249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b41700-06c4-4a16-8bff-5299deaa17a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:47.817226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b41700-06c4-4a16-8bff-5299deaa17a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:47.828248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b41700-06c4-4a16-8bff-5299deaa17a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:47.828248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b41700-06c4-4a16-8bff-5299deaa17a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:47.828248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b41700-06c4-4a16-8bff-5299deaa17a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:47.828248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b41700-06c4-4a16-8bff-5299deaa17a2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:47.929229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af099d-6655-4dc3-b47d-9e7074bcfaf4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:47.931763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-98af099d-6655-4dc3-b47d-9e7074bcfaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:47.951090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af099d-6655-4dc3-b47d-9e7074bcfaf4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:47.959192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40074279-dc63-4faf-a277-47dd412831d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:47.959898 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40074279-dc63-4faf-a277-47dd412831d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:47.960283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40074279-dc63-4faf-a277-47dd412831d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:47.960644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40074279-dc63-4faf-a277-47dd412831d2 admin admin] PATH_INFO: `/v3/users/3b7d59bebfa546e981461165c05b7b55` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:47.962210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40074279-dc63-4faf-a277-47dd412831d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7d59bebfa546e981461165c05b7b55)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:47.964698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40074279-dc63-4faf-a277-47dd412831d2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:48.049121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1011/1988] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:47 2022] POST /identity/v3/projects => generated 365 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:48.056720 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b41700-06c4-4a16-8bff-5299deaa17a2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:48.157603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b41700-06c4-4a16-8bff-5299deaa17a2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:48.164585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a460318-51d1-45a0-b90b-26804db133f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:48.165365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a460318-51d1-45a0-b90b-26804db133f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:48.165696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a460318-51d1-45a0-b90b-26804db133f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:48.166029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a460318-51d1-45a0-b90b-26804db133f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:48.166719 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a460318-51d1-45a0-b90b-26804db133f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:48.168862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a460318-51d1-45a0-b90b-26804db133f9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:48.469791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1012/1989] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:48 2022] POST /identity/v3/users => generated 283 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:48.478829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a460318-51d1-45a0-b90b-26804db133f9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:48.492049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-40074279-dc63-4faf-a277-47dd412831d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7d59bebfa546e981461165c05b7b55'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:48.492291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-40074279-dc63-4faf-a277-47dd412831d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7d59bebfa546e981461165c05b7b55'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:48.495560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a460318-51d1-45a0-b90b-26804db133f9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:48.509521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7883a-a81b-4ea5-8511-b5fae523a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:48.511023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7883a-a81b-4ea5-8511-b5fae523a3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:48.511599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7883a-a81b-4ea5-8511-b5fae523a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:48.512254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7883a-a81b-4ea5-8511-b5fae523a3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:48.518559 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7883a-a81b-4ea5-8511-b5fae523a3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:48.518940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7883a-a81b-4ea5-8511-b5fae523a3f6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:48.546185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1013/1990] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:48.546770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-40074279-dc63-4faf-a277-47dd412831d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7d59bebfa546e981461165c05b7b55'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:48.551369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7883a-a81b-4ea5-8511-b5fae523a3f6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:48.557778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-31f7883a-a81b-4ea5-8511-b5fae523a3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:48.567150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-40074279-dc63-4faf-a277-47dd412831d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7d59bebfa546e981461165c05b7b55'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:48.569144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-40074279-dc63-4faf-a277-47dd412831d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7d59bebfa546e981461165c05b7b55'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:48.587375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7883a-a81b-4ea5-8511-b5fae523a3f6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:48.591691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a49f5-ab46-4ed5-9adb-b219b4938832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:48.592751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a49f5-ab46-4ed5-9adb-b219b4938832 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:48.593099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a49f5-ab46-4ed5-9adb-b219b4938832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:48.593386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a49f5-ab46-4ed5-9adb-b219b4938832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:48.594332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a49f5-ab46-4ed5-9adb-b219b4938832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:48.596281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a49f5-ab46-4ed5-9adb-b219b4938832 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:48.610505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1014/1991] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:48.617427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a49f5-ab46-4ed5-9adb-b219b4938832 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:48.635463 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a49f5-ab46-4ed5-9adb-b219b4938832 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:48.643678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f66ea-cc86-4f14-8d2e-dd2800252cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:48.644775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f66ea-cc86-4f14-8d2e-dd2800252cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:48.645244 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f66ea-cc86-4f14-8d2e-dd2800252cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:48.645828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f66ea-cc86-4f14-8d2e-dd2800252cfa admin admin] PATH_INFO: `/v3/projects/514ea851500c46debc822336a33a7e70/users/3ba7495915a5415b82694191b3ad7110/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:48.694606 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f66ea-cc86-4f14-8d2e-dd2800252cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=514ea851500c46debc822336a33a7e70, user_id=3ba7495915a5415b82694191b3ad7110, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:48.697267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 978/1992] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:47 2022] DELETE /identity/v3/users/3b7d59bebfa546e981461165c05b7b55 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:48.703312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f66ea-cc86-4f14-8d2e-dd2800252cfa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:48.705800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdace0ac-fc5e-4380-ad98-2321a0510e49 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:48.706547 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdace0ac-fc5e-4380-ad98-2321a0510e49 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:48.707265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdace0ac-fc5e-4380-ad98-2321a0510e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:48.751516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bdace0ac-fc5e-4380-ad98-2321a0510e49 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:48.754263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bdace0ac-fc5e-4380-ad98-2321a0510e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:48.858195 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1015/1993] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:48 2022] PUT /identity/v3/projects/514ea851500c46debc822336a33a7e70/users/3ba7495915a5415b82694191b3ad7110/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:48.880820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075b4bd-db5c-4843-898f-a7142c13ff4e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:48.883349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075b4bd-db5c-4843-898f-a7142c13ff4e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:48.883349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075b4bd-db5c-4843-898f-a7142c13ff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:48.937790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 979/1994] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:48.963177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdace0ac-fc5e-4380-ad98-2321a0510e49 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:48.963177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bdace0ac-fc5e-4380-ad98-2321a0510e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:48.964629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2075b4bd-db5c-4843-898f-a7142c13ff4e None None] MFA Rules not processed for user `3ba7495915a5415b82694191b3ad7110`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:48.964629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2075b4bd-db5c-4843-898f-a7142c13ff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:49.074719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdace0ac-fc5e-4380-ad98-2321a0510e49 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:49.088625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1016/1995] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:49.096930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075b4bd-db5c-4843-898f-a7142c13ff4e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:49.181508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f4ea3-4815-4791-ae2d-df7e064811cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:49.184214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f4ea3-4815-4791-ae2d-df7e064811cf service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:49.184982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f4ea3-4815-4791-ae2d-df7e064811cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:49.186092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f4ea3-4815-4791-ae2d-df7e064811cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:49.256512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075b4bd-db5c-4843-898f-a7142c13ff4e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:49.264903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b131261-6f4a-4a70-8f26-900cfbed4cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:49.265621 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b131261-6f4a-4a70-8f26-900cfbed4cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:49.265949 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b131261-6f4a-4a70-8f26-900cfbed4cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:49.266216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b131261-6f4a-4a70-8f26-900cfbed4cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:49.267000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b131261-6f4a-4a70-8f26-900cfbed4cb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:49.270265 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b131261-6f4a-4a70-8f26-900cfbed4cb9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:49.352979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f4ea3-4815-4791-ae2d-df7e064811cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:49.355651 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f4ea3-4815-4791-ae2d-df7e064811cf service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:49.372247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 980/1996] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:46:49.583028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1017/1997] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:49 2022] POST /identity/v3/projects => generated 363 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:49.589501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f4ea3-4815-4791-ae2d-df7e064811cf service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:49.613668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f4ea3-4815-4791-ae2d-df7e064811cf service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:49.691451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91d19b-fe28-4844-b9e7-55a814d45074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:49.692128 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91d19b-fe28-4844-b9e7-55a814d45074 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:49.692413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91d19b-fe28-4844-b9e7-55a814d45074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:49.692681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91d19b-fe28-4844-b9e7-55a814d45074 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:49.693324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91d19b-fe28-4844-b9e7-55a814d45074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:49.695340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91d19b-fe28-4844-b9e7-55a814d45074 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:49.736487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:49.863336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 981/1998] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:49 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:49.864770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b131261-6f4a-4a70-8f26-900cfbed4cb9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:49.885479 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b131261-6f4a-4a70-8f26-900cfbed4cb9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:49.898476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cf5f7-601e-449f-bba3-ea2da3e1d15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:49.900248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cf5f7-601e-449f-bba3-ea2da3e1d15f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:49.900511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cf5f7-601e-449f-bba3-ea2da3e1d15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:49.900909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cf5f7-601e-449f-bba3-ea2da3e1d15f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:49.901561 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cf5f7-601e-449f-bba3-ea2da3e1d15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:49.903926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cf5f7-601e-449f-bba3-ea2da3e1d15f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:49.943854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1018/1999] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:46:49.944680 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91d19b-fe28-4844-b9e7-55a814d45074 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:49.961793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91d19b-fe28-4844-b9e7-55a814d45074 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:49.973389 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033c50d-ff02-4e58-a1a5-07343c14754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:49.974804 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033c50d-ff02-4e58-a1a5-07343c14754a admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:49.975101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033c50d-ff02-4e58-a1a5-07343c14754a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:49.975429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033c50d-ff02-4e58-a1a5-07343c14754a admin admin] PATH_INFO: `/v3/projects/b01d1435833042e6aaea9ef302c19cb9/users/0ee440faf4924480a329c593d82a866e/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:50.006344 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033c50d-ff02-4e58-a1a5-07343c14754a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01d1435833042e6aaea9ef302c19cb9, user_id=0ee440faf4924480a329c593d82a866e, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:50.008442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033c50d-ff02-4e58-a1a5-07343c14754a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:50.205718 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 982/2000] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:49 2022] PUT /identity/v3/projects/b01d1435833042e6aaea9ef302c19cb9/users/0ee440faf4924480a329c593d82a866e/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:50.210127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cf5f7-601e-449f-bba3-ea2da3e1d15f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:50.223522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cf5f7-601e-449f-bba3-ea2da3e1d15f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:50.254974 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033c50d-ff02-4e58-a1a5-07343c14754a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:50.259125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5033c50d-ff02-4e58-a1a5-07343c14754a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:50.325829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef035-120e-4152-b025-9458ff9e3dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:50.326675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef035-120e-4152-b025-9458ff9e3dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:50.327177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef035-120e-4152-b025-9458ff9e3dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:50.327632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef035-120e-4152-b025-9458ff9e3dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:50.328811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cef035-120e-4152-b025-9458ff9e3dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:50.331656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cef035-120e-4152-b025-9458ff9e3dd0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:50.346621 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1019/2001] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:46:50.358108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef035-120e-4152-b025-9458ff9e3dd0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:50.362309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033c50d-ff02-4e58-a1a5-07343c14754a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:50.368991 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:50.370165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:50.370779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:50.371245 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] PATH_INFO: `/v3/projects/0bbfc2f748dd45d783cae25d18348047` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:50.372747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bbfc2f748dd45d783cae25d18348047)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:50.376146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:50.377104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef035-120e-4152-b025-9458ff9e3dd0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:50.390544 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba043f74-3ad9-41fd-8885-f11542becaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:50.391506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043f74-3ad9-41fd-8885-f11542becaaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:50.391701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043f74-3ad9-41fd-8885-f11542becaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:50.392134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043f74-3ad9-41fd-8885-f11542becaaa admin admin] PATH_INFO: `/v3/projects/b01d1435833042e6aaea9ef302c19cb9/users/0ee440faf4924480a329c593d82a866e/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:50.394128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba043f74-3ad9-41fd-8885-f11542becaaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01d1435833042e6aaea9ef302c19cb9, user_id=0ee440faf4924480a329c593d82a866e, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:50.397044 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba043f74-3ad9-41fd-8885-f11542becaaa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:50.413374 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1020/2002] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:50 2022] PUT /identity/v3/projects/b01d1435833042e6aaea9ef302c19cb9/users/0ee440faf4924480a329c593d82a866e/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:50.436911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a1c58-ae05-4bde-8d2a-276b8fa4f380 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:50.437359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a1c58-ae05-4bde-8d2a-276b8fa4f380 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:50.438260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a1c58-ae05-4bde-8d2a-276b8fa4f380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:50.500072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c29a1c58-ae05-4bde-8d2a-276b8fa4f380 None None] MFA Rules not processed for user `0ee440faf4924480a329c593d82a866e`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:50.501434 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c29a1c58-ae05-4bde-8d2a-276b8fa4f380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:50.608365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1021/2003] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:50.626268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a1c58-ae05-4bde-8d2a-276b8fa4f380 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:50.651900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c29a1c58-ae05-4bde-8d2a-276b8fa4f380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:50.652263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bbfc2f748dd45d783cae25d18348047', 'request_id': 'req-283aa4ff-408c-4757-8388-e79acd725640'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:50.652263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bbfc2f748dd45d783cae25d18348047', 'request_id': 'req-283aa4ff-408c-4757-8388-e79acd725640'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:50.698887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a1c58-ae05-4bde-8d2a-276b8fa4f380 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:50.762807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca797c-e334-44c6-a16f-386241f8537b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:50.764187 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca797c-e334-44c6-a16f-386241f8537b service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:50.764511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca797c-e334-44c6-a16f-386241f8537b service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:50.764976 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca797c-e334-44c6-a16f-386241f8537b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:50.840482 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca797c-e334-44c6-a16f-386241f8537b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:50.842810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca797c-e334-44c6-a16f-386241f8537b service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:50.853874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1022/2004] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:50.910201 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bbfc2f748dd45d783cae25d18348047', 'request_id': 'req-283aa4ff-408c-4757-8388-e79acd725640'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:50.923661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] The token cache is being invalidate because project 0bbfc2f748dd45d783cae25d18348047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:50.923992 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:50.924770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:50.926594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 983/2005] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:50 2022] DELETE /identity/v3/projects/0bbfc2f748dd45d783cae25d18348047 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:50.933153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca797c-e334-44c6-a16f-386241f8537b service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:51.013128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca797c-e334-44c6-a16f-386241f8537b service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:51.019142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:51.019793 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:51.020070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:51.020344 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] PATH_INFO: `/v3/users/9a17e9f425e14d14abc163acc3166367` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:51.021469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a17e9f425e14d14abc163acc3166367)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:51.023388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:51.290867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:51.292465 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:51.306271 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aa4ff-408c-4757-8388-e79acd725640 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:51.310960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10c68c-d1c2-47a0-95bf-a71bce70e360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:51.311775 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c68c-d1c2-47a0-95bf-a71bce70e360 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:51.312062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c68c-d1c2-47a0-95bf-a71bce70e360 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:51.312436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c68c-d1c2-47a0-95bf-a71bce70e360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:51.314320 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1b10c68c-d1c2-47a0-95bf-a71bce70e360 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:51.389226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c68c-d1c2-47a0-95bf-a71bce70e360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:51.390820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c68c-d1c2-47a0-95bf-a71bce70e360 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:51.400722 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 984/2006] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:46:51.457487 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a17e9f425e14d14abc163acc3166367'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:51.478947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a17e9f425e14d14abc163acc3166367'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:51.710667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a17e9f425e14d14abc163acc3166367'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:51.712625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a17e9f425e14d14abc163acc3166367'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:51.714282 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a17e9f425e14d14abc163acc3166367'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:51.765372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1023/2007] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:50 2022] DELETE /identity/v3/users/9a17e9f425e14d14abc163acc3166367 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:52.469754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:52.798771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10c68c-d1c2-47a0-95bf-a71bce70e360 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:52.800975 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1b10c68c-d1c2-47a0-95bf-a71bce70e360 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:52.830492 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10c68c-d1c2-47a0-95bf-a71bce70e360 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:52.937769 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:52.938979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:52.939275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:52.939779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae admin admin] PATH_INFO: `/v3/projects/15a53df9a32d4cb0beac427f58977ba2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:52.941418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a53df9a32d4cb0beac427f58977ba2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:52.943334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:53.002576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:53.004759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:53.022168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976b01b-fa83-4898-8d5d-80f5b06b52b5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:53.028328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc779a-d47f-4eb3-a1d6-9be900c5c07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:53.029421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc779a-d47f-4eb3-a1d6-9be900c5c07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:53.029855 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc779a-d47f-4eb3-a1d6-9be900c5c07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:53.030367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc779a-d47f-4eb3-a1d6-9be900c5c07a admin admin] PATH_INFO: `/v3/users/9c9f84c12c4049eebe2db84098f129c3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:53.031613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc779a-d47f-4eb3-a1d6-9be900c5c07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9f84c12c4049eebe2db84098f129c3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:53.033702 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc779a-d47f-4eb3-a1d6-9be900c5c07a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:53.125608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a53df9a32d4cb0beac427f58977ba2', 'request_id': 'req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:53.141312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a53df9a32d4cb0beac427f58977ba2', 'request_id': 'req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:53.328549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a53df9a32d4cb0beac427f58977ba2', 'request_id': 'req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:53.349841 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae admin admin] The token cache is being invalidate because project 15a53df9a32d4cb0beac427f58977ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:53.350273 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:53.351034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a9e96bd9-0963-473e-936b-e6c1a0fe8eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:53.352914 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 985/2008] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:52 2022] DELETE /identity/v3/projects/15a53df9a32d4cb0beac427f58977ba2 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:53.363812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d9590-f36d-499a-8c47-a6c886f1c96f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:53.364078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d9590-f36d-499a-8c47-a6c886f1c96f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:53.364366 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d9590-f36d-499a-8c47-a6c886f1c96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:53.414053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cfdc779a-d47f-4eb3-a1d6-9be900c5c07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9f84c12c4049eebe2db84098f129c3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:53.434916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cfdc779a-d47f-4eb3-a1d6-9be900c5c07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9f84c12c4049eebe2db84098f129c3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:53.436714 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a82d9590-f36d-499a-8c47-a6c886f1c96f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:53.440297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a82d9590-f36d-499a-8c47-a6c886f1c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:53.542043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 986/2009] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:53.555307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fff60-1060-4de0-aff6-b21d6b65bb96 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:53.555592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fff60-1060-4de0-aff6-b21d6b65bb96 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:53.555916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fff60-1060-4de0-aff6-b21d6b65bb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:53.581517 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c98fff60-1060-4de0-aff6-b21d6b65bb96 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:53.582581 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c98fff60-1060-4de0-aff6-b21d6b65bb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:53.597186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 987/2010] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:53.604637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fff60-1060-4de0-aff6-b21d6b65bb96 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:53.608024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cfdc779a-d47f-4eb3-a1d6-9be900c5c07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9f84c12c4049eebe2db84098f129c3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:53.609279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cfdc779a-d47f-4eb3-a1d6-9be900c5c07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9f84c12c4049eebe2db84098f129c3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:53.610456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cfdc779a-d47f-4eb3-a1d6-9be900c5c07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9f84c12c4049eebe2db84098f129c3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:53.633621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fff60-1060-4de0-aff6-b21d6b65bb96 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:53.645041 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1024/2011] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:53 2022] DELETE /identity/v3/users/9c9f84c12c4049eebe2db84098f129c3 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:53.658956 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:53.668685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f711a8c-7b12-40c5-8875-b7707a61a33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:53.668685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f711a8c-7b12-40c5-8875-b7707a61a33c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:53.669147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5078085-2234-4502-a79e-4ba721015f5b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:53.669147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5078085-2234-4502-a79e-4ba721015f5b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:53.669147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5078085-2234-4502-a79e-4ba721015f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:53.670145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f711a8c-7b12-40c5-8875-b7707a61a33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:53.670867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f711a8c-7b12-40c5-8875-b7707a61a33c admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:53.672413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f711a8c-7b12-40c5-8875-b7707a61a33c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:53.674781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f711a8c-7b12-40c5-8875-b7707a61a33c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:53.680019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f711a8c-7b12-40c5-8875-b7707a61a33c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:53.708162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 988/2012] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:46:53.708415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e5078085-2234-4502-a79e-4ba721015f5b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:53.708598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e5078085-2234-4502-a79e-4ba721015f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:53.710178 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f711a8c-7b12-40c5-8875-b7707a61a33c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:53.717522 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6f711a8c-7b12-40c5-8875-b7707a61a33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:53.739926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f711a8c-7b12-40c5-8875-b7707a61a33c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:53.810602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1025/2013] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:53.824549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5078085-2234-4502-a79e-4ba721015f5b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:53.826450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e5078085-2234-4502-a79e-4ba721015f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:53.827771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178e645-b333-4a7d-8764-57a95ffe2ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:53.828503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178e645-b333-4a7d-8764-57a95ffe2ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:53.829664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178e645-b333-4a7d-8764-57a95ffe2ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:53.829664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178e645-b333-4a7d-8764-57a95ffe2ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:53.830820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178e645-b333-4a7d-8764-57a95ffe2ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:53.832542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178e645-b333-4a7d-8764-57a95ffe2ad2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:53.940951 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5078085-2234-4502-a79e-4ba721015f5b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:53.954726 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7a91d-6c72-4e98-8dd0-4969c35ac7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:53.956033 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7a91d-6c72-4e98-8dd0-4969c35ac7cd service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:53.956477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7a91d-6c72-4e98-8dd0-4969c35ac7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:53.956994 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7a91d-6c72-4e98-8dd0-4969c35ac7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:53.986971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7a91d-6c72-4e98-8dd0-4969c35ac7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:53.990726 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7a91d-6c72-4e98-8dd0-4969c35ac7cd service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:54.014796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1026/2014] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:46:54.105394 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 989/2015] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:53 2022] POST /identity/v3/projects => generated 401 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:54.112583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7a91d-6c72-4e98-8dd0-4969c35ac7cd service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:54.124830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7a91d-6c72-4e98-8dd0-4969c35ac7cd service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:54.259769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e09d1-1a62-4d26-8372-7eb617dddfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:54.261337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e09d1-1a62-4d26-8372-7eb617dddfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:54.261749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e09d1-1a62-4d26-8372-7eb617dddfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:54.262613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e09d1-1a62-4d26-8372-7eb617dddfe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:54.265338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e09d1-1a62-4d26-8372-7eb617dddfe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:54.268428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e09d1-1a62-4d26-8372-7eb617dddfe2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:54.454318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1027/2016] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:54 2022] POST /identity/v3/users => generated 301 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:54.460163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178e645-b333-4a7d-8764-57a95ffe2ad2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:54.484809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178e645-b333-4a7d-8764-57a95ffe2ad2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:54.499394 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26583f-be7e-46cb-915b-f33a2ddb89b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:54.500785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26583f-be7e-46cb-915b-f33a2ddb89b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:54.501403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26583f-be7e-46cb-915b-f33a2ddb89b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:54.502017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26583f-be7e-46cb-915b-f33a2ddb89b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:54.504606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26583f-be7e-46cb-915b-f33a2ddb89b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:54.508820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26583f-be7e-46cb-915b-f33a2ddb89b6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:54.526955 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 990/2017] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:54.533197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e09d1-1a62-4d26-8372-7eb617dddfe2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:54.549484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e09d1-1a62-4d26-8372-7eb617dddfe2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:54.558858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0174d-7325-4f11-94c1-798b2c27a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:54.559883 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0174d-7325-4f11-94c1-798b2c27a5fb admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:54.561465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0174d-7325-4f11-94c1-798b2c27a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:54.562159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0174d-7325-4f11-94c1-798b2c27a5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:54.563229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0174d-7325-4f11-94c1-798b2c27a5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:54.565994 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0174d-7325-4f11-94c1-798b2c27a5fb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:54.590454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1028/2018] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:54.598609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26583f-be7e-46cb-915b-f33a2ddb89b6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:54.617323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26583f-be7e-46cb-915b-f33a2ddb89b6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:54.627433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287d480-05cb-4a5a-b369-58331dbeb7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:54.628812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287d480-05cb-4a5a-b369-58331dbeb7db admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:54.630170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287d480-05cb-4a5a-b369-58331dbeb7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:54.630651 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287d480-05cb-4a5a-b369-58331dbeb7db admin admin] PATH_INFO: `/v3/projects/ea7e60058a634412915f49ee7665a2c5/users/36e75c27bc22461f9d5e992225610855/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:54.680649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287d480-05cb-4a5a-b369-58331dbeb7db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e60058a634412915f49ee7665a2c5, user_id=36e75c27bc22461f9d5e992225610855, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:54.683670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287d480-05cb-4a5a-b369-58331dbeb7db admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:54.833573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 991/2019] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:54 2022] PUT /identity/v3/projects/ea7e60058a634412915f49ee7665a2c5/users/36e75c27bc22461f9d5e992225610855/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:54.858876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a2ca-2f2c-43c9-be48-ff2794c6bbfc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:54.859834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a2ca-2f2c-43c9-be48-ff2794c6bbfc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:54.859834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a2ca-2f2c-43c9-be48-ff2794c6bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:54.978323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-35f1a2ca-2f2c-43c9-be48-ff2794c6bbfc None None] MFA Rules not processed for user `36e75c27bc22461f9d5e992225610855`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:54.983751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-35f1a2ca-2f2c-43c9-be48-ff2794c6bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:55.086609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1029/2020] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:55.093598 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287d480-05cb-4a5a-b369-58331dbeb7db admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:55.244545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287d480-05cb-4a5a-b369-58331dbeb7db admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:55.252837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126b7a1-6635-4df3-b593-9b7f98fcb752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:55.253782 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126b7a1-6635-4df3-b593-9b7f98fcb752 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:55.264054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126b7a1-6635-4df3-b593-9b7f98fcb752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:55.265736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126b7a1-6635-4df3-b593-9b7f98fcb752 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:55.266572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126b7a1-6635-4df3-b593-9b7f98fcb752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:55.269986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126b7a1-6635-4df3-b593-9b7f98fcb752 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:55.540052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 992/2021] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:55 2022] POST /identity/v3/projects => generated 401 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:55.553707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a2ca-2f2c-43c9-be48-ff2794c6bbfc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:55.574395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a2ca-2f2c-43c9-be48-ff2794c6bbfc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:55.581487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240751-dd93-43e0-ad89-6992c1777c6f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:55.582112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240751-dd93-43e0-ad89-6992c1777c6f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:55.583017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240751-dd93-43e0-ad89-6992c1777c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:55.619489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1c240751-dd93-43e0-ad89-6992c1777c6f None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:55.621582 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1c240751-dd93-43e0-ad89-6992c1777c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:55.680496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24428925-73ef-46f0-af29-db2b2b0a8271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:55.681351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24428925-73ef-46f0-af29-db2b2b0a8271 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:55.681855 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24428925-73ef-46f0-af29-db2b2b0a8271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:55.682346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24428925-73ef-46f0-af29-db2b2b0a8271 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:55.683305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24428925-73ef-46f0-af29-db2b2b0a8271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:55.687496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24428925-73ef-46f0-af29-db2b2b0a8271 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:55.722848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 993/2022] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:46:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:55.728454 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c240751-dd93-43e0-ad89-6992c1777c6f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:55.730313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1c240751-dd93-43e0-ad89-6992c1777c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:55.758642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c240751-dd93-43e0-ad89-6992c1777c6f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:55.765952 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:55.766828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:55.767358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:55.767358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] PATH_INFO: `/v3/projects/806ac9e6e5084f619dcf41962c3e8625` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:55.768349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=806ac9e6e5084f619dcf41962c3e8625)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:55.770308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:55.898359 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:55.908116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1030/2023] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:55 2022] POST /identity/v3/users => generated 307 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:55.909004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24428925-73ef-46f0-af29-db2b2b0a8271 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:55.911543 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-24428925-73ef-46f0-af29-db2b2b0a8271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:56.043037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24428925-73ef-46f0-af29-db2b2b0a8271 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:56.053390 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26b2e5-1c44-40b4-a7dc-dd398bf4b639 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:56.054106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26b2e5-1c44-40b4-a7dc-dd398bf4b639 service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:56.054889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26b2e5-1c44-40b4-a7dc-dd398bf4b639 service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:56.054889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26b2e5-1c44-40b4-a7dc-dd398bf4b639 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:56.067839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26b2e5-1c44-40b4-a7dc-dd398bf4b639 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:56.070609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26b2e5-1c44-40b4-a7dc-dd398bf4b639 service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:56.082091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1031/2024] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:46:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:46:56.084144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26b2e5-1c44-40b4-a7dc-dd398bf4b639 service swift] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:56.094845 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806ac9e6e5084f619dcf41962c3e8625', 'request_id': 'req-ebfe5139-c5a5-4002-9ce9-d68b108f9575'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:56.101684 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26b2e5-1c44-40b4-a7dc-dd398bf4b639 service swift] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:56.128146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806ac9e6e5084f619dcf41962c3e8625', 'request_id': 'req-ebfe5139-c5a5-4002-9ce9-d68b108f9575'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:56.204191 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3dc99-de72-43b6-84f0-2634eedc2620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:56.205208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3dc99-de72-43b6-84f0-2634eedc2620 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:56.205597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3dc99-de72-43b6-84f0-2634eedc2620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:56.206119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3dc99-de72-43b6-84f0-2634eedc2620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:56.207218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3dc99-de72-43b6-84f0-2634eedc2620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:56.209848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3dc99-de72-43b6-84f0-2634eedc2620 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:56.224954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1032/2025] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:56.229670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3dc99-de72-43b6-84f0-2634eedc2620 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:56.243868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3dc99-de72-43b6-84f0-2634eedc2620 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:56.250271 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab9a5a-a53f-48a6-97f7-b1befe6376e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:56.250952 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab9a5a-a53f-48a6-97f7-b1befe6376e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:56.251231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab9a5a-a53f-48a6-97f7-b1befe6376e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:56.251515 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab9a5a-a53f-48a6-97f7-b1befe6376e5 admin admin] PATH_INFO: `/v3/projects/1b64e0b159c548feb67c0be44533f1c0/users/cd37ba0329864a48be41e39d1bf30bf4/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:56.273615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab9a5a-a53f-48a6-97f7-b1befe6376e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b64e0b159c548feb67c0be44533f1c0, user_id=cd37ba0329864a48be41e39d1bf30bf4, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:56.281124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab9a5a-a53f-48a6-97f7-b1befe6376e5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:56.362680 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806ac9e6e5084f619dcf41962c3e8625', 'request_id': 'req-ebfe5139-c5a5-4002-9ce9-d68b108f9575'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:56.391219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] The token cache is being invalidate because project 806ac9e6e5084f619dcf41962c3e8625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:56.392191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:56.393266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:56.395660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 994/2026] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:55 2022] DELETE /identity/v3/projects/806ac9e6e5084f619dcf41962c3e8625 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:56.400883 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:56.402917 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:56.420179 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1033/2027] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:56 2022] PUT /identity/v3/projects/1b64e0b159c548feb67c0be44533f1c0/users/cd37ba0329864a48be41e39d1bf30bf4/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:56.425233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab9a5a-a53f-48a6-97f7-b1befe6376e5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:56.432077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-feab9a5a-a53f-48a6-97f7-b1befe6376e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:56.455347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe5139-c5a5-4002-9ce9-d68b108f9575 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:56.538573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab9a5a-a53f-48a6-97f7-b1befe6376e5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:56.548394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ff1d2-8ef6-4c80-9495-efcd16b57b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:56.549481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ff1d2-8ef6-4c80-9495-efcd16b57b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:56.549602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268be679-a66f-4868-981a-fb5e1d6695f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:56.549971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ff1d2-8ef6-4c80-9495-efcd16b57b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:56.550448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ff1d2-8ef6-4c80-9495-efcd16b57b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:56.550633 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268be679-a66f-4868-981a-fb5e1d6695f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:56.551320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ff1d2-8ef6-4c80-9495-efcd16b57b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:56.551784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268be679-a66f-4868-981a-fb5e1d6695f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:56.552092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268be679-a66f-4868-981a-fb5e1d6695f6 admin admin] PATH_INFO: `/v3/users/2e7b062185624536a188064754853f1f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:56.553571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ff1d2-8ef6-4c80-9495-efcd16b57b2b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:56.555936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268be679-a66f-4868-981a-fb5e1d6695f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7b062185624536a188064754853f1f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:56.563276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268be679-a66f-4868-981a-fb5e1d6695f6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:56.566661 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1034/2028] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:56.574686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ff1d2-8ef6-4c80-9495-efcd16b57b2b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:56.651105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ff1d2-8ef6-4c80-9495-efcd16b57b2b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:56.682448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c369b88-1380-4c52-9630-f9a466cf9edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:56.686171 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c369b88-1380-4c52-9630-f9a466cf9edc admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:56.686590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c369b88-1380-4c52-9630-f9a466cf9edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:56.687068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c369b88-1380-4c52-9630-f9a466cf9edc admin admin] PATH_INFO: `/v3/projects/1b64e0b159c548feb67c0be44533f1c0/users/cd37ba0329864a48be41e39d1bf30bf4/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:56.696224 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c369b88-1380-4c52-9630-f9a466cf9edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b64e0b159c548feb67c0be44533f1c0, user_id=cd37ba0329864a48be41e39d1bf30bf4, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:56.704017 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c369b88-1380-4c52-9630-f9a466cf9edc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:56.729781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1035/2029] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:56 2022] PUT /identity/v3/projects/1b64e0b159c548feb67c0be44533f1c0/users/cd37ba0329864a48be41e39d1bf30bf4/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:56.749813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55f0cf-5aab-443b-9de3-98794d370846 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:56.754873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55f0cf-5aab-443b-9de3-98794d370846 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:56.754873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55f0cf-5aab-443b-9de3-98794d370846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:56.826264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9b55f0cf-5aab-443b-9de3-98794d370846 None None] MFA Rules not processed for user `cd37ba0329864a48be41e39d1bf30bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:56.828706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9b55f0cf-5aab-443b-9de3-98794d370846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:56.964642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-268be679-a66f-4868-981a-fb5e1d6695f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7b062185624536a188064754853f1f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:56.965963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-268be679-a66f-4868-981a-fb5e1d6695f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7b062185624536a188064754853f1f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:56.975014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1036/2030] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:56 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:56.988313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55f0cf-5aab-443b-9de3-98794d370846 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:56.990202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9b55f0cf-5aab-443b-9de3-98794d370846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:56.997150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-268be679-a66f-4868-981a-fb5e1d6695f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7b062185624536a188064754853f1f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:57.009494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-268be679-a66f-4868-981a-fb5e1d6695f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7b062185624536a188064754853f1f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:57.011076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-268be679-a66f-4868-981a-fb5e1d6695f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7b062185624536a188064754853f1f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:57.073282 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55f0cf-5aab-443b-9de3-98794d370846 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:57.079252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db358e-7625-43fb-9275-c3ba33f58112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:57.079912 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db358e-7625-43fb-9275-c3ba33f58112 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:57.080305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db358e-7625-43fb-9275-c3ba33f58112 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:57.080459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db358e-7625-43fb-9275-c3ba33f58112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:57.082695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a8db358e-7625-43fb-9275-c3ba33f58112 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:57.106301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db358e-7625-43fb-9275-c3ba33f58112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:57.110351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db358e-7625-43fb-9275-c3ba33f58112 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:57.137360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1037/2031] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:56 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:46:57.165441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 995/2032] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:56 2022] DELETE /identity/v3/users/2e7b062185624536a188064754853f1f => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:57.345948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:57.845792 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db358e-7625-43fb-9275-c3ba33f58112 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:57.849159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a8db358e-7625-43fb-9275-c3ba33f58112 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:57.869665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db358e-7625-43fb-9275-c3ba33f58112 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:57.978419 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2201b-7cad-4690-8e60-bd75bd681a27 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:57.979005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2201b-7cad-4690-8e60-bd75bd681a27 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:57.988114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2201b-7cad-4690-8e60-bd75bd681a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:57.996420 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:58.027789 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8fb2201b-7cad-4690-8e60-bd75bd681a27 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:58.030017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8fb2201b-7cad-4690-8e60-bd75bd681a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:58.034002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96094d2a-fc5e-41b5-a983-7e2d9a510d6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:58.035273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96094d2a-fc5e-41b5-a983-7e2d9a510d6c service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:58.035273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96094d2a-fc5e-41b5-a983-7e2d9a510d6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:58.036417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96094d2a-fc5e-41b5-a983-7e2d9a510d6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:58.044996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-96094d2a-fc5e-41b5-a983-7e2d9a510d6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:58.152878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96094d2a-fc5e-41b5-a983-7e2d9a510d6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:58.156637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96094d2a-fc5e-41b5-a983-7e2d9a510d6c service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:58.166651 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 996/2033] 10.222.0.91 () {58 vars in 967 bytes} [Wed Aug 24 10:46:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:58.173020 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2201b-7cad-4690-8e60-bd75bd681a27 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:58.173438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1038/2034] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:57 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:58.173516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8fb2201b-7cad-4690-8e60-bd75bd681a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:58.186049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96094d2a-fc5e-41b5-a983-7e2d9a510d6c service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:58.187840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-96094d2a-fc5e-41b5-a983-7e2d9a510d6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:58.390593 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2201b-7cad-4690-8e60-bd75bd681a27 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:58.390593 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:58.390593 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:58.390593 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:58.391963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e admin admin] PATH_INFO: `/v3/projects/88eb9e95b7d74fb282593afac9663fa0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:58.391963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88eb9e95b7d74fb282593afac9663fa0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:58.391963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:58.393675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96094d2a-fc5e-41b5-a983-7e2d9a510d6c service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:58.393675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8c24-73f8-490b-a92c-61534558d349 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:58.397476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8c24-73f8-490b-a92c-61534558d349 service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:58.398515 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8c24-73f8-490b-a92c-61534558d349 service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:58.398799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8c24-73f8-490b-a92c-61534558d349 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:58.418872 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8c24-73f8-490b-a92c-61534558d349 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:58.422693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8c24-73f8-490b-a92c-61534558d349 service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:58.443667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1039/2035] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:46:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:46:58.883510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88eb9e95b7d74fb282593afac9663fa0', 'request_id': 'req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:58.894662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88eb9e95b7d74fb282593afac9663fa0', 'request_id': 'req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:59.088357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88eb9e95b7d74fb282593afac9663fa0', 'request_id': 'req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:59.113153 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e admin admin] The token cache is being invalidate because project 88eb9e95b7d74fb282593afac9663fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:59.113541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:59.114348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-645b5a4c-bdc0-4015-bb61-b2c0dad9164e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:59.116666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 997/2036] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:58 2022] DELETE /identity/v3/projects/88eb9e95b7d74fb282593afac9663fa0 => generated 0 bytes in 949 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:59.126683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf74ec2-7c78-489e-8915-2a4d3b73d1f9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:59.127900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf74ec2-7c78-489e-8915-2a4d3b73d1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:59.128363 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf74ec2-7c78-489e-8915-2a4d3b73d1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:59.158444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3cf74ec2-7c78-489e-8915-2a4d3b73d1f9 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:59.159905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3cf74ec2-7c78-489e-8915-2a4d3b73d1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:59.285770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1040/2037] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:59.301764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16810dc-9bf7-4a82-857c-9d14b6c0fc69 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:59.301764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16810dc-9bf7-4a82-857c-9d14b6c0fc69 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:59.302072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16810dc-9bf7-4a82-857c-9d14b6c0fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:59.338511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a16810dc-9bf7-4a82-857c-9d14b6c0fc69 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:59.339899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a16810dc-9bf7-4a82-857c-9d14b6c0fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:59.353028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 998/2038] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:59.358727 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf74ec2-7c78-489e-8915-2a4d3b73d1f9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:59.375344 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf74ec2-7c78-489e-8915-2a4d3b73d1f9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:59.383244 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92afcd-72c0-4559-ad91-a05a2af29233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:59.384125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92afcd-72c0-4559-ad91-a05a2af29233 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:59.384548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92afcd-72c0-4559-ad91-a05a2af29233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:59.385050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92afcd-72c0-4559-ad91-a05a2af29233 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:59.386133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92afcd-72c0-4559-ad91-a05a2af29233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:59.386658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92afcd-72c0-4559-ad91-a05a2af29233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:59.390904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92afcd-72c0-4559-ad91-a05a2af29233 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:59.408649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1041/2039] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:46:59.413683 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16810dc-9bf7-4a82-857c-9d14b6c0fc69 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:59.429838 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16810dc-9bf7-4a82-857c-9d14b6c0fc69 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:59.436293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412accb-b45d-49b4-a4e4-3760ae0c95ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:59.437312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412accb-b45d-49b4-a4e4-3760ae0c95ec admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:59.437804 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412accb-b45d-49b4-a4e4-3760ae0c95ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:59.438069 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412accb-b45d-49b4-a4e4-3760ae0c95ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:59.438899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412accb-b45d-49b4-a4e4-3760ae0c95ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:59.441447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412accb-b45d-49b4-a4e4-3760ae0c95ec admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:59.574748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 999/2040] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:59 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:59.578243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92afcd-72c0-4559-ad91-a05a2af29233 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:59.599153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92afcd-72c0-4559-ad91-a05a2af29233 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:59.714579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6eae2c-3b5a-42b9-8b92-5cff629e123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:59.715337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6eae2c-3b5a-42b9-8b92-5cff629e123c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:59.715705 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6eae2c-3b5a-42b9-8b92-5cff629e123c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:59.716723 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6eae2c-3b5a-42b9-8b92-5cff629e123c admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:59.717804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6eae2c-3b5a-42b9-8b92-5cff629e123c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:59.720446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6eae2c-3b5a-42b9-8b92-5cff629e123c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:59.936830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1042/2041] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:59 2022] POST /identity/v3/users => generated 283 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:59.938481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412accb-b45d-49b4-a4e4-3760ae0c95ec admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:59.955431 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412accb-b45d-49b4-a4e4-3760ae0c95ec admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:59.960784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84162a33-0530-46d0-a705-7e968d05f315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:59.962005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84162a33-0530-46d0-a705-7e968d05f315 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:59.962005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84162a33-0530-46d0-a705-7e968d05f315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:59.962005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84162a33-0530-46d0-a705-7e968d05f315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:59.962554 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84162a33-0530-46d0-a705-7e968d05f315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:59.964680 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84162a33-0530-46d0-a705-7e968d05f315 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:59.982461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd338e-d84c-41b8-8e1a-88fe9703d601 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:59.983167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd338e-d84c-41b8-8e1a-88fe9703d601 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:59.993859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd338e-d84c-41b8-8e1a-88fe9703d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:59.994013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1000/2042] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:59.996052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84162a33-0530-46d0-a705-7e968d05f315 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:00.011632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84162a33-0530-46d0-a705-7e968d05f315 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:00.012441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f2bd338e-d84c-41b8-8e1a-88fe9703d601 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:00.014283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f2bd338e-d84c-41b8-8e1a-88fe9703d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:00.018210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cb935-8457-4418-af12-9a458473142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:00.019042 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cb935-8457-4418-af12-9a458473142f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:00.019445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cb935-8457-4418-af12-9a458473142f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:00.019880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cb935-8457-4418-af12-9a458473142f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:00.020925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cb935-8457-4418-af12-9a458473142f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:00.023451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cb935-8457-4418-af12-9a458473142f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:00.038248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1001/2043] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:00.052164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cb935-8457-4418-af12-9a458473142f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:00.070390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cb935-8457-4418-af12-9a458473142f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:00.077232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0617f7-439b-4213-a086-e0277f2264c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:00.078079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0617f7-439b-4213-a086-e0277f2264c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:00.078536 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0617f7-439b-4213-a086-e0277f2264c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:00.079023 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0617f7-439b-4213-a086-e0277f2264c5 admin admin] PATH_INFO: `/v3/projects/ebb14eaae11744c6a4e8f1d20612558b/users/c9ebbc99270c4357afe873f357ba4372/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:00.098254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0617f7-439b-4213-a086-e0277f2264c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb14eaae11744c6a4e8f1d20612558b, user_id=c9ebbc99270c4357afe873f357ba4372, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:00.099862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1043/2044] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:46:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:00.101079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0617f7-439b-4213-a086-e0277f2264c5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:00.114736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd338e-d84c-41b8-8e1a-88fe9703d601 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:00.116286 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f2bd338e-d84c-41b8-8e1a-88fe9703d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:00.207469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd338e-d84c-41b8-8e1a-88fe9703d601 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:00.212988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511ee3a-5396-453c-9ef3-bea41a2258bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:00.219859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511ee3a-5396-453c-9ef3-bea41a2258bd service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:00.219859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511ee3a-5396-453c-9ef3-bea41a2258bd service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:00.219859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511ee3a-5396-453c-9ef3-bea41a2258bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:00.224568 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511ee3a-5396-453c-9ef3-bea41a2258bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:00.226305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511ee3a-5396-453c-9ef3-bea41a2258bd service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:00.238084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1044/2045] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:47:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:47:00.384138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1002/2046] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:00 2022] PUT /identity/v3/projects/ebb14eaae11744c6a4e8f1d20612558b/users/c9ebbc99270c4357afe873f357ba4372/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:00.401658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b5a8-419e-4d14-a7b8-bfd894fc64ad None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:00.402249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b5a8-419e-4d14-a7b8-bfd894fc64ad None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:00.402859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b5a8-419e-4d14-a7b8-bfd894fc64ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:00.455142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5440b5a8-419e-4d14-a7b8-bfd894fc64ad None None] MFA Rules not processed for user `c9ebbc99270c4357afe873f357ba4372`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:00.457103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5440b5a8-419e-4d14-a7b8-bfd894fc64ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:00.557490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1045/2047] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:00.570381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0617f7-439b-4213-a086-e0277f2264c5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:00.572436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-da0617f7-439b-4213-a086-e0277f2264c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:00.655865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0617f7-439b-4213-a086-e0277f2264c5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:00.660421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91282193-d7ea-41c1-82ba-303ad5a25096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:00.661049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91282193-d7ea-41c1-82ba-303ad5a25096 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:00.661357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91282193-d7ea-41c1-82ba-303ad5a25096 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:00.661605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91282193-d7ea-41c1-82ba-303ad5a25096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:00.672398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91282193-d7ea-41c1-82ba-303ad5a25096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:00.673685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91282193-d7ea-41c1-82ba-303ad5a25096 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:00.684072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1003/2048] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:01.391554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2136681-94af-4528-bbed-a21538cc3551 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:01.396637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2136681-94af-4528-bbed-a21538cc3551 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:01.396637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2136681-94af-4528-bbed-a21538cc3551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:01.416142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f2136681-94af-4528-bbed-a21538cc3551 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:01.417472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f2136681-94af-4528-bbed-a21538cc3551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:01.503421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1046/2049] 10.222.0.91 () {58 vars in 967 bytes} [Wed Aug 24 10:47:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:01.517640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91282193-d7ea-41c1-82ba-303ad5a25096 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:01.707207 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91282193-d7ea-41c1-82ba-303ad5a25096 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:01.718461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89f65b-d4b2-436a-a2d3-e7d526cae900 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:01.719100 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89f65b-d4b2-436a-a2d3-e7d526cae900 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:01.719370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89f65b-d4b2-436a-a2d3-e7d526cae900 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:01.719939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89f65b-d4b2-436a-a2d3-e7d526cae900 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:01.733904 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89f65b-d4b2-436a-a2d3-e7d526cae900 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:01.735841 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89f65b-d4b2-436a-a2d3-e7d526cae900 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:01.754895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1004/2050] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:47:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:47:04.152200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:05.439537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2136681-94af-4528-bbed-a21538cc3551 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:05.443184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f2136681-94af-4528-bbed-a21538cc3551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:05.466903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=2,keystone:DELETE=21,keystone:SELECT=77 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:05.563111 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2136681-94af-4528-bbed-a21538cc3551 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:05.576956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:05.579602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:05.580188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:05.580680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] PATH_INFO: `/v3/users/3ba7495915a5415b82694191b3ad7110` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:05.586368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba7495915a5415b82694191b3ad7110)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:05.591769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:06.232252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba7495915a5415b82694191b3ad7110'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:06.248961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba7495915a5415b82694191b3ad7110'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:06.492929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba7495915a5415b82694191b3ad7110'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:06.493795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba7495915a5415b82694191b3ad7110'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:06.496260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba7495915a5415b82694191b3ad7110'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:06.517532 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1047/2051] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:05 2022] DELETE /identity/v3/users/3ba7495915a5415b82694191b3ad7110 => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:06.525660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ddf10-6a39-4bd8-9ddb-32955bb2cbd4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:06.526318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ddf10-6a39-4bd8-9ddb-32955bb2cbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:06.526476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ddf10-6a39-4bd8-9ddb-32955bb2cbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:06.553193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b46ddf10-6a39-4bd8-9ddb-32955bb2cbd4 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:06.554641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b46ddf10-6a39-4bd8-9ddb-32955bb2cbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:06.609195 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:06.612275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:06.654657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1005/2052] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:06.671941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ddf10-6a39-4bd8-9ddb-32955bb2cbd4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:06.674475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b46ddf10-6a39-4bd8-9ddb-32955bb2cbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:06.725108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d728cd4-aea2-4a20-b4f2-ee6faadf120d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:06.732011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f0975-9d6d-49c9-afb3-7201291e547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:06.732720 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0975-9d6d-49c9-afb3-7201291e547f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:06.733002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0975-9d6d-49c9-afb3-7201291e547f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:06.733329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0975-9d6d-49c9-afb3-7201291e547f admin admin] PATH_INFO: `/v3/users/36e75c27bc22461f9d5e992225610855` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:06.734537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f0975-9d6d-49c9-afb3-7201291e547f admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e75c27bc22461f9d5e992225610855)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:06.736577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f0975-9d6d-49c9-afb3-7201291e547f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:06.784822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ddf10-6a39-4bd8-9ddb-32955bb2cbd4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:06.791762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80611431-bc8d-405d-9f04-fe2ea67591d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:06.793520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80611431-bc8d-405d-9f04-fe2ea67591d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:06.795954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80611431-bc8d-405d-9f04-fe2ea67591d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:06.796506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80611431-bc8d-405d-9f04-fe2ea67591d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:06.818489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80611431-bc8d-405d-9f04-fe2ea67591d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:06.821518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80611431-bc8d-405d-9f04-fe2ea67591d8 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:06.838463 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1006/2053] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:07.110342 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80611431-bc8d-405d-9f04-fe2ea67591d8 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:07.113114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-80611431-bc8d-405d-9f04-fe2ea67591d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:07.125821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-af8f0975-9d6d-49c9-afb3-7201291e547f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e75c27bc22461f9d5e992225610855'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:07.137033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80611431-bc8d-405d-9f04-fe2ea67591d8 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:07.144404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-af8f0975-9d6d-49c9-afb3-7201291e547f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e75c27bc22461f9d5e992225610855'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:07.146262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbcc08-6081-47db-a598-65a90e0c3380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:07.174091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbcc08-6081-47db-a598-65a90e0c3380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:07.174091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbcc08-6081-47db-a598-65a90e0c3380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:07.174091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbcc08-6081-47db-a598-65a90e0c3380 admin admin] PATH_INFO: `/v3/users/7ce2b798833249db9cc0ff000c779ec3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:07.174091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbcc08-6081-47db-a598-65a90e0c3380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce2b798833249db9cc0ff000c779ec3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:07.174091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbcc08-6081-47db-a598-65a90e0c3380 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:07.317127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-af8f0975-9d6d-49c9-afb3-7201291e547f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e75c27bc22461f9d5e992225610855'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:07.317944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-af8f0975-9d6d-49c9-afb3-7201291e547f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e75c27bc22461f9d5e992225610855'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:07.318819 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-af8f0975-9d6d-49c9-afb3-7201291e547f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e75c27bc22461f9d5e992225610855'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:07.345643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1048/2054] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:06 2022] DELETE /identity/v3/users/36e75c27bc22461f9d5e992225610855 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:07.353006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8bd58-d554-4e7b-9150-7cf7ee51bd4c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:07.353518 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8bd58-d554-4e7b-9150-7cf7ee51bd4c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:07.354002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8bd58-d554-4e7b-9150-7cf7ee51bd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:07.402103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-09f8bd58-d554-4e7b-9150-7cf7ee51bd4c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:07.405091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-09f8bd58-d554-4e7b-9150-7cf7ee51bd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:07.487913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1049/2055] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:07.506299 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8bd58-d554-4e7b-9150-7cf7ee51bd4c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:07.509961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-09f8bd58-d554-4e7b-9150-7cf7ee51bd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:07.612194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8bd58-d554-4e7b-9150-7cf7ee51bd4c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:07.616494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a77f5-ca81-45bc-b3dc-cf51cf3f5773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:07.617171 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a77f5-ca81-45bc-b3dc-cf51cf3f5773 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:07.617458 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a77f5-ca81-45bc-b3dc-cf51cf3f5773 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:07.617733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a77f5-ca81-45bc-b3dc-cf51cf3f5773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:07.629984 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a77f5-ca81-45bc-b3dc-cf51cf3f5773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:07.631703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a77f5-ca81-45bc-b3dc-cf51cf3f5773 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:07.643599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1050/2056] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:07.749896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a4cbcc08-6081-47db-a598-65a90e0c3380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce2b798833249db9cc0ff000c779ec3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:07.751137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a4cbcc08-6081-47db-a598-65a90e0c3380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce2b798833249db9cc0ff000c779ec3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:07.762417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a77f5-ca81-45bc-b3dc-cf51cf3f5773 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:07.767581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6c9a77f5-ca81-45bc-b3dc-cf51cf3f5773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:07.777797 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a4cbcc08-6081-47db-a598-65a90e0c3380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce2b798833249db9cc0ff000c779ec3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:07.795302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a4cbcc08-6081-47db-a598-65a90e0c3380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce2b798833249db9cc0ff000c779ec3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:07.797767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a4cbcc08-6081-47db-a598-65a90e0c3380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce2b798833249db9cc0ff000c779ec3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:07.799990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a77f5-ca81-45bc-b3dc-cf51cf3f5773 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:07.813094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:07.814004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:07.814392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:07.814894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] PATH_INFO: `/v3/projects/514ea851500c46debc822336a33a7e70` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:07.816485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] RBAC: Authorizing `identity:delete_project(project_id=514ea851500c46debc822336a33a7e70)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:07.818706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:08.018307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1007/2057] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:07 2022] DELETE /identity/v3/users/7ce2b798833249db9cc0ff000c779ec3 => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:08.020830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b639fc8-b7b9-4d80-98d5-f7bc2638a689 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:08.021479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b639fc8-b7b9-4d80-98d5-f7bc2638a689 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:08.022079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b639fc8-b7b9-4d80-98d5-f7bc2638a689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:08.061036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2b639fc8-b7b9-4d80-98d5-f7bc2638a689 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:08.074711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2b639fc8-b7b9-4d80-98d5-f7bc2638a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:08.080921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '514ea851500c46debc822336a33a7e70', 'request_id': 'req-d9691b12-29da-4407-95e7-6636d7ca373f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.106145 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '514ea851500c46debc822336a33a7e70', 'request_id': 'req-d9691b12-29da-4407-95e7-6636d7ca373f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.178087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1008/2058] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:08.207488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b639fc8-b7b9-4d80-98d5-f7bc2638a689 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:08.209653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2b639fc8-b7b9-4d80-98d5-f7bc2638a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:08.269906 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '514ea851500c46debc822336a33a7e70', 'request_id': 'req-d9691b12-29da-4407-95e7-6636d7ca373f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.296132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] The token cache is being invalidate because project 514ea851500c46debc822336a33a7e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:08.296689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.297485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.299390 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1051/2059] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:07 2022] DELETE /identity/v3/projects/514ea851500c46debc822336a33a7e70 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:08.304744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:08.306953 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:08.313775 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b639fc8-b7b9-4d80-98d5-f7bc2638a689 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:08.327899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3d21a-5108-4273-af13-8772709f7fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:08.327899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3d21a-5108-4273-af13-8772709f7fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:08.327899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3d21a-5108-4273-af13-8772709f7fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:08.327899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3d21a-5108-4273-af13-8772709f7fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:08.330856 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f9d3d21a-5108-4273-af13-8772709f7fe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:08.337806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9691b12-29da-4407-95e7-6636d7ca373f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:08.356124 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3d21a-5108-4273-af13-8772709f7fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:08.358726 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3d21a-5108-4273-af13-8772709f7fe1 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:08.367061 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:08.374104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:08.374104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:08.374104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] PATH_INFO: `/v3/users/0ee440faf4924480a329c593d82a866e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:08.374104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee440faf4924480a329c593d82a866e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:08.374104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:08.375845 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1009/2060] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:08.469139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3d21a-5108-4273-af13-8772709f7fe1 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:08.471916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f9d3d21a-5108-4273-af13-8772709f7fe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:08.510070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3d21a-5108-4273-af13-8772709f7fe1 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:08.527556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:08.530007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:08.530007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:08.530007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] PATH_INFO: `/v3/projects/ea7e60058a634412915f49ee7665a2c5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:08.531543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea7e60058a634412915f49ee7665a2c5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:08.534253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:08.874796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea7e60058a634412915f49ee7665a2c5', 'request_id': 'req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.876570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee440faf4924480a329c593d82a866e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.886044 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea7e60058a634412915f49ee7665a2c5', 'request_id': 'req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.895880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee440faf4924480a329c593d82a866e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.070357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea7e60058a634412915f49ee7665a2c5', 'request_id': 'req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.086318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] The token cache is being invalidate because project ea7e60058a634412915f49ee7665a2c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:09.086804 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.087891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.090470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1010/2061] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:08 2022] DELETE /identity/v3/projects/ea7e60058a634412915f49ee7665a2c5 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:09.091632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:09.093738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:09.180194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb7ca1-c7d1-4d0e-a712-2e59747b7f5e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:09.187796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:09.187796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:09.188119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:09.188280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc admin admin] PATH_INFO: `/v3/projects/e9560961934e44dea70e5466761fff56` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:09.189536 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9560961934e44dea70e5466761fff56)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:09.191773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:09.276711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee440faf4924480a329c593d82a866e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.277774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee440faf4924480a329c593d82a866e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.278662 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee440faf4924480a329c593d82a866e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.297579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1052/2062] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:08 2022] DELETE /identity/v3/users/0ee440faf4924480a329c593d82a866e => generated 0 bytes in 994 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:09.299558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:09.302418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:09.452005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dca337-4b1a-4f1d-9e61-64b0701ecde3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:09.473150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9560961934e44dea70e5466761fff56', 'request_id': 'req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.485787 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9560961934e44dea70e5466761fff56', 'request_id': 'req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.557727 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:09.558600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:09.559085 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:09.560573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] PATH_INFO: `/v3/users/cd37ba0329864a48be41e39d1bf30bf4` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:09.562242 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd37ba0329864a48be41e39d1bf30bf4)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:09.566150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:09.665074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9560961934e44dea70e5466761fff56', 'request_id': 'req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.692405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc admin admin] The token cache is being invalidate because project e9560961934e44dea70e5466761fff56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:09.692405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.694439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fa41f3ae-bb5a-438d-9d90-53d17f1859fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.714002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1011/2063] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:09 2022] DELETE /identity/v3/projects/e9560961934e44dea70e5466761fff56 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:09.724661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dd16a-2740-49ce-aac5-2e7f85a40bcf None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:09.725312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dd16a-2740-49ce-aac5-2e7f85a40bcf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:09.725762 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dd16a-2740-49ce-aac5-2e7f85a40bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:09.798592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-784dd16a-2740-49ce-aac5-2e7f85a40bcf None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:09.800305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-784dd16a-2740-49ce-aac5-2e7f85a40bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:09.815260 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1012/2064] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:09.826288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020c87e-12bd-4cfb-aaaf-0aeaa7663369 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:09.837642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020c87e-12bd-4cfb-aaaf-0aeaa7663369 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:09.837642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020c87e-12bd-4cfb-aaaf-0aeaa7663369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:09.880251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d020c87e-12bd-4cfb-aaaf-0aeaa7663369 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:09.881678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d020c87e-12bd-4cfb-aaaf-0aeaa7663369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:09.904949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1013/2065] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:09.911103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020c87e-12bd-4cfb-aaaf-0aeaa7663369 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:09.930928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020c87e-12bd-4cfb-aaaf-0aeaa7663369 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:09.959529 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd37ba0329864a48be41e39d1bf30bf4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.961340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a20dc-8983-45f1-8ae9-50c785cd3bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:09.962783 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a20dc-8983-45f1-8ae9-50c785cd3bee admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:09.966893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a20dc-8983-45f1-8ae9-50c785cd3bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:09.969802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a20dc-8983-45f1-8ae9-50c785cd3bee admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:09.971203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a20dc-8983-45f1-8ae9-50c785cd3bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:09.973819 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a20dc-8983-45f1-8ae9-50c785cd3bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:09.980781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a20dc-8983-45f1-8ae9-50c785cd3bee admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:09.982553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd37ba0329864a48be41e39d1bf30bf4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:10.018837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1014/2066] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:47:10.023040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a20dc-8983-45f1-8ae9-50c785cd3bee admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.056852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a20dc-8983-45f1-8ae9-50c785cd3bee admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.056852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63767dc-9342-4c0f-a6e5-3bab6eca1723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.056852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63767dc-9342-4c0f-a6e5-3bab6eca1723 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.056852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63767dc-9342-4c0f-a6e5-3bab6eca1723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.057385 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63767dc-9342-4c0f-a6e5-3bab6eca1723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.057385 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63767dc-9342-4c0f-a6e5-3bab6eca1723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.057385 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63767dc-9342-4c0f-a6e5-3bab6eca1723 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.298159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd37ba0329864a48be41e39d1bf30bf4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:10.298834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd37ba0329864a48be41e39d1bf30bf4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:10.299812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd37ba0329864a48be41e39d1bf30bf4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:10.318451 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1053/2067] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:09 2022] DELETE /identity/v3/users/cd37ba0329864a48be41e39d1bf30bf4 => generated 0 bytes in 1020 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:10.436775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.440997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:10.455669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1015/2068] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:10 2022] POST /identity/v3/projects => generated 371 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:10.460893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63767dc-9342-4c0f-a6e5-3bab6eca1723 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.468799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a63767dc-9342-4c0f-a6e5-3bab6eca1723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:10.573497 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f593-7a2b-4b0b-bd1a-515f1298b760 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.577558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63767dc-9342-4c0f-a6e5-3bab6eca1723 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.580521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7fb12-3581-4e9c-91b9-f3d23facbacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.584083 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7fb12-3581-4e9c-91b9-f3d23facbacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.584083 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7fb12-3581-4e9c-91b9-f3d23facbacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.584083 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7fb12-3581-4e9c-91b9-f3d23facbacf admin admin] PATH_INFO: `/v3/projects/b01d1435833042e6aaea9ef302c19cb9` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.584353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90676f84-6292-46ef-9de9-a2a8a042c159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.584451 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7fb12-3581-4e9c-91b9-f3d23facbacf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b01d1435833042e6aaea9ef302c19cb9)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.584528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90676f84-6292-46ef-9de9-a2a8a042c159 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.584528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90676f84-6292-46ef-9de9-a2a8a042c159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.584528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90676f84-6292-46ef-9de9-a2a8a042c159 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.584528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90676f84-6292-46ef-9de9-a2a8a042c159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.584789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7fb12-3581-4e9c-91b9-f3d23facbacf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.586611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90676f84-6292-46ef-9de9-a2a8a042c159 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.786570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1016/2069] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:10 2022] POST /identity/v3/users => generated 286 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:10.791425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90676f84-6292-46ef-9de9-a2a8a042c159 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.805708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90676f84-6292-46ef-9de9-a2a8a042c159 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.813438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a38c2-bd79-47b6-b490-078d692a301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.814099 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a38c2-bd79-47b6-b490-078d692a301a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.814406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a38c2-bd79-47b6-b490-078d692a301a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.814653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a38c2-bd79-47b6-b490-078d692a301a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.815331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a38c2-bd79-47b6-b490-078d692a301a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.817776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a38c2-bd79-47b6-b490-078d692a301a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.834212 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1017/2070] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:10.839929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a38c2-bd79-47b6-b490-078d692a301a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.858723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a38c2-bd79-47b6-b490-078d692a301a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.866406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246ff2b-da7f-48c9-8cbb-ba83d14fa5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.867414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246ff2b-da7f-48c9-8cbb-ba83d14fa5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.868134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246ff2b-da7f-48c9-8cbb-ba83d14fa5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.868438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246ff2b-da7f-48c9-8cbb-ba83d14fa5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.869321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246ff2b-da7f-48c9-8cbb-ba83d14fa5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.873387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246ff2b-da7f-48c9-8cbb-ba83d14fa5b1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.899277 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1018/2071] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:10.906449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246ff2b-da7f-48c9-8cbb-ba83d14fa5b1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.917787 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246ff2b-da7f-48c9-8cbb-ba83d14fa5b1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.926748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cdaa4-e44e-47eb-9154-0e02608f87a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.927818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cdaa4-e44e-47eb-9154-0e02608f87a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.928306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cdaa4-e44e-47eb-9154-0e02608f87a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.928740 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cdaa4-e44e-47eb-9154-0e02608f87a6 admin admin] PATH_INFO: `/v3/projects/6fbfc8ca282a4e1086b8bc4b1beb9e25/users/3a962c814f9f40bfa9e13efda4a66786/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.948185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-74e7fb12-3581-4e9c-91b9-f3d23facbacf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b01d1435833042e6aaea9ef302c19cb9', 'request_id': 'req-74e7fb12-3581-4e9c-91b9-f3d23facbacf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:10.958227 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cdaa4-e44e-47eb-9154-0e02608f87a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbfc8ca282a4e1086b8bc4b1beb9e25, user_id=3a962c814f9f40bfa9e13efda4a66786, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.961402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cdaa4-e44e-47eb-9154-0e02608f87a6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.961592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-74e7fb12-3581-4e9c-91b9-f3d23facbacf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b01d1435833042e6aaea9ef302c19cb9', 'request_id': 'req-74e7fb12-3581-4e9c-91b9-f3d23facbacf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:11.189110 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-74e7fb12-3581-4e9c-91b9-f3d23facbacf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b01d1435833042e6aaea9ef302c19cb9', 'request_id': 'req-74e7fb12-3581-4e9c-91b9-f3d23facbacf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:11.199645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1019/2072] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:10 2022] PUT /identity/v3/projects/6fbfc8ca282a4e1086b8bc4b1beb9e25/users/3a962c814f9f40bfa9e13efda4a66786/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:11.206152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-74e7fb12-3581-4e9c-91b9-f3d23facbacf admin admin] The token cache is being invalidate because project b01d1435833042e6aaea9ef302c19cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:11.206582 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-74e7fb12-3581-4e9c-91b9-f3d23facbacf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:11.207438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-74e7fb12-3581-4e9c-91b9-f3d23facbacf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:11.208127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba645e-12fd-4e0c-8386-6370ed8bf7a6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.208533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba645e-12fd-4e0c-8386-6370ed8bf7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.208900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba645e-12fd-4e0c-8386-6370ed8bf7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.209362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1054/2073] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:10 2022] DELETE /identity/v3/projects/b01d1435833042e6aaea9ef302c19cb9 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:11.217603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23031ac4-8207-468b-876d-5e467dee1ddd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.217603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23031ac4-8207-468b-876d-5e467dee1ddd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.218558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23031ac4-8207-468b-876d-5e467dee1ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.240273 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-20ba645e-12fd-4e0c-8386-6370ed8bf7a6 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:11.242281 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-20ba645e-12fd-4e0c-8386-6370ed8bf7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:11.248586 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-23031ac4-8207-468b-876d-5e467dee1ddd None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:11.250006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-23031ac4-8207-468b-876d-5e467dee1ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:11.355622 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1055/2074] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:11.357158 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23031ac4-8207-468b-876d-5e467dee1ddd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:11.358809 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-23031ac4-8207-468b-876d-5e467dee1ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:11.365613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1020/2075] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:11.368308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac6189-2243-4452-b4f4-61f4bf6a4316 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.372537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac6189-2243-4452-b4f4-61f4bf6a4316 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.372537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac6189-2243-4452-b4f4-61f4bf6a4316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.384592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23031ac4-8207-468b-876d-5e467dee1ddd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:11.394233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ad86b-f03e-424e-a2be-a6406e481ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:11.395207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ad86b-f03e-424e-a2be-a6406e481ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.396224 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ad86b-f03e-424e-a2be-a6406e481ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.396436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bcac6189-2243-4452-b4f4-61f4bf6a4316 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:11.396595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ad86b-f03e-424e-a2be-a6406e481ca8 admin admin] PATH_INFO: `/v3/projects/1b64e0b159c548feb67c0be44533f1c0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.398098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bcac6189-2243-4452-b4f4-61f4bf6a4316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:11.399136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ad86b-f03e-424e-a2be-a6406e481ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b64e0b159c548feb67c0be44533f1c0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:11.402459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ad86b-f03e-424e-a2be-a6406e481ca8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:11.415056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1021/2076] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:11.416507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac6189-2243-4452-b4f4-61f4bf6a4316 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:11.418488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bcac6189-2243-4452-b4f4-61f4bf6a4316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:11.531122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac6189-2243-4452-b4f4-61f4bf6a4316 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:11.535333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd5884-c3ae-46b6-a0c3-c36f3fcb7f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:11.536224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5884-c3ae-46b6-a0c3-c36f3fcb7f0b service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.537540 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5884-c3ae-46b6-a0c3-c36f3fcb7f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.537871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5884-c3ae-46b6-a0c3-c36f3fcb7f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.561526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd5884-c3ae-46b6-a0c3-c36f3fcb7f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:11.563145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd5884-c3ae-46b6-a0c3-c36f3fcb7f0b service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:11.575493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1022/2077] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:11.578292 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd5884-c3ae-46b6-a0c3-c36f3fcb7f0b service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:11.587216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd5884-c3ae-46b6-a0c3-c36f3fcb7f0b service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:11.609765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ec4d3-dede-450a-8412-46a4a5587ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:11.611528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec4d3-dede-450a-8412-46a4a5587ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.612185 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec4d3-dede-450a-8412-46a4a5587ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.613240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec4d3-dede-450a-8412-46a4a5587ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.614607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ec4d3-dede-450a-8412-46a4a5587ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:11.616116 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ec4d3-dede-450a-8412-46a4a5587ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:11.620266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ec4d3-dede-450a-8412-46a4a5587ee1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:11.629781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d14ad86b-f03e-424e-a2be-a6406e481ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b64e0b159c548feb67c0be44533f1c0', 'request_id': 'req-d14ad86b-f03e-424e-a2be-a6406e481ca8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:11.639799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1023/2078] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:47:11.646459 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ec4d3-dede-450a-8412-46a4a5587ee1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:11.648122 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d14ad86b-f03e-424e-a2be-a6406e481ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b64e0b159c548feb67c0be44533f1c0', 'request_id': 'req-d14ad86b-f03e-424e-a2be-a6406e481ca8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:11.660439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ec4d3-dede-450a-8412-46a4a5587ee1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:11.784831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21238546-51fd-41a9-ba94-607ebc1a16bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:11.786141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238546-51fd-41a9-ba94-607ebc1a16bf admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.787077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238546-51fd-41a9-ba94-607ebc1a16bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.787814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238546-51fd-41a9-ba94-607ebc1a16bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.789000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21238546-51fd-41a9-ba94-607ebc1a16bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:11.789282 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d14ad86b-f03e-424e-a2be-a6406e481ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b64e0b159c548feb67c0be44533f1c0', 'request_id': 'req-d14ad86b-f03e-424e-a2be-a6406e481ca8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:11.793677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21238546-51fd-41a9-ba94-607ebc1a16bf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:11.806204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d14ad86b-f03e-424e-a2be-a6406e481ca8 admin admin] The token cache is being invalidate because project 1b64e0b159c548feb67c0be44533f1c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:11.806860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d14ad86b-f03e-424e-a2be-a6406e481ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:11.808313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d14ad86b-f03e-424e-a2be-a6406e481ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:11.811967 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1056/2079] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:11 2022] DELETE /identity/v3/projects/1b64e0b159c548feb67c0be44533f1c0 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:11.823806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f0c57-63a5-4cc2-8c96-87f8830c7801 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.824195 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f0c57-63a5-4cc2-8c96-87f8830c7801 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.824510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f0c57-63a5-4cc2-8c96-87f8830c7801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.863916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9e9f0c57-63a5-4cc2-8c96-87f8830c7801 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:11.866093 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9e9f0c57-63a5-4cc2-8c96-87f8830c7801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:11.881051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1057/2080] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:11.891707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eac2c3-b5d9-44d5-a287-73aae63a175d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.894766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eac2c3-b5d9-44d5-a287-73aae63a175d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.894766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eac2c3-b5d9-44d5-a287-73aae63a175d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.919455 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-90eac2c3-b5d9-44d5-a287-73aae63a175d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:11.920989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-90eac2c3-b5d9-44d5-a287-73aae63a175d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:11.932952 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1058/2081] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:11.940434 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eac2c3-b5d9-44d5-a287-73aae63a175d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:11.957269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eac2c3-b5d9-44d5-a287-73aae63a175d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:11.964755 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665a609-7dcc-46bc-a5a1-6f928c7e4f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:11.966203 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665a609-7dcc-46bc-a5a1-6f928c7e4f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.975177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665a609-7dcc-46bc-a5a1-6f928c7e4f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.975177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665a609-7dcc-46bc-a5a1-6f928c7e4f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.975177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665a609-7dcc-46bc-a5a1-6f928c7e4f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:11.975177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665a609-7dcc-46bc-a5a1-6f928c7e4f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:11.975177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665a609-7dcc-46bc-a5a1-6f928c7e4f11 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:11.996517 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1059/2082] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:47:12.002063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665a609-7dcc-46bc-a5a1-6f928c7e4f11 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:12.013636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665a609-7dcc-46bc-a5a1-6f928c7e4f11 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:12.019115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe4844-6f4f-469a-b2b8-3246d5c11f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:12.019861 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe4844-6f4f-469a-b2b8-3246d5c11f19 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:12.020189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe4844-6f4f-469a-b2b8-3246d5c11f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:12.020540 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe4844-6f4f-469a-b2b8-3246d5c11f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:12.021322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe4844-6f4f-469a-b2b8-3246d5c11f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:12.023614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe4844-6f4f-469a-b2b8-3246d5c11f19 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:12.055576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1024/2083] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:11 2022] POST /identity/v3/projects => generated 387 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:12.058464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21238546-51fd-41a9-ba94-607ebc1a16bf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:12.061077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-21238546-51fd-41a9-ba94-607ebc1a16bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:12.071907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:12.185448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21238546-51fd-41a9-ba94-607ebc1a16bf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:12.191119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec9c96-30d6-43b6-a9fb-5cec4b1241a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:12.191763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec9c96-30d6-43b6-a9fb-5cec4b1241a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:12.192042 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec9c96-30d6-43b6-a9fb-5cec4b1241a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:12.193892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec9c96-30d6-43b6-a9fb-5cec4b1241a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:12.193892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec9c96-30d6-43b6-a9fb-5cec4b1241a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:12.195119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec9c96-30d6-43b6-a9fb-5cec4b1241a2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:12.227192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1060/2084] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:12 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:12.233322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe4844-6f4f-469a-b2b8-3246d5c11f19 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:12.351157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe4844-6f4f-469a-b2b8-3246d5c11f19 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:12.360931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f64a0-4846-4e1d-836e-c178e39296be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:12.362028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f64a0-4846-4e1d-836e-c178e39296be admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:12.362574 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f64a0-4846-4e1d-836e-c178e39296be admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:12.363649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f64a0-4846-4e1d-836e-c178e39296be admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:12.365286 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f64a0-4846-4e1d-836e-c178e39296be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:12.369039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f64a0-4846-4e1d-836e-c178e39296be admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:12.372716 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1025/2085] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:12 2022] POST /identity/v3/users => generated 294 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:12.380832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec9c96-30d6-43b6-a9fb-5cec4b1241a2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:12.405822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec9c96-30d6-43b6-a9fb-5cec4b1241a2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:12.413259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dc123-9e24-47d8-aa8f-44b0d40f95f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:12.414309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dc123-9e24-47d8-aa8f-44b0d40f95f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:12.414794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dc123-9e24-47d8-aa8f-44b0d40f95f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:12.415262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dc123-9e24-47d8-aa8f-44b0d40f95f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:12.416388 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dc123-9e24-47d8-aa8f-44b0d40f95f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:12.418052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dc123-9e24-47d8-aa8f-44b0d40f95f4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:12.438444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1026/2086] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:12.443582 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dc123-9e24-47d8-aa8f-44b0d40f95f4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:12.460467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dc123-9e24-47d8-aa8f-44b0d40f95f4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:12.468384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e970a7-408d-4c51-ad16-2a46e992c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:12.469423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e970a7-408d-4c51-ad16-2a46e992c038 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:12.469723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e970a7-408d-4c51-ad16-2a46e992c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:12.469984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e970a7-408d-4c51-ad16-2a46e992c038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:12.470644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e970a7-408d-4c51-ad16-2a46e992c038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:12.472998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e970a7-408d-4c51-ad16-2a46e992c038 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:12.490113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1027/2087] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:12.496669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e970a7-408d-4c51-ad16-2a46e992c038 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:12.509840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e970a7-408d-4c51-ad16-2a46e992c038 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:12.516874 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15cfaa-f3d3-47cd-a96b-74772324556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:12.517639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15cfaa-f3d3-47cd-a96b-74772324556d admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:12.518006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15cfaa-f3d3-47cd-a96b-74772324556d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:12.518351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15cfaa-f3d3-47cd-a96b-74772324556d admin admin] PATH_INFO: `/v3/projects/b1a42371fd614ed2a5c73bbeb15b0870/users/e7e3b325a7f346ad87a9557601f22a98/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:12.552232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15cfaa-f3d3-47cd-a96b-74772324556d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a42371fd614ed2a5c73bbeb15b0870, user_id=e7e3b325a7f346ad87a9557601f22a98, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:12.557857 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15cfaa-f3d3-47cd-a96b-74772324556d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:12.582294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:12.608916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1061/2088] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:12 2022] POST /identity/v3/users => generated 291 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:12.611571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f64a0-4846-4e1d-836e-c178e39296be admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:12.649993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f64a0-4846-4e1d-836e-c178e39296be admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:12.672423 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80503-91e6-4d25-afcb-e8acdabfbf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:12.674161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80503-91e6-4d25-afcb-e8acdabfbf2f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:12.675014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80503-91e6-4d25-afcb-e8acdabfbf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:12.675634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80503-91e6-4d25-afcb-e8acdabfbf2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:12.676975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80503-91e6-4d25-afcb-e8acdabfbf2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:12.680035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80503-91e6-4d25-afcb-e8acdabfbf2f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:12.710692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1062/2090] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:12.717101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80503-91e6-4d25-afcb-e8acdabfbf2f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:12.718880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1028/2090] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:12 2022] PUT /identity/v3/projects/b1a42371fd614ed2a5c73bbeb15b0870/users/e7e3b325a7f346ad87a9557601f22a98/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:12.720471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160974a9-5a55-4d3e-8a7c-35574a617fef None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:12.720756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160974a9-5a55-4d3e-8a7c-35574a617fef None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:12.721030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160974a9-5a55-4d3e-8a7c-35574a617fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:12.732537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80503-91e6-4d25-afcb-e8acdabfbf2f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:12.784561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-160974a9-5a55-4d3e-8a7c-35574a617fef None None] MFA Rules not processed for user `e7e3b325a7f346ad87a9557601f22a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:12.786687 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-160974a9-5a55-4d3e-8a7c-35574a617fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:12.891903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c8040-8f14-44bc-b10a-ec1a698348b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:12.897990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c8040-8f14-44bc-b10a-ec1a698348b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:12.897990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c8040-8f14-44bc-b10a-ec1a698348b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:12.897990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c8040-8f14-44bc-b10a-ec1a698348b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:12.897990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c8040-8f14-44bc-b10a-ec1a698348b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:12.900105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c8040-8f14-44bc-b10a-ec1a698348b6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:12.934214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1063/2091] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:12.941558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c8040-8f14-44bc-b10a-ec1a698348b6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:12.972251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c8040-8f14-44bc-b10a-ec1a698348b6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:12.977025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1029/2092] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:12.985122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160974a9-5a55-4d3e-8a7c-35574a617fef None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:12.990305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455fa76-3906-44fa-afff-c04bd48122cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:12.990305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455fa76-3906-44fa-afff-c04bd48122cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:12.990305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455fa76-3906-44fa-afff-c04bd48122cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:12.990305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455fa76-3906-44fa-afff-c04bd48122cd admin admin] PATH_INFO: `/v3/projects/5bd78f4d48d747948d6c805b5854d38a/users/63bd60b80742447dadac20656666f387/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:13.010792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160974a9-5a55-4d3e-8a7c-35574a617fef None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:13.020349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c8062-1038-4fc7-abdb-233e8c1e0a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:13.021183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c8062-1038-4fc7-abdb-233e8c1e0a7a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:13.021651 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c8062-1038-4fc7-abdb-233e8c1e0a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:13.022094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c8062-1038-4fc7-abdb-233e8c1e0a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:13.023145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c8062-1038-4fc7-abdb-233e8c1e0a7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:13.025050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455fa76-3906-44fa-afff-c04bd48122cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd78f4d48d747948d6c805b5854d38a, user_id=63bd60b80742447dadac20656666f387, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:13.030430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c8062-1038-4fc7-abdb-233e8c1e0a7a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:13.030653 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455fa76-3906-44fa-afff-c04bd48122cd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:13.246221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1064/2093] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:12 2022] PUT /identity/v3/projects/5bd78f4d48d747948d6c805b5854d38a/users/63bd60b80742447dadac20656666f387/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:13.251210 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1030/2094] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:12 2022] POST /identity/v3/projects => generated 385 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:13.257847 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455fa76-3906-44fa-afff-c04bd48122cd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:13.260701 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669314-39df-4f5d-8fb7-83365799f475 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:13.261180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669314-39df-4f5d-8fb7-83365799f475 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:13.261737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669314-39df-4f5d-8fb7-83365799f475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:13.325378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b2669314-39df-4f5d-8fb7-83365799f475 None None] MFA Rules not processed for user `63bd60b80742447dadac20656666f387`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:13.327307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b2669314-39df-4f5d-8fb7-83365799f475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:13.432005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455fa76-3906-44fa-afff-c04bd48122cd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:13.458367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1031/2095] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:13.465006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2669314-39df-4f5d-8fb7-83365799f475 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:13.547876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c31426-a255-479e-a5d0-8d35d71b746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:13.548895 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c31426-a255-479e-a5d0-8d35d71b746f admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:13.549368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c31426-a255-479e-a5d0-8d35d71b746f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:13.549850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c31426-a255-479e-a5d0-8d35d71b746f admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:13.551137 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c31426-a255-479e-a5d0-8d35d71b746f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:13.555768 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c31426-a255-479e-a5d0-8d35d71b746f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:13.598401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2669314-39df-4f5d-8fb7-83365799f475 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:13.607831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9511e3-9bba-49ce-8749-f3c0b96e8073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:13.608494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9511e3-9bba-49ce-8749-f3c0b96e8073 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:13.608781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9511e3-9bba-49ce-8749-f3c0b96e8073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:13.609206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9511e3-9bba-49ce-8749-f3c0b96e8073 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:13.609851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9511e3-9bba-49ce-8749-f3c0b96e8073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:13.611906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9511e3-9bba-49ce-8749-f3c0b96e8073 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:13.766197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1065/2096] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:13 2022] POST /identity/v3/users => generated 299 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:13.772752 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c31426-a255-479e-a5d0-8d35d71b746f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:13.797401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c31426-a255-479e-a5d0-8d35d71b746f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:13.808952 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618dcd3-3e6e-4162-943a-f7ebae28003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:13.811046 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618dcd3-3e6e-4162-943a-f7ebae28003b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:13.811830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618dcd3-3e6e-4162-943a-f7ebae28003b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:13.812429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618dcd3-3e6e-4162-943a-f7ebae28003b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:13.814429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618dcd3-3e6e-4162-943a-f7ebae28003b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:13.817057 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618dcd3-3e6e-4162-943a-f7ebae28003b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:13.836519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1066/2097] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:13.844422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618dcd3-3e6e-4162-943a-f7ebae28003b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:13.850363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1032/2098] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:13 2022] POST /identity/v3/projects => generated 379 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:13.855707 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9511e3-9bba-49ce-8749-f3c0b96e8073 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:13.870921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618dcd3-3e6e-4162-943a-f7ebae28003b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:14.086023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00c2df-3fdc-49f8-8e50-27ad6410e6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:14.087030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00c2df-3fdc-49f8-8e50-27ad6410e6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.087227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00c2df-3fdc-49f8-8e50-27ad6410e6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.088526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00c2df-3fdc-49f8-8e50-27ad6410e6e0 admin admin] PATH_INFO: `/v3/projects/1ed29de8158040029b283e51a5ec7fc3/users/31b140dd902a4042a1ccf0eb8a419449/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.123195 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00c2df-3fdc-49f8-8e50-27ad6410e6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed29de8158040029b283e51a5ec7fc3, user_id=31b140dd902a4042a1ccf0eb8a419449, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:14.131189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00c2df-3fdc-49f8-8e50-27ad6410e6e0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:14.157078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9511e3-9bba-49ce-8749-f3c0b96e8073 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:14.164592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9252fc9-67c0-4759-b232-638dec3ada00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:14.165195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9252fc9-67c0-4759-b232-638dec3ada00 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.165605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9252fc9-67c0-4759-b232-638dec3ada00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.166009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9252fc9-67c0-4759-b232-638dec3ada00 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.166811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9252fc9-67c0-4759-b232-638dec3ada00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:14.170458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9252fc9-67c0-4759-b232-638dec3ada00 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:14.311406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1067/2099] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:13 2022] PUT /identity/v3/projects/1ed29de8158040029b283e51a5ec7fc3/users/31b140dd902a4042a1ccf0eb8a419449/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:14.313165 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00c2df-3fdc-49f8-8e50-27ad6410e6e0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:14.344034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1033/2100] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:13 2022] POST /identity/v3/users => generated 296 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:14.350087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9252fc9-67c0-4759-b232-638dec3ada00 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:14.376815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9252fc9-67c0-4759-b232-638dec3ada00 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:14.470051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00c2df-3fdc-49f8-8e50-27ad6410e6e0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:14.477196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005ac81-33ac-4892-8373-7633153bf242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:14.478050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005ac81-33ac-4892-8373-7633153bf242 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.478329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005ac81-33ac-4892-8373-7633153bf242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.478602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005ac81-33ac-4892-8373-7633153bf242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.479412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005ac81-33ac-4892-8373-7633153bf242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:14.482330 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005ac81-33ac-4892-8373-7633153bf242 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:14.501229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1068/2101] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:14.503000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005ac81-33ac-4892-8373-7633153bf242 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:14.503493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef9ec3-443e-4b3b-9b35-33ebd468917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:14.505025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef9ec3-443e-4b3b-9b35-33ebd468917b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.505545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef9ec3-443e-4b3b-9b35-33ebd468917b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.505832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef9ec3-443e-4b3b-9b35-33ebd468917b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.506765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef9ec3-443e-4b3b-9b35-33ebd468917b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:14.513033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef9ec3-443e-4b3b-9b35-33ebd468917b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:14.517526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005ac81-33ac-4892-8373-7633153bf242 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:14.526226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624a5ff-5cdc-4a77-bbe1-3f2f363797d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:14.527871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a5ff-5cdc-4a77-bbe1-3f2f363797d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.529744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a5ff-5cdc-4a77-bbe1-3f2f363797d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.530253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a5ff-5cdc-4a77-bbe1-3f2f363797d1 admin admin] PATH_INFO: `/v3/projects/1ed29de8158040029b283e51a5ec7fc3/users/31b140dd902a4042a1ccf0eb8a419449/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.534055 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624a5ff-5cdc-4a77-bbe1-3f2f363797d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed29de8158040029b283e51a5ec7fc3, user_id=31b140dd902a4042a1ccf0eb8a419449, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:14.537169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624a5ff-5cdc-4a77-bbe1-3f2f363797d1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:14.541295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1034/2102] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:14.544618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef9ec3-443e-4b3b-9b35-33ebd468917b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:14.555784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1069/2103] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:14 2022] PUT /identity/v3/projects/1ed29de8158040029b283e51a5ec7fc3/users/31b140dd902a4042a1ccf0eb8a419449/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:14.569490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef9ec3-443e-4b3b-9b35-33ebd468917b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:14.573854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cade70a-cc13-4650-88e6-3ef869eaab41 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.574871 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cade70a-cc13-4650-88e6-3ef869eaab41 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.575896 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cade70a-cc13-4650-88e6-3ef869eaab41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.672471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7cade70a-cc13-4650-88e6-3ef869eaab41 None None] MFA Rules not processed for user `31b140dd902a4042a1ccf0eb8a419449`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:14.675069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7cade70a-cc13-4650-88e6-3ef869eaab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:14.693019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eddb93-cb5d-4e54-8c99-c47488833213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:14.695091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eddb93-cb5d-4e54-8c99-c47488833213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.695446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eddb93-cb5d-4e54-8c99-c47488833213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.695854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eddb93-cb5d-4e54-8c99-c47488833213 admin admin] PATH_INFO: `/v3/projects/2790c8bd82dc405cb0dba65ff17e2cf7/users/1ad6149a51b74a879164a9b27f4264ec/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.718104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eddb93-cb5d-4e54-8c99-c47488833213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2790c8bd82dc405cb0dba65ff17e2cf7, user_id=1ad6149a51b74a879164a9b27f4264ec, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:14.722531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eddb93-cb5d-4e54-8c99-c47488833213 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:14.825213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1070/2104] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:14.841320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cade70a-cc13-4650-88e6-3ef869eaab41 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:14.844506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7cade70a-cc13-4650-88e6-3ef869eaab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:14.932000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cade70a-cc13-4650-88e6-3ef869eaab41 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:14.936488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f574eec-b8d3-4ed1-ba24-da3e238b5382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:14.937101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f574eec-b8d3-4ed1-ba24-da3e238b5382 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.937379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f574eec-b8d3-4ed1-ba24-da3e238b5382 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.937687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f574eec-b8d3-4ed1-ba24-da3e238b5382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.948967 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f574eec-b8d3-4ed1-ba24-da3e238b5382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:14.949774 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1035/2105] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:14 2022] PUT /identity/v3/projects/2790c8bd82dc405cb0dba65ff17e2cf7/users/1ad6149a51b74a879164a9b27f4264ec/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:14.950445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f574eec-b8d3-4ed1-ba24-da3e238b5382 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:14.954064 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eddb93-cb5d-4e54-8c99-c47488833213 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:14.962691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1071/2106] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:14.994800 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f574eec-b8d3-4ed1-ba24-da3e238b5382 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:15.018659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f574eec-b8d3-4ed1-ba24-da3e238b5382 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:15.063418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eddb93-cb5d-4e54-8c99-c47488833213 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:15.083730 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a42708-4ece-42e0-9d76-d4ed3947e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:15.084374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a42708-4ece-42e0-9d76-d4ed3947e6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.084654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a42708-4ece-42e0-9d76-d4ed3947e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.084920 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a42708-4ece-42e0-9d76-d4ed3947e6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.085568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a42708-4ece-42e0-9d76-d4ed3947e6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:15.087181 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a42708-4ece-42e0-9d76-d4ed3947e6c4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:15.120845 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1036/2107] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:15.122432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a42708-4ece-42e0-9d76-d4ed3947e6c4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:15.135136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a42708-4ece-42e0-9d76-d4ed3947e6c4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:15.146395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86398922-4369-4c2c-b70d-2f3e79f436c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:15.147659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86398922-4369-4c2c-b70d-2f3e79f436c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.148418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86398922-4369-4c2c-b70d-2f3e79f436c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.149189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86398922-4369-4c2c-b70d-2f3e79f436c5 admin admin] PATH_INFO: `/v3/projects/2790c8bd82dc405cb0dba65ff17e2cf7/users/1ad6149a51b74a879164a9b27f4264ec/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.152418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160da17d-2b94-4bcf-983a-9e6ea0b58545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:15.159186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86398922-4369-4c2c-b70d-2f3e79f436c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2790c8bd82dc405cb0dba65ff17e2cf7, user_id=1ad6149a51b74a879164a9b27f4264ec, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:15.159365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160da17d-2b94-4bcf-983a-9e6ea0b58545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.159365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160da17d-2b94-4bcf-983a-9e6ea0b58545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.159365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160da17d-2b94-4bcf-983a-9e6ea0b58545 admin admin] PATH_INFO: `/v3/users/e7e3b325a7f346ad87a9557601f22a98` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.163281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160da17d-2b94-4bcf-983a-9e6ea0b58545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e3b325a7f346ad87a9557601f22a98)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:15.164080 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86398922-4369-4c2c-b70d-2f3e79f436c5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:15.178736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160da17d-2b94-4bcf-983a-9e6ea0b58545 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:15.210279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1037/2108] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:15 2022] PUT /identity/v3/projects/2790c8bd82dc405cb0dba65ff17e2cf7/users/1ad6149a51b74a879164a9b27f4264ec/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:15.222998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b184f9f-11d6-4466-ac5f-3bf497d2bbff None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.223819 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b184f9f-11d6-4466-ac5f-3bf497d2bbff None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.225322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b184f9f-11d6-4466-ac5f-3bf497d2bbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.274737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9b184f9f-11d6-4466-ac5f-3bf497d2bbff None None] MFA Rules not processed for user `1ad6149a51b74a879164a9b27f4264ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:15.277267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9b184f9f-11d6-4466-ac5f-3bf497d2bbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:15.449932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1038/2109] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:15.449932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b184f9f-11d6-4466-ac5f-3bf497d2bbff None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:15.452073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9b184f9f-11d6-4466-ac5f-3bf497d2bbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:15.582297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b184f9f-11d6-4466-ac5f-3bf497d2bbff None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:15.588256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc20e39-93a2-4b3e-8a47-df9688bdbee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:15.589142 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc20e39-93a2-4b3e-8a47-df9688bdbee8 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.589568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc20e39-93a2-4b3e-8a47-df9688bdbee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.589985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc20e39-93a2-4b3e-8a47-df9688bdbee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.594154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ccc20e39-93a2-4b3e-8a47-df9688bdbee8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:15.620816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-160da17d-2b94-4bcf-983a-9e6ea0b58545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e3b325a7f346ad87a9557601f22a98'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:15.673623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-160da17d-2b94-4bcf-983a-9e6ea0b58545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e3b325a7f346ad87a9557601f22a98'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:15.720011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc20e39-93a2-4b3e-8a47-df9688bdbee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:15.721866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc20e39-93a2-4b3e-8a47-df9688bdbee8 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:15.756995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1039/2110] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:15.758195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc20e39-93a2-4b3e-8a47-df9688bdbee8 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:15.777313 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc20e39-93a2-4b3e-8a47-df9688bdbee8 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:15.795695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784b011-214d-42ee-a3e4-f4e28c1d8d14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:15.796350 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784b011-214d-42ee-a3e4-f4e28c1d8d14 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.796629 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784b011-214d-42ee-a3e4-f4e28c1d8d14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.796955 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784b011-214d-42ee-a3e4-f4e28c1d8d14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.806375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-160da17d-2b94-4bcf-983a-9e6ea0b58545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e3b325a7f346ad87a9557601f22a98'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:15.807092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-160da17d-2b94-4bcf-983a-9e6ea0b58545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e3b325a7f346ad87a9557601f22a98'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:15.807578 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-160da17d-2b94-4bcf-983a-9e6ea0b58545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e3b325a7f346ad87a9557601f22a98'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:15.831820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784b011-214d-42ee-a3e4-f4e28c1d8d14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:15.834513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784b011-214d-42ee-a3e4-f4e28c1d8d14 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:15.859110 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1072/2111] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:14 2022] DELETE /identity/v3/users/e7e3b325a7f346ad87a9557601f22a98 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:15.863996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54700-9b16-4075-b55c-d40177759b9f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.864811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54700-9b16-4075-b55c-d40177759b9f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.865220 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54700-9b16-4075-b55c-d40177759b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.875864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1040/2112] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:15.967260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-29e54700-9b16-4075-b55c-d40177759b9f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:15.968778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-29e54700-9b16-4075-b55c-d40177759b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:16.122505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1073/2113] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:16.124248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784b011-214d-42ee-a3e4-f4e28c1d8d14 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:16.126924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e784b011-214d-42ee-a3e4-f4e28c1d8d14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:16.316548 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784b011-214d-42ee-a3e4-f4e28c1d8d14 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:16.505734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f749eb-5907-4089-875e-dfd2cf81c3e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:16.506699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f749eb-5907-4089-875e-dfd2cf81c3e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:16.506859 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f749eb-5907-4089-875e-dfd2cf81c3e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:16.507225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f749eb-5907-4089-875e-dfd2cf81c3e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:16.529124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:16.547265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f749eb-5907-4089-875e-dfd2cf81c3e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:16.548849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f749eb-5907-4089-875e-dfd2cf81c3e4 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:16.570738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1041/2114] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:16.813650 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:18.186368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e54700-9b16-4075-b55c-d40177759b9f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:18.190412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-29e54700-9b16-4075-b55c-d40177759b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:18.219949 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e54700-9b16-4075-b55c-d40177759b9f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:18.226613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:18.229367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:18.230186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:18.230979 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] PATH_INFO: `/v3/projects/b1a42371fd614ed2a5c73bbeb15b0870` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:18.234025 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a42371fd614ed2a5c73bbeb15b0870)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:18.242706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:18.338604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:18.448818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f749eb-5907-4089-875e-dfd2cf81c3e4 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:18.456044 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d0f749eb-5907-4089-875e-dfd2cf81c3e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:18.468360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a42371fd614ed2a5c73bbeb15b0870', 'request_id': 'req-13556b7e-7cbe-463c-80f3-dd2fb833b22a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.486123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a42371fd614ed2a5c73bbeb15b0870', 'request_id': 'req-13556b7e-7cbe-463c-80f3-dd2fb833b22a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.502900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f749eb-5907-4089-875e-dfd2cf81c3e4 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:18.598198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40798e-0c93-46de-a988-8517bdb05ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:18.599448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40798e-0c93-46de-a988-8517bdb05ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:18.600074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40798e-0c93-46de-a988-8517bdb05ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:18.600670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40798e-0c93-46de-a988-8517bdb05ce8 admin admin] PATH_INFO: `/v3/users/63bd60b80742447dadac20656666f387` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:18.603460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40798e-0c93-46de-a988-8517bdb05ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63bd60b80742447dadac20656666f387)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:18.607507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40798e-0c93-46de-a988-8517bdb05ce8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:18.620495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a42371fd614ed2a5c73bbeb15b0870', 'request_id': 'req-13556b7e-7cbe-463c-80f3-dd2fb833b22a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.658917 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] The token cache is being invalidate because project b1a42371fd614ed2a5c73bbeb15b0870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:18.659355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.660328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.665469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1074/2115] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:18 2022] DELETE /identity/v3/projects/b1a42371fd614ed2a5c73bbeb15b0870 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:18.668373 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:18.671069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:18.687485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13556b7e-7cbe-463c-80f3-dd2fb833b22a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:18.693080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:18.694042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:18.694429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:18.694935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] PATH_INFO: `/v3/users/31b140dd902a4042a1ccf0eb8a419449` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:18.702778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b140dd902a4042a1ccf0eb8a419449)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:18.702778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:18.984350 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ff40798e-0c93-46de-a988-8517bdb05ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63bd60b80742447dadac20656666f387'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.986093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ff40798e-0c93-46de-a988-8517bdb05ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63bd60b80742447dadac20656666f387'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:19.022578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ff40798e-0c93-46de-a988-8517bdb05ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63bd60b80742447dadac20656666f387'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:19.049877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ff40798e-0c93-46de-a988-8517bdb05ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63bd60b80742447dadac20656666f387'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:19.054082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ff40798e-0c93-46de-a988-8517bdb05ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63bd60b80742447dadac20656666f387'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:19.094448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b140dd902a4042a1ccf0eb8a419449'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:19.157915 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b140dd902a4042a1ccf0eb8a419449'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:19.162951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1042/2116] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:18 2022] DELETE /identity/v3/users/63bd60b80742447dadac20656666f387 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:19.167543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5662819-5058-4ffa-a2f4-f5df7aa11668 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:19.168107 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5662819-5058-4ffa-a2f4-f5df7aa11668 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:19.168631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5662819-5058-4ffa-a2f4-f5df7aa11668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:19.226453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b5662819-5058-4ffa-a2f4-f5df7aa11668 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:19.230257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b5662819-5058-4ffa-a2f4-f5df7aa11668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:19.299303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b140dd902a4042a1ccf0eb8a419449'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:19.301494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b140dd902a4042a1ccf0eb8a419449'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:19.302795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b140dd902a4042a1ccf0eb8a419449'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:19.339408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1075/2117] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:18 2022] DELETE /identity/v3/users/31b140dd902a4042a1ccf0eb8a419449 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:19.372418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1043/2118] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:19.404021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:19.406537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:19.520411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bfb2b-3fc7-487a-97dd-d22ab8dd933c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:19.526891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0ad39-c0f7-45ef-8b92-97b81e1b0fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:19.528408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0ad39-c0f7-45ef-8b92-97b81e1b0fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:19.529181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0ad39-c0f7-45ef-8b92-97b81e1b0fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:19.529858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0ad39-c0f7-45ef-8b92-97b81e1b0fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:19.701338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0ad39-c0f7-45ef-8b92-97b81e1b0fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:19.706287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0ad39-c0f7-45ef-8b92-97b81e1b0fa6 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:19.727100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1076/2119] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:19.850311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:20.355234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5662819-5058-4ffa-a2f4-f5df7aa11668 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:20.355234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b5662819-5058-4ffa-a2f4-f5df7aa11668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:20.378229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5662819-5058-4ffa-a2f4-f5df7aa11668 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:20.402709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:20.403513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:20.403839 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:20.404108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] PATH_INFO: `/v3/projects/1ed29de8158040029b283e51a5ec7fc3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:20.406497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed29de8158040029b283e51a5ec7fc3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:20.411918 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:20.698283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed29de8158040029b283e51a5ec7fc3', 'request_id': 'req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.714296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed29de8158040029b283e51a5ec7fc3', 'request_id': 'req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.897482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed29de8158040029b283e51a5ec7fc3', 'request_id': 'req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.914767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] The token cache is being invalidate because project 1ed29de8158040029b283e51a5ec7fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:20.915134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.917238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.918564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1044/2120] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:20 2022] DELETE /identity/v3/projects/1ed29de8158040029b283e51a5ec7fc3 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:20.926325 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fbed4-a01a-403f-a22a-05271c8380ec None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:20.926908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fbed4-a01a-403f-a22a-05271c8380ec None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:20.927154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fbed4-a01a-403f-a22a-05271c8380ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:20.952434 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-711fbed4-a01a-403f-a22a-05271c8380ec None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:20.953630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-711fbed4-a01a-403f-a22a-05271c8380ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:21.056376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.058291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:21.107933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1077/2121] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:21.121012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9019f69-c41e-4de6-b376-4fb1bf532390 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.124814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9019f69-c41e-4de6-b376-4fb1bf532390 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.125444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9019f69-c41e-4de6-b376-4fb1bf532390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.186313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d9019f69-c41e-4de6-b376-4fb1bf532390 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:21.188580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d9019f69-c41e-4de6-b376-4fb1bf532390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:21.223903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1078/2122] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:21.224171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcaddd-9f59-4edb-ad4f-9b93ab81c678 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.225385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9019f69-c41e-4de6-b376-4fb1bf532390 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.235549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.239102 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9019f69-c41e-4de6-b376-4fb1bf532390 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.239363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.239939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.240297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] PATH_INFO: `/v3/projects/5bd78f4d48d747948d6c805b5854d38a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.245363 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cfa0a-c6ee-4d87-904f-2f6bc003a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.245613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd78f4d48d747948d6c805b5854d38a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.245994 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cfa0a-c6ee-4d87-904f-2f6bc003a1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.246262 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cfa0a-c6ee-4d87-904f-2f6bc003a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.246537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cfa0a-c6ee-4d87-904f-2f6bc003a1e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.248002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cfa0a-c6ee-4d87-904f-2f6bc003a1e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:21.248807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cfa0a-c6ee-4d87-904f-2f6bc003a1e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.249880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:21.251710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cfa0a-c6ee-4d87-904f-2f6bc003a1e7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:21.271371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1079/2123] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:47:21.279451 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cfa0a-c6ee-4d87-904f-2f6bc003a1e7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.296178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cfa0a-c6ee-4d87-904f-2f6bc003a1e7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.304442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d16146-0fff-4aa1-acc7-bc392c6109fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.305109 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d16146-0fff-4aa1-acc7-bc392c6109fc admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.305396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d16146-0fff-4aa1-acc7-bc392c6109fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.305667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d16146-0fff-4aa1-acc7-bc392c6109fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.307007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d16146-0fff-4aa1-acc7-bc392c6109fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.310140 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d16146-0fff-4aa1-acc7-bc392c6109fc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:21.466221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd78f4d48d747948d6c805b5854d38a', 'request_id': 'req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:21.478628 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd78f4d48d747948d6c805b5854d38a', 'request_id': 'req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:21.506372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1080/2124] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:21 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:21.513953 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d16146-0fff-4aa1-acc7-bc392c6109fc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.606660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd78f4d48d747948d6c805b5854d38a', 'request_id': 'req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:21.626518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] The token cache is being invalidate because project 5bd78f4d48d747948d6c805b5854d38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:21.627012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:21.628018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:21.629906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1045/2125] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:21 2022] DELETE /identity/v3/projects/5bd78f4d48d747948d6c805b5854d38a => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:21.635553 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.637964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:21.656471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d16146-0fff-4aa1-acc7-bc392c6109fc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.695750 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba96913-3606-4978-90cc-169eb83e5ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.696277 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba96913-3606-4978-90cc-169eb83e5ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.696679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba96913-3606-4978-90cc-169eb83e5ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.697105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba96913-3606-4978-90cc-169eb83e5ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.699006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba96913-3606-4978-90cc-169eb83e5ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.701887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba96913-3606-4978-90cc-169eb83e5ee1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:21.768826 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:21.882932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed63d54-4f03-4e49-ba68-100bf3ad9ef0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.898959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.900489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.901027 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.907586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] PATH_INFO: `/v3/users/1ad6149a51b74a879164a9b27f4264ec` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.907586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad6149a51b74a879164a9b27f4264ec)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.912834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:21.928150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1081/2126] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:21 2022] POST /identity/v3/users => generated 287 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:21.931116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba96913-3606-4978-90cc-169eb83e5ee1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.939788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2ba96913-3606-4978-90cc-169eb83e5ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:22.013502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba96913-3606-4978-90cc-169eb83e5ee1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:22.019691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f670e2a-a412-46f8-8b8e-df97554ecfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:22.020385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f670e2a-a412-46f8-8b8e-df97554ecfbd admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:22.020875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f670e2a-a412-46f8-8b8e-df97554ecfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:22.021151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f670e2a-a412-46f8-8b8e-df97554ecfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:22.022457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f670e2a-a412-46f8-8b8e-df97554ecfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:22.024208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f670e2a-a412-46f8-8b8e-df97554ecfbd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:22.062065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1082/2127] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:22.073941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f670e2a-a412-46f8-8b8e-df97554ecfbd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:22.086409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f670e2a-a412-46f8-8b8e-df97554ecfbd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:22.095396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787e9fb-814e-4c09-84d4-423cf8460dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:22.096814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787e9fb-814e-4c09-84d4-423cf8460dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:22.102682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787e9fb-814e-4c09-84d4-423cf8460dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:22.102682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787e9fb-814e-4c09-84d4-423cf8460dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:22.102682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787e9fb-814e-4c09-84d4-423cf8460dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:22.102682 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787e9fb-814e-4c09-84d4-423cf8460dbf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:22.169748 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1083/2128] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:22.172810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787e9fb-814e-4c09-84d4-423cf8460dbf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:22.197277 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787e9fb-814e-4c09-84d4-423cf8460dbf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:22.208432 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de23862-4441-45ad-8919-d6b07fc50ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:22.209123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de23862-4441-45ad-8919-d6b07fc50ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:22.209404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de23862-4441-45ad-8919-d6b07fc50ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:22.209678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de23862-4441-45ad-8919-d6b07fc50ef4 admin admin] PATH_INFO: `/v3/projects/359a4f374fbb42539a65b5dd0cc958b4/users/275bbf3d484d4f04a4e7f150074ce305/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:22.237213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de23862-4441-45ad-8919-d6b07fc50ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=359a4f374fbb42539a65b5dd0cc958b4, user_id=275bbf3d484d4f04a4e7f150074ce305, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:22.239514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de23862-4441-45ad-8919-d6b07fc50ef4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:22.361190 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad6149a51b74a879164a9b27f4264ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.363262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad6149a51b74a879164a9b27f4264ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.401377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1084/2129] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:22 2022] PUT /identity/v3/projects/359a4f374fbb42539a65b5dd0cc958b4/users/275bbf3d484d4f04a4e7f150074ce305/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:22.407035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee59552-5071-4475-8dde-572123ae7482 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:22.407602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee59552-5071-4475-8dde-572123ae7482 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:22.408082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee59552-5071-4475-8dde-572123ae7482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:22.412794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad6149a51b74a879164a9b27f4264ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.435177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad6149a51b74a879164a9b27f4264ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.440830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad6149a51b74a879164a9b27f4264ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.459353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-eee59552-5071-4475-8dde-572123ae7482 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:22.461018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-eee59552-5071-4475-8dde-572123ae7482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:22.567462 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1085/2130] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:22.581333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1046/2131] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:21 2022] DELETE /identity/v3/users/1ad6149a51b74a879164a9b27f4264ec => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:22.597272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:22.685917 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee59552-5071-4475-8dde-572123ae7482 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:22.687687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-eee59552-5071-4475-8dde-572123ae7482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:22.860595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee59552-5071-4475-8dde-572123ae7482 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:22.958964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f8441-fa2e-4844-9270-cb26839e2cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:22.961964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f8441-fa2e-4844-9270-cb26839e2cba service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:22.962561 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f8441-fa2e-4844-9270-cb26839e2cba service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:22.962986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f8441-fa2e-4844-9270-cb26839e2cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.111735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f8441-fa2e-4844-9270-cb26839e2cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:23.116863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f8441-fa2e-4844-9270-cb26839e2cba service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:23.143909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1086/2132] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:23.511635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:23.514254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:23.555451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8ecac-d878-4ce7-a12e-3010fe89609e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:23.575222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920688de-21a9-4d00-8856-84a9baecadd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:23.576272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920688de-21a9-4d00-8856-84a9baecadd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.576671 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920688de-21a9-4d00-8856-84a9baecadd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.577053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920688de-21a9-4d00-8856-84a9baecadd2 admin admin] PATH_INFO: `/v3/projects/2790c8bd82dc405cb0dba65ff17e2cf7` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.580948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920688de-21a9-4d00-8856-84a9baecadd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2790c8bd82dc405cb0dba65ff17e2cf7)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:23.583970 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920688de-21a9-4d00-8856-84a9baecadd2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:23.774049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-920688de-21a9-4d00-8856-84a9baecadd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2790c8bd82dc405cb0dba65ff17e2cf7', 'request_id': 'req-920688de-21a9-4d00-8856-84a9baecadd2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:23.797670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-920688de-21a9-4d00-8856-84a9baecadd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2790c8bd82dc405cb0dba65ff17e2cf7', 'request_id': 'req-920688de-21a9-4d00-8856-84a9baecadd2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.038021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-920688de-21a9-4d00-8856-84a9baecadd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2790c8bd82dc405cb0dba65ff17e2cf7', 'request_id': 'req-920688de-21a9-4d00-8856-84a9baecadd2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.089119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-920688de-21a9-4d00-8856-84a9baecadd2 admin admin] The token cache is being invalidate because project 2790c8bd82dc405cb0dba65ff17e2cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:24.089119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-920688de-21a9-4d00-8856-84a9baecadd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.089119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-920688de-21a9-4d00-8856-84a9baecadd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.089119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1047/2133] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:23 2022] DELETE /identity/v3/projects/2790c8bd82dc405cb0dba65ff17e2cf7 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:24.089440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56660e54-4660-4d77-8782-c4abed7dce20 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.089440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56660e54-4660-4d77-8782-c4abed7dce20 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.089440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56660e54-4660-4d77-8782-c4abed7dce20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.099653 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-56660e54-4660-4d77-8782-c4abed7dce20 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:24.100881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-56660e54-4660-4d77-8782-c4abed7dce20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:24.241034 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1087/2134] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:24.250611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93439931-0608-42a6-b69e-fb015306d521 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.250836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93439931-0608-42a6-b69e-fb015306d521 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.251268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93439931-0608-42a6-b69e-fb015306d521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.298764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-93439931-0608-42a6-b69e-fb015306d521 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:24.301535 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-93439931-0608-42a6-b69e-fb015306d521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:24.325738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1048/2135] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:24.331830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56660e54-4660-4d77-8782-c4abed7dce20 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:24.347970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56660e54-4660-4d77-8782-c4abed7dce20 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:24.359668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b79896-c18c-4f99-8e1f-27956e826f71 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.359668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b79896-c18c-4f99-8e1f-27956e826f71 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.364688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b79896-c18c-4f99-8e1f-27956e826f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.368297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d302a8-f3b5-4b16-b1c9-2dbc2dfaeb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:24.370224 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d302a8-f3b5-4b16-b1c9-2dbc2dfaeb01 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.370923 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d302a8-f3b5-4b16-b1c9-2dbc2dfaeb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.371407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d302a8-f3b5-4b16-b1c9-2dbc2dfaeb01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.374435 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d302a8-f3b5-4b16-b1c9-2dbc2dfaeb01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:24.374758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d302a8-f3b5-4b16-b1c9-2dbc2dfaeb01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:24.377759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d302a8-f3b5-4b16-b1c9-2dbc2dfaeb01 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:24.401840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1088/2136] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:47:24.405376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d302a8-f3b5-4b16-b1c9-2dbc2dfaeb01 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:24.429404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d302a8-f3b5-4b16-b1c9-2dbc2dfaeb01 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:24.431155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a1b79896-c18c-4f99-8e1f-27956e826f71 None None] MFA Rules not processed for user `3a962c814f9f40bfa9e13efda4a66786`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:24.433028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a1b79896-c18c-4f99-8e1f-27956e826f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:24.439868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f7809-aff1-4856-b2b8-67b47d8c6419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:24.440870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f7809-aff1-4856-b2b8-67b47d8c6419 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.441492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f7809-aff1-4856-b2b8-67b47d8c6419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.441999 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f7809-aff1-4856-b2b8-67b47d8c6419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.442919 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f7809-aff1-4856-b2b8-67b47d8c6419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:24.446051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f7809-aff1-4856-b2b8-67b47d8c6419 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:24.540849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1049/2137] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:24.545925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b79896-c18c-4f99-8e1f-27956e826f71 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:24.547619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a1b79896-c18c-4f99-8e1f-27956e826f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:24.572594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b79896-c18c-4f99-8e1f-27956e826f71 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:24.582992 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522afe2a-d1b8-43e5-85b7-42973a7eba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:24.583688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522afe2a-d1b8-43e5-85b7-42973a7eba43 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.583999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522afe2a-d1b8-43e5-85b7-42973a7eba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.584296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522afe2a-d1b8-43e5-85b7-42973a7eba43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.584977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522afe2a-d1b8-43e5-85b7-42973a7eba43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:24.587224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522afe2a-d1b8-43e5-85b7-42973a7eba43 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:24.672218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1089/2138] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:24 2022] POST /identity/v3/projects => generated 383 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:24.680154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f7809-aff1-4856-b2b8-67b47d8c6419 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:24.757662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1050/2139] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:24 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:24.761705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522afe2a-d1b8-43e5-85b7-42973a7eba43 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:24.787903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f7809-aff1-4856-b2b8-67b47d8c6419 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:24.825098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:24.945156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927713cd-6463-4778-8c21-b04c51be9bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:24.945156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927713cd-6463-4778-8c21-b04c51be9bee admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.945156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927713cd-6463-4778-8c21-b04c51be9bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.945156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927713cd-6463-4778-8c21-b04c51be9bee admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.945509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927713cd-6463-4778-8c21-b04c51be9bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:24.945509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927713cd-6463-4778-8c21-b04c51be9bee admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:24.957789 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522afe2a-d1b8-43e5-85b7-42973a7eba43 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:24.976443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e512c4e-92b1-4341-a442-a98d7641d80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:24.977203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e512c4e-92b1-4341-a442-a98d7641d80c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.977483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e512c4e-92b1-4341-a442-a98d7641d80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.977891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e512c4e-92b1-4341-a442-a98d7641d80c admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.980045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e512c4e-92b1-4341-a442-a98d7641d80c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:24.984808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e512c4e-92b1-4341-a442-a98d7641d80c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:25.042757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1090/2140] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:24 2022] POST /identity/v3/users => generated 292 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:25.050569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927713cd-6463-4778-8c21-b04c51be9bee admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:25.070200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927713cd-6463-4778-8c21-b04c51be9bee admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:25.084810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c1ce5-5647-4853-8b3d-6399646d0c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:25.085869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c1ce5-5647-4853-8b3d-6399646d0c83 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:25.086501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c1ce5-5647-4853-8b3d-6399646d0c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:25.086778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c1ce5-5647-4853-8b3d-6399646d0c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:25.087534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c1ce5-5647-4853-8b3d-6399646d0c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:25.092281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c1ce5-5647-4853-8b3d-6399646d0c83 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:25.117456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1091/2141] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:25.122004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c1ce5-5647-4853-8b3d-6399646d0c83 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:25.133448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c1ce5-5647-4853-8b3d-6399646d0c83 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:25.142241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020f8bc-ad70-4b2d-9c5d-6113051d83d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:25.144977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020f8bc-ad70-4b2d-9c5d-6113051d83d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:25.145449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020f8bc-ad70-4b2d-9c5d-6113051d83d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:25.145900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020f8bc-ad70-4b2d-9c5d-6113051d83d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:25.147218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020f8bc-ad70-4b2d-9c5d-6113051d83d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:25.149061 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020f8bc-ad70-4b2d-9c5d-6113051d83d4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:25.157808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1051/2142] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:24 2022] POST /identity/v3/users => generated 293 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:25.165126 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e512c4e-92b1-4341-a442-a98d7641d80c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:25.183017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e512c4e-92b1-4341-a442-a98d7641d80c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:25.195323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1092/2143] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:25.198550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020f8bc-ad70-4b2d-9c5d-6113051d83d4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:25.218484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc74401-701a-4fd6-b70a-59a12b61ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:25.219872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc74401-701a-4fd6-b70a-59a12b61ad2b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:25.233848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc74401-701a-4fd6-b70a-59a12b61ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:25.233848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc74401-701a-4fd6-b70a-59a12b61ad2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:25.233848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc74401-701a-4fd6-b70a-59a12b61ad2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:25.234144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020f8bc-ad70-4b2d-9c5d-6113051d83d4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:25.236885 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc74401-701a-4fd6-b70a-59a12b61ad2b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:25.243419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d15f53-7755-4ac5-ac8c-6e757220760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:25.244164 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d15f53-7755-4ac5-ac8c-6e757220760b admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:25.244453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d15f53-7755-4ac5-ac8c-6e757220760b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:25.244982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d15f53-7755-4ac5-ac8c-6e757220760b admin admin] PATH_INFO: `/v3/projects/aa3bca14cbc84a8495a2945f0c2fb4f4/users/dff3459aed064a4aa0b4e7ca1cdadc7d/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:25.284312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1052/2144] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:25.288430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc74401-701a-4fd6-b70a-59a12b61ad2b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:25.308166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d15f53-7755-4ac5-ac8c-6e757220760b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3bca14cbc84a8495a2945f0c2fb4f4, user_id=dff3459aed064a4aa0b4e7ca1cdadc7d, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:25.324503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc74401-701a-4fd6-b70a-59a12b61ad2b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:25.333454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d15f53-7755-4ac5-ac8c-6e757220760b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:25.340100 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e9a20-8f0d-44af-aa46-569c73739728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:25.344361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e9a20-8f0d-44af-aa46-569c73739728 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:25.344972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e9a20-8f0d-44af-aa46-569c73739728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:25.345558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e9a20-8f0d-44af-aa46-569c73739728 admin admin] PATH_INFO: `/v3/projects/aaa7d4d896be4102a521a11a1130e9a2/users/9a6626ba44944859b21d401a409a1181/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:25.407452 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e9a20-8f0d-44af-aa46-569c73739728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa7d4d896be4102a521a11a1130e9a2, user_id=9a6626ba44944859b21d401a409a1181, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:25.420572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e9a20-8f0d-44af-aa46-569c73739728 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:25.472159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1093/2145] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:25 2022] PUT /identity/v3/projects/aa3bca14cbc84a8495a2945f0c2fb4f4/users/dff3459aed064a4aa0b4e7ca1cdadc7d/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:25.491788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd37b98-0949-4536-bff9-4738cdec98bd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:25.492095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd37b98-0949-4536-bff9-4738cdec98bd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:25.492375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd37b98-0949-4536-bff9-4738cdec98bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:25.551323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1053/2146] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:25 2022] PUT /identity/v3/projects/aaa7d4d896be4102a521a11a1130e9a2/users/9a6626ba44944859b21d401a409a1181/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:25.572930 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e9a20-8f0d-44af-aa46-569c73739728 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:25.597014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ecd37b98-0949-4536-bff9-4738cdec98bd None None] MFA Rules not processed for user `dff3459aed064a4aa0b4e7ca1cdadc7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:25.599884 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ecd37b98-0949-4536-bff9-4738cdec98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:25.662595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:25.751580 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e9a20-8f0d-44af-aa46-569c73739728 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:25.759473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b430354-0c54-4b72-bb9c-6cbee3ed69fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:25.761335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b430354-0c54-4b72-bb9c-6cbee3ed69fb admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:25.761891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b430354-0c54-4b72-bb9c-6cbee3ed69fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:25.762397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b430354-0c54-4b72-bb9c-6cbee3ed69fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:25.763623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b430354-0c54-4b72-bb9c-6cbee3ed69fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:25.769031 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b430354-0c54-4b72-bb9c-6cbee3ed69fb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:25.789032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1094/2147] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:25.802454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32143e-662b-44d6-aff5-af0207ff831c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:25.802884 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32143e-662b-44d6-aff5-af0207ff831c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:25.803250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32143e-662b-44d6-aff5-af0207ff831c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:25.816469 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1054/2148] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:25.817535 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b430354-0c54-4b72-bb9c-6cbee3ed69fb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:25.824036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9b430354-0c54-4b72-bb9c-6cbee3ed69fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:25.902571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dd32143e-662b-44d6-aff5-af0207ff831c None None] MFA Rules not processed for user `275bbf3d484d4f04a4e7f150074ce305`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:25.906591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dd32143e-662b-44d6-aff5-af0207ff831c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:26.026664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b430354-0c54-4b72-bb9c-6cbee3ed69fb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:26.030043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb0d3b-1208-4836-bda1-cdef924d1456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:26.032144 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb0d3b-1208-4836-bda1-cdef924d1456 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.032756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb0d3b-1208-4836-bda1-cdef924d1456 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.033390 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb0d3b-1208-4836-bda1-cdef924d1456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.055779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb0d3b-1208-4836-bda1-cdef924d1456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:26.058042 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb0d3b-1208-4836-bda1-cdef924d1456 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:26.077526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1055/2149] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:26.079255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb0d3b-1208-4836-bda1-cdef924d1456 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:26.093240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb0d3b-1208-4836-bda1-cdef924d1456 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:26.095473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1095/2150] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:26.100785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b03ce-2780-4052-b770-e259f9053687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:26.101573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b03ce-2780-4052-b770-e259f9053687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.102016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b03ce-2780-4052-b770-e259f9053687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.102682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b03ce-2780-4052-b770-e259f9053687 admin admin] PATH_INFO: `/v3/projects/aaa7d4d896be4102a521a11a1130e9a2/users/9a6626ba44944859b21d401a409a1181/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.104748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b03ce-2780-4052-b770-e259f9053687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa7d4d896be4102a521a11a1130e9a2, user_id=9a6626ba44944859b21d401a409a1181, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:26.109171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b03ce-2780-4052-b770-e259f9053687 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:26.150821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1056/2151] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:26 2022] PUT /identity/v3/projects/aaa7d4d896be4102a521a11a1130e9a2/users/9a6626ba44944859b21d401a409a1181/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:26.440126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32143e-662b-44d6-aff5-af0207ff831c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:26.441798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dd32143e-662b-44d6-aff5-af0207ff831c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:26.456887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32143e-662b-44d6-aff5-af0207ff831c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:26.530305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff874ce-68be-4238-9ca1-022441231ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:26.531046 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff874ce-68be-4238-9ca1-022441231ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.531399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff874ce-68be-4238-9ca1-022441231ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.531756 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff874ce-68be-4238-9ca1-022441231ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.709629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff874ce-68be-4238-9ca1-022441231ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:26.712813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff874ce-68be-4238-9ca1-022441231ac5 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:26.736105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1096/2152] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:27.505178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:29.601187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b7e9-743e-4ab4-8c80-1ded53a5d3e0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:29.610615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b7e9-743e-4ab4-8c80-1ded53a5d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:29.610615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b7e9-743e-4ab4-8c80-1ded53a5d3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:29.700556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b4a6b7e9-743e-4ab4-8c80-1ded53a5d3e0 None None] MFA Rules not processed for user `275bbf3d484d4f04a4e7f150074ce305`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:29.705586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b4a6b7e9-743e-4ab4-8c80-1ded53a5d3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:29.736288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1057/2153] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:30.149891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:30.227580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8405c-e594-4446-ac6d-2c1baa1376cf None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:30.230095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8405c-e594-4446-ac6d-2c1baa1376cf None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:30.230447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8405c-e594-4446-ac6d-2c1baa1376cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:30.278462 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-95c8405c-e594-4446-ac6d-2c1baa1376cf None None] MFA Rules not processed for user `5eec554b613142b0a8ec4976501fb45d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:30.278462 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-95c8405c-e594-4446-ac6d-2c1baa1376cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:30.444546 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1097/2154] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:31.888230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:33.720162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f1bda-4572-4f87-895a-d7389fdf1cd0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:33.720703 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f1bda-4572-4f87-895a-d7389fdf1cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:33.720985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f1bda-4572-4f87-895a-d7389fdf1cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:33.759926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7e4f1bda-4572-4f87-895a-d7389fdf1cd0 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:33.762636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7e4f1bda-4572-4f87-895a-d7389fdf1cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:33.809398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:34.036995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1058/2155] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:34.053212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8405c-e594-4446-ac6d-2c1baa1376cf None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.055424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-95c8405c-e594-4446-ac6d-2c1baa1376cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:34.086355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:34.232033 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8405c-e594-4446-ac6d-2c1baa1376cf None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.240400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f86d54-5d46-4223-86fc-58fb26e20a56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.241419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f86d54-5d46-4223-86fc-58fb26e20a56 service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.242552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f86d54-5d46-4223-86fc-58fb26e20a56 service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.243309 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f86d54-5d46-4223-86fc-58fb26e20a56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.273962 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f86d54-5d46-4223-86fc-58fb26e20a56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.276006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f86d54-5d46-4223-86fc-58fb26e20a56 service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.303425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1098/2156] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:47:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:47:34.750462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:36.631922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f1bda-4572-4f87-895a-d7389fdf1cd0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:36.868321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f1bda-4572-4f87-895a-d7389fdf1cd0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:36.877645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:36.877645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:36.877645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:36.877645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] PATH_INFO: `/v3/users/dff3459aed064a4aa0b4e7ca1cdadc7d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:36.879468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff3459aed064a4aa0b4e7ca1cdadc7d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:36.889910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:37.247922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:37.250819 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff3459aed064a4aa0b4e7ca1cdadc7d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.251648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff3459aed064a4aa0b4e7ca1cdadc7d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.283700 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff3459aed064a4aa0b4e7ca1cdadc7d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.297430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff3459aed064a4aa0b4e7ca1cdadc7d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.298988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff3459aed064a4aa0b4e7ca1cdadc7d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.447023 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1059/2157] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:36 2022] DELETE /identity/v3/users/dff3459aed064a4aa0b4e7ca1cdadc7d => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:37.452648 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace0182-db6f-44ba-8a81-85d28089d72a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:37.462757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace0182-db6f-44ba-8a81-85d28089d72a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:37.462757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace0182-db6f-44ba-8a81-85d28089d72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:37.527912 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dace0182-db6f-44ba-8a81-85d28089d72a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:37.530323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dace0182-db6f-44ba-8a81-85d28089d72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:37.637846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1099/2158] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:37.650469 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:37.653538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:37.842000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5b461-b717-4fe8-bcec-3c954340e3d3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:37.846960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc728f3e-6590-4cd8-bdd7-55e9afd958d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:37.850060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc728f3e-6590-4cd8-bdd7-55e9afd958d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:37.850797 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc728f3e-6590-4cd8-bdd7-55e9afd958d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:37.852082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc728f3e-6590-4cd8-bdd7-55e9afd958d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:37.875320 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc728f3e-6590-4cd8-bdd7-55e9afd958d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:37.878331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc728f3e-6590-4cd8-bdd7-55e9afd958d1 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:37.898512 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1060/2159] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:38.097590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:38.613914 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:39.178479 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ed416-29c9-465a-9183-888983adc5ea None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:39.178969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ed416-29c9-465a-9183-888983adc5ea None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:39.179054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ed416-29c9-465a-9183-888983adc5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:39.268651 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0a2ed416-29c9-465a-9183-888983adc5ea None None] MFA Rules not processed for user `9a6626ba44944859b21d401a409a1181`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:39.278416 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0a2ed416-29c9-465a-9183-888983adc5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:39.450741 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1100/2160] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:39.483738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc728f3e-6590-4cd8-bdd7-55e9afd958d1 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:39.486658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fc728f3e-6590-4cd8-bdd7-55e9afd958d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:39.826520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc728f3e-6590-4cd8-bdd7-55e9afd958d1 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:39.835784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794abbe-80e5-4bc2-b40f-399690f3dbf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:39.837108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794abbe-80e5-4bc2-b40f-399690f3dbf9 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:39.838004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794abbe-80e5-4bc2-b40f-399690f3dbf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:39.838476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794abbe-80e5-4bc2-b40f-399690f3dbf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:39.842223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0794abbe-80e5-4bc2-b40f-399690f3dbf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:39.934969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794abbe-80e5-4bc2-b40f-399690f3dbf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:39.937078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794abbe-80e5-4bc2-b40f-399690f3dbf9 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:39.961980 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1061/2161] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:40.495298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ed416-29c9-465a-9183-888983adc5ea None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:40.498295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0a2ed416-29c9-465a-9183-888983adc5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:40.561336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ed416-29c9-465a-9183-888983adc5ea None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:40.561336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01521449-e837-4225-9df6-e41043dc82a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:40.561336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01521449-e837-4225-9df6-e41043dc82a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:40.561336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01521449-e837-4225-9df6-e41043dc82a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:40.561694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01521449-e837-4225-9df6-e41043dc82a5 admin admin] PATH_INFO: `/v3/projects/aa3bca14cbc84a8495a2945f0c2fb4f4` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:40.561694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01521449-e837-4225-9df6-e41043dc82a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3bca14cbc84a8495a2945f0c2fb4f4)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:40.561694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01521449-e837-4225-9df6-e41043dc82a5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:40.904663 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:40.963382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-01521449-e837-4225-9df6-e41043dc82a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3bca14cbc84a8495a2945f0c2fb4f4', 'request_id': 'req-01521449-e837-4225-9df6-e41043dc82a5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:40.988611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-01521449-e837-4225-9df6-e41043dc82a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3bca14cbc84a8495a2945f0c2fb4f4', 'request_id': 'req-01521449-e837-4225-9df6-e41043dc82a5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:41.172331 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-01521449-e837-4225-9df6-e41043dc82a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3bca14cbc84a8495a2945f0c2fb4f4', 'request_id': 'req-01521449-e837-4225-9df6-e41043dc82a5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:41.249324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-01521449-e837-4225-9df6-e41043dc82a5 admin admin] The token cache is being invalidate because project aa3bca14cbc84a8495a2945f0c2fb4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:41.249324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-01521449-e837-4225-9df6-e41043dc82a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:41.249324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-01521449-e837-4225-9df6-e41043dc82a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:41.249324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1101/2162] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:40 2022] DELETE /identity/v3/projects/aa3bca14cbc84a8495a2945f0c2fb4f4 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:41.249764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5e83-5ed9-4480-9e2b-d68aa8a2bb6b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:41.249764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5e83-5ed9-4480-9e2b-d68aa8a2bb6b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:41.249967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5e83-5ed9-4480-9e2b-d68aa8a2bb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:41.297644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-431c5e83-5ed9-4480-9e2b-d68aa8a2bb6b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:41.312509 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-431c5e83-5ed9-4480-9e2b-d68aa8a2bb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:41.592769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6d115-4829-4967-9222-b05e7e36919a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:41.594019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1062/2163] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:41.594512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6d115-4829-4967-9222-b05e7e36919a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:41.594883 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6d115-4829-4967-9222-b05e7e36919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:41.635780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c4f6d115-4829-4967-9222-b05e7e36919a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:41.637235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c4f6d115-4829-4967-9222-b05e7e36919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:41.681736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1102/2164] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:41.683311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c5e83-5ed9-4480-9e2b-d68aa8a2bb6b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:41.696434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c5e83-5ed9-4480-9e2b-d68aa8a2bb6b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:41.702304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1323322-19d3-4e45-a368-c3ea8d7dca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:41.703403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1323322-19d3-4e45-a368-c3ea8d7dca52 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:41.703932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1323322-19d3-4e45-a368-c3ea8d7dca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:41.704425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1323322-19d3-4e45-a368-c3ea8d7dca52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:41.705353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1323322-19d3-4e45-a368-c3ea8d7dca52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:41.705883 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1323322-19d3-4e45-a368-c3ea8d7dca52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:41.709897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1323322-19d3-4e45-a368-c3ea8d7dca52 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:41.738168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1063/2165] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:47:41.739285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6d115-4829-4967-9222-b05e7e36919a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:41.752474 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6d115-4829-4967-9222-b05e7e36919a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:41.768623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fb39-ba98-4359-b636-320ed38169b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:41.769276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fb39-ba98-4359-b636-320ed38169b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:41.769541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fb39-ba98-4359-b636-320ed38169b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:41.769808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fb39-ba98-4359-b636-320ed38169b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:41.770444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246fb39-ba98-4359-b636-320ed38169b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:41.776883 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246fb39-ba98-4359-b636-320ed38169b6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:42.564929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1103/2166] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:41 2022] POST /identity/v3/projects => generated 383 bytes in 824 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:42.566119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1323322-19d3-4e45-a368-c3ea8d7dca52 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:42.577505 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1323322-19d3-4e45-a368-c3ea8d7dca52 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:42.641602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ab71b-4449-4de0-b7c4-9c0fbd23024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:42.642241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ab71b-4449-4de0-b7c4-9c0fbd23024c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:42.642513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ab71b-4449-4de0-b7c4-9c0fbd23024c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:42.642781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ab71b-4449-4de0-b7c4-9c0fbd23024c admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:42.643404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ab71b-4449-4de0-b7c4-9c0fbd23024c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:42.645353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ab71b-4449-4de0-b7c4-9c0fbd23024c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:42.820825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1064/2167] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:42 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:42.824732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fb39-ba98-4359-b636-320ed38169b6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:42.866228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fb39-ba98-4359-b636-320ed38169b6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:42.881685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fd6c2-c726-4036-84c3-28943cb70033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:42.883693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fd6c2-c726-4036-84c3-28943cb70033 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:42.884057 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fd6c2-c726-4036-84c3-28943cb70033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:42.884405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fd6c2-c726-4036-84c3-28943cb70033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:42.885204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fd6c2-c726-4036-84c3-28943cb70033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:42.887462 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fd6c2-c726-4036-84c3-28943cb70033 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:42.910280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1104/2168] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:42.912429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ab71b-4449-4de0-b7c4-9c0fbd23024c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:42.950527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ab71b-4449-4de0-b7c4-9c0fbd23024c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:42.964717 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c86d91-0d8e-442a-9fd4-15da990f8433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:42.968466 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c86d91-0d8e-442a-9fd4-15da990f8433 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:42.969150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c86d91-0d8e-442a-9fd4-15da990f8433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:42.969528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c86d91-0d8e-442a-9fd4-15da990f8433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:42.970821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c86d91-0d8e-442a-9fd4-15da990f8433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:42.980769 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c86d91-0d8e-442a-9fd4-15da990f8433 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:42.998343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1065/2169] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:43.002687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fd6c2-c726-4036-84c3-28943cb70033 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:43.037993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fd6c2-c726-4036-84c3-28943cb70033 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:43.048173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db7f8f-b5b4-4e50-b445-bb5a8a2b4f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:43.050628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db7f8f-b5b4-4e50-b445-bb5a8a2b4f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:43.050628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db7f8f-b5b4-4e50-b445-bb5a8a2b4f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:43.053556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db7f8f-b5b4-4e50-b445-bb5a8a2b4f84 admin admin] PATH_INFO: `/v3/projects/ab3417909acc4e9a94c8d0ddb075efd1/users/e72d12632b3448ada7f888fdb609a53b/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:43.076515 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db7f8f-b5b4-4e50-b445-bb5a8a2b4f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3417909acc4e9a94c8d0ddb075efd1, user_id=e72d12632b3448ada7f888fdb609a53b, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:43.079425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db7f8f-b5b4-4e50-b445-bb5a8a2b4f84 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:43.421886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1105/2170] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:43 2022] PUT /identity/v3/projects/ab3417909acc4e9a94c8d0ddb075efd1/users/e72d12632b3448ada7f888fdb609a53b/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:43.422234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411424b-2de2-4dbb-a4d2-9ce59740f946 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:43.422234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411424b-2de2-4dbb-a4d2-9ce59740f946 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:43.422234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411424b-2de2-4dbb-a4d2-9ce59740f946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:43.471121 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e411424b-2de2-4dbb-a4d2-9ce59740f946 None None] MFA Rules not processed for user `e72d12632b3448ada7f888fdb609a53b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:43.478671 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e411424b-2de2-4dbb-a4d2-9ce59740f946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:43.626678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db7f8f-b5b4-4e50-b445-bb5a8a2b4f84 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:43.628261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1066/2171] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:43.747288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db7f8f-b5b4-4e50-b445-bb5a8a2b4f84 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:43.753788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80fb83-2b16-456a-a498-57c8d4f0d2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:43.755192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80fb83-2b16-456a-a498-57c8d4f0d2ef admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:43.756448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80fb83-2b16-456a-a498-57c8d4f0d2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:43.756984 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80fb83-2b16-456a-a498-57c8d4f0d2ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:43.757948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80fb83-2b16-456a-a498-57c8d4f0d2ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:43.760294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80fb83-2b16-456a-a498-57c8d4f0d2ef admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:43.944927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1106/2172] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:43 2022] POST /identity/v3/projects => generated 385 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:43.950052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411424b-2de2-4dbb-a4d2-9ce59740f946 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:43.973308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411424b-2de2-4dbb-a4d2-9ce59740f946 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:44.148984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf457a-ca2b-4df4-8719-abcf72f3470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:44.150016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf457a-ca2b-4df4-8719-abcf72f3470c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:44.150523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf457a-ca2b-4df4-8719-abcf72f3470c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:44.152192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf457a-ca2b-4df4-8719-abcf72f3470c admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:44.152192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf457a-ca2b-4df4-8719-abcf72f3470c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:44.154209 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf457a-ca2b-4df4-8719-abcf72f3470c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:44.379822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1067/2173] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:43 2022] POST /identity/v3/users => generated 293 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:44.384048 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80fb83-2b16-456a-a498-57c8d4f0d2ef admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:44.403402 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80fb83-2b16-456a-a498-57c8d4f0d2ef admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:44.427594 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1829b1c-758d-4da5-935d-08bdec7518cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:44.428590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1829b1c-758d-4da5-935d-08bdec7518cb admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:44.429063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1829b1c-758d-4da5-935d-08bdec7518cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:44.429545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1829b1c-758d-4da5-935d-08bdec7518cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:44.430443 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1829b1c-758d-4da5-935d-08bdec7518cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:44.440635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1829b1c-758d-4da5-935d-08bdec7518cb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:44.465254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1107/2174] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:44.467617 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf457a-ca2b-4df4-8719-abcf72f3470c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:44.482128 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf457a-ca2b-4df4-8719-abcf72f3470c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:44.517945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb93724-27a2-4926-bf5c-eb32dafd2ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:44.520654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb93724-27a2-4926-bf5c-eb32dafd2ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:44.524423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb93724-27a2-4926-bf5c-eb32dafd2ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:44.524669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb93724-27a2-4926-bf5c-eb32dafd2ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:44.525412 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb93724-27a2-4926-bf5c-eb32dafd2ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:44.527134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb93724-27a2-4926-bf5c-eb32dafd2ad5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:44.561713 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1068/2175] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:44.562762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1829b1c-758d-4da5-935d-08bdec7518cb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:44.577268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1829b1c-758d-4da5-935d-08bdec7518cb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:44.612970 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5a7be-4347-4ba8-a61b-69ccea69298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:44.614827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5a7be-4347-4ba8-a61b-69ccea69298e admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:44.615349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5a7be-4347-4ba8-a61b-69ccea69298e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:44.615820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5a7be-4347-4ba8-a61b-69ccea69298e admin admin] PATH_INFO: `/v3/projects/922b747259654fbfaa2009d7b33e8a10/users/f97747e68ec04579bb0bed66b2729460/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:44.665476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5a7be-4347-4ba8-a61b-69ccea69298e admin admin] RBAC: Authorizing `identity:create_grant(project_id=922b747259654fbfaa2009d7b33e8a10, user_id=f97747e68ec04579bb0bed66b2729460, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:44.669535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5a7be-4347-4ba8-a61b-69ccea69298e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:44.782851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1108/2176] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:44 2022] PUT /identity/v3/projects/922b747259654fbfaa2009d7b33e8a10/users/f97747e68ec04579bb0bed66b2729460/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:44.794285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15ce2e-e58f-44a2-8fbb-f61a5a648dc7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:44.795339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15ce2e-e58f-44a2-8fbb-f61a5a648dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:44.796519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15ce2e-e58f-44a2-8fbb-f61a5a648dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:44.894028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ae15ce2e-e58f-44a2-8fbb-f61a5a648dc7 None None] MFA Rules not processed for user `f97747e68ec04579bb0bed66b2729460`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:44.903035 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ae15ce2e-e58f-44a2-8fbb-f61a5a648dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:45.076415 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1069/2177] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:45.084163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5a7be-4347-4ba8-a61b-69ccea69298e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:45.243705 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5a7be-4347-4ba8-a61b-69ccea69298e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:45.266314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3650f3-1d55-41c9-86a1-4d327d962822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:45.267975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3650f3-1d55-41c9-86a1-4d327d962822 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:45.283009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3650f3-1d55-41c9-86a1-4d327d962822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:45.284359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3650f3-1d55-41c9-86a1-4d327d962822 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:45.287997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3650f3-1d55-41c9-86a1-4d327d962822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:45.303127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3650f3-1d55-41c9-86a1-4d327d962822 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:45.454315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1109/2178] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:45 2022] POST /identity/v3/projects => generated 385 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:45.455988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15ce2e-e58f-44a2-8fbb-f61a5a648dc7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:45.499979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15ce2e-e58f-44a2-8fbb-f61a5a648dc7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:45.557269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:45.706060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e3322-bc22-456e-b47f-d7410b025f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:45.707574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e3322-bc22-456e-b47f-d7410b025f83 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:45.709691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e3322-bc22-456e-b47f-d7410b025f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:45.710288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e3322-bc22-456e-b47f-d7410b025f83 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:45.712709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e3322-bc22-456e-b47f-d7410b025f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:45.720117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e3322-bc22-456e-b47f-d7410b025f83 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:45.892105 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1070/2179] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:45 2022] POST /identity/v3/users => generated 299 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:45.893221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3650f3-1d55-41c9-86a1-4d327d962822 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:45.914194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3650f3-1d55-41c9-86a1-4d327d962822 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:45.927828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb7613-0f64-4780-9190-7f8a76d3c6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:45.929147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb7613-0f64-4780-9190-7f8a76d3c6be admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:45.929320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb7613-0f64-4780-9190-7f8a76d3c6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:45.929771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb7613-0f64-4780-9190-7f8a76d3c6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:45.930889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb7613-0f64-4780-9190-7f8a76d3c6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:45.933776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb7613-0f64-4780-9190-7f8a76d3c6be admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:46.029685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1110/2180] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:46.030881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e3322-bc22-456e-b47f-d7410b025f83 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:46.064374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e3322-bc22-456e-b47f-d7410b025f83 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:46.093948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba0a25-cfa4-4e7e-a653-4b4a295f60a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:46.095406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba0a25-cfa4-4e7e-a653-4b4a295f60a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:46.096118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba0a25-cfa4-4e7e-a653-4b4a295f60a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:46.102435 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba0a25-cfa4-4e7e-a653-4b4a295f60a3 admin admin] PATH_INFO: `/v3/projects/6781430fc3e249c8a662cf5993b6ff2d/users/454cbf2aab9e42f5b905a08da6c972b5/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:46.169115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba0a25-cfa4-4e7e-a653-4b4a295f60a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6781430fc3e249c8a662cf5993b6ff2d, user_id=454cbf2aab9e42f5b905a08da6c972b5, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:46.169115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba0a25-cfa4-4e7e-a653-4b4a295f60a3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:46.295359 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1071/2181] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:46 2022] PUT /identity/v3/projects/6781430fc3e249c8a662cf5993b6ff2d/users/454cbf2aab9e42f5b905a08da6c972b5/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:46.299526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb7613-0f64-4780-9190-7f8a76d3c6be admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:46.328354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb7613-0f64-4780-9190-7f8a76d3c6be admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:46.527899 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76e234-4434-47d1-944d-fca33351e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:46.529008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76e234-4434-47d1-944d-fca33351e337 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:46.529519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76e234-4434-47d1-944d-fca33351e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:46.530471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76e234-4434-47d1-944d-fca33351e337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:46.532698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76e234-4434-47d1-944d-fca33351e337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:46.546376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76e234-4434-47d1-944d-fca33351e337 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:46.571788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1111/2182] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:46.576268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba0a25-cfa4-4e7e-a653-4b4a295f60a3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:46.589033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba0a25-cfa4-4e7e-a653-4b4a295f60a3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:46.614590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e83614-7bcf-4241-b30d-d58d64494353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:46.615080 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e83614-7bcf-4241-b30d-d58d64494353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:46.615525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e83614-7bcf-4241-b30d-d58d64494353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:46.616126 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e83614-7bcf-4241-b30d-d58d64494353 admin admin] PATH_INFO: `/v3/projects/6781430fc3e249c8a662cf5993b6ff2d/users/454cbf2aab9e42f5b905a08da6c972b5/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:46.619256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e83614-7bcf-4241-b30d-d58d64494353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6781430fc3e249c8a662cf5993b6ff2d, user_id=454cbf2aab9e42f5b905a08da6c972b5, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:46.630435 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e83614-7bcf-4241-b30d-d58d64494353 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:46.657469 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1072/2183] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:46 2022] PUT /identity/v3/projects/6781430fc3e249c8a662cf5993b6ff2d/users/454cbf2aab9e42f5b905a08da6c972b5/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:46.676436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c0a45-fa31-4dac-bb81-abb73d5f392d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:46.679675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c0a45-fa31-4dac-bb81-abb73d5f392d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:46.679675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c0a45-fa31-4dac-bb81-abb73d5f392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:46.787421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-448c0a45-fa31-4dac-bb81-abb73d5f392d None None] MFA Rules not processed for user `454cbf2aab9e42f5b905a08da6c972b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:46.788079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-448c0a45-fa31-4dac-bb81-abb73d5f392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:47.099769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1112/2184] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:47.112292 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e83614-7bcf-4241-b30d-d58d64494353 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:47.114817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-46e83614-7bcf-4241-b30d-d58d64494353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:47.218610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e83614-7bcf-4241-b30d-d58d64494353 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:47.227811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448d7d2-7bc8-4e1b-a770-ff84c15f2c15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:47.228706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448d7d2-7bc8-4e1b-a770-ff84c15f2c15 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:47.229140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448d7d2-7bc8-4e1b-a770-ff84c15f2c15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:47.230580 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448d7d2-7bc8-4e1b-a770-ff84c15f2c15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:47.381060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448d7d2-7bc8-4e1b-a770-ff84c15f2c15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:47.407507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448d7d2-7bc8-4e1b-a770-ff84c15f2c15 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:47.452760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1073/2185] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:49.203542 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa5da7-d113-4c9f-a019-c881269e6f55 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:49.204127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa5da7-d113-4c9f-a019-c881269e6f55 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:49.204127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa5da7-d113-4c9f-a019-c881269e6f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:49.257318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-aafa5da7-d113-4c9f-a019-c881269e6f55 None None] MFA Rules not processed for user `3a962c814f9f40bfa9e13efda4a66786`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:49.258712 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-aafa5da7-d113-4c9f-a019-c881269e6f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:49.460659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1113/2186] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:50.212842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:51.321134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:51.642192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448d7d2-7bc8-4e1b-a770-ff84c15f2c15 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:51.670432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448d7d2-7bc8-4e1b-a770-ff84c15f2c15 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:51.694125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15ae64-b5c0-44ee-8c9b-7d94f1de2462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:51.695084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15ae64-b5c0-44ee-8c9b-7d94f1de2462 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:51.695709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15ae64-b5c0-44ee-8c9b-7d94f1de2462 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:51.697042 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15ae64-b5c0-44ee-8c9b-7d94f1de2462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:51.977670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15ae64-b5c0-44ee-8c9b-7d94f1de2462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:51.979180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15ae64-b5c0-44ee-8c9b-7d94f1de2462 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:52.048009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1074/2187] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:55.493504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:56.025022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa5da7-d113-4c9f-a019-c881269e6f55 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:56.049732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa5da7-d113-4c9f-a019-c881269e6f55 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:56.056794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73d041-34e3-484b-be0f-a6895d2a0e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:56.059391 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73d041-34e3-484b-be0f-a6895d2a0e7e service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:56.070971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73d041-34e3-484b-be0f-a6895d2a0e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:56.070971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73d041-34e3-484b-be0f-a6895d2a0e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:56.082764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73d041-34e3-484b-be0f-a6895d2a0e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:56.086118 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73d041-34e3-484b-be0f-a6895d2a0e7e service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:56.107376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1114/2188] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:56.477197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:56.938959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ca030-f749-4967-89bd-a84acd3217d6 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:56.939500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ca030-f749-4967-89bd-a84acd3217d6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:56.940058 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ca030-f749-4967-89bd-a84acd3217d6 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:56.944369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1075/2189] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:47:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:47:56.952913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b8713-e24b-4f52-801d-c7c5285345b2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:56.953389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b8713-e24b-4f52-801d-c7c5285345b2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:56.954536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b8713-e24b-4f52-801d-c7c5285345b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:56.991070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-602b8713-e24b-4f52-801d-c7c5285345b2 None None] MFA Rules not processed for user `8ebfb233b2504463a4ee9202b5a3ab50`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:56.992725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-602b8713-e24b-4f52-801d-c7c5285345b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:57.077606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ca030-f749-4967-89bd-a84acd3217d6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:57.080715 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b65ca030-f749-4967-89bd-a84acd3217d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:57.102997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1115/2190] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:47:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:57.126774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b8713-e24b-4f52-801d-c7c5285345b2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:57.126774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-602b8713-e24b-4f52-801d-c7c5285345b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:57.142512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b8713-e24b-4f52-801d-c7c5285345b2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:57.162619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eedd78-ca28-4756-a410-63e678909be2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebfb233b2504463a4ee9202b5a3ab50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:57.163549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eedd78-ca28-4756-a410-63e678909be2 service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:57.164144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eedd78-ca28-4756-a410-63e678909be2 service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:57.164766 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eedd78-ca28-4756-a410-63e678909be2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:57.194241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eedd78-ca28-4756-a410-63e678909be2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:57.197468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eedd78-ca28-4756-a410-63e678909be2 service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:57.226155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1116/2191] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:57.283327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ca030-f749-4967-89bd-a84acd3217d6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:57.295668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:57.295668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:57.295668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:57.295668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] PATH_INFO: `/v3/users/c9ebbc99270c4357afe873f357ba4372` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:57.297081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ebbc99270c4357afe873f357ba4372)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:57.301335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:57.686857 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ebbc99270c4357afe873f357ba4372'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:57.687675 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ebbc99270c4357afe873f357ba4372'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:57.708887 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ebbc99270c4357afe873f357ba4372'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:57.719321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ebbc99270c4357afe873f357ba4372'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:57.720616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ebbc99270c4357afe873f357ba4372'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:57.835930 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1076/2192] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:57 2022] DELETE /identity/v3/users/c9ebbc99270c4357afe873f357ba4372 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:57.841069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02eeb-22ef-4c1e-ad88-adeac3d236aa None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:57.841436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02eeb-22ef-4c1e-ad88-adeac3d236aa None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:57.841784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02eeb-22ef-4c1e-ad88-adeac3d236aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:57.865222 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-06e02eeb-22ef-4c1e-ad88-adeac3d236aa None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:57.867140 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-06e02eeb-22ef-4c1e-ad88-adeac3d236aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:57.972602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1117/2193] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:57.988439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:57.990123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:58.034727 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:58.080753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90176cea-38f7-4514-8df9-e33a36b5cebd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:58.096101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470043-c9d0-4133-9494-a8430bafff41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:58.096101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470043-c9d0-4133-9494-a8430bafff41 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:58.096101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470043-c9d0-4133-9494-a8430bafff41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:58.096101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470043-c9d0-4133-9494-a8430bafff41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:58.110166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2470043-c9d0-4133-9494-a8430bafff41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:58.113038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2470043-c9d0-4133-9494-a8430bafff41 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:58.129015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1077/2194] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:59.065444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02eeb-22ef-4c1e-ad88-adeac3d236aa None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:59.068097 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-06e02eeb-22ef-4c1e-ad88-adeac3d236aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:59.089821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02eeb-22ef-4c1e-ad88-adeac3d236aa None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:59.099470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a826b-d7d7-4646-881f-173ca700701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:59.100456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a826b-d7d7-4646-881f-173ca700701f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:59.100894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a826b-d7d7-4646-881f-173ca700701f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:59.101375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a826b-d7d7-4646-881f-173ca700701f admin admin] PATH_INFO: `/v3/projects/ebb14eaae11744c6a4e8f1d20612558b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:59.103169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a826b-d7d7-4646-881f-173ca700701f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb14eaae11744c6a4e8f1d20612558b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:59.106520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a826b-d7d7-4646-881f-173ca700701f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:59.233177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470043-c9d0-4133-9494-a8430bafff41 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:59.233177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b2470043-c9d0-4133-9494-a8430bafff41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:59.258892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470043-c9d0-4133-9494-a8430bafff41 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:59.268797 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:59.272547 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:59.272547 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:59.272547 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] PATH_INFO: `/v3/users/2b38cc0d7c5d43008599050a0d64989c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:59.272547 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b38cc0d7c5d43008599050a0d64989c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:59.274516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:59.361875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e13a826b-d7d7-4646-881f-173ca700701f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb14eaae11744c6a4e8f1d20612558b', 'request_id': 'req-e13a826b-d7d7-4646-881f-173ca700701f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.374980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e13a826b-d7d7-4646-881f-173ca700701f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb14eaae11744c6a4e8f1d20612558b', 'request_id': 'req-e13a826b-d7d7-4646-881f-173ca700701f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.463849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e13a826b-d7d7-4646-881f-173ca700701f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb14eaae11744c6a4e8f1d20612558b', 'request_id': 'req-e13a826b-d7d7-4646-881f-173ca700701f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.484582 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e13a826b-d7d7-4646-881f-173ca700701f admin admin] The token cache is being invalidate because project ebb14eaae11744c6a4e8f1d20612558b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:59.485296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e13a826b-d7d7-4646-881f-173ca700701f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.486448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e13a826b-d7d7-4646-881f-173ca700701f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.500369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1118/2195] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:59 2022] DELETE /identity/v3/projects/ebb14eaae11744c6a4e8f1d20612558b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:59.500466 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:59.501157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becfc21-bf87-43f6-af36-2b1f8e2680be None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:59.501673 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becfc21-bf87-43f6-af36-2b1f8e2680be None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:59.502791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becfc21-bf87-43f6-af36-2b1f8e2680be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:59.547596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3becfc21-bf87-43f6-af36-2b1f8e2680be None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:59.549229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3becfc21-bf87-43f6-af36-2b1f8e2680be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:59.625960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b38cc0d7c5d43008599050a0d64989c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.628087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b38cc0d7c5d43008599050a0d64989c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.672253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b38cc0d7c5d43008599050a0d64989c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.703514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b38cc0d7c5d43008599050a0d64989c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.708686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b38cc0d7c5d43008599050a0d64989c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.730345 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1119/2196] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:59.742859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7102d-6317-477a-8796-f4a6fd4d224d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:59.744978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7102d-6317-477a-8796-f4a6fd4d224d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:59.745533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7102d-6317-477a-8796-f4a6fd4d224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:59.833984 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d5e7102d-6317-477a-8796-f4a6fd4d224d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:59.845005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d5e7102d-6317-477a-8796-f4a6fd4d224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:59.866413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1078/2197] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:59 2022] DELETE /identity/v3/users/2b38cc0d7c5d43008599050a0d64989c => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:59.893312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1120/2198] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:59.899370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:00.138781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db12e5-10ce-4733-a509-1146d2f88a64 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:00.178747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17527c98-23ed-4f96-80a4-83f5ea5593fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:00.179653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17527c98-23ed-4f96-80a4-83f5ea5593fb admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:00.180184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17527c98-23ed-4f96-80a4-83f5ea5593fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:00.180653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17527c98-23ed-4f96-80a4-83f5ea5593fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:00.181790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17527c98-23ed-4f96-80a4-83f5ea5593fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:48:00.182329 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17527c98-23ed-4f96-80a4-83f5ea5593fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:00.186092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17527c98-23ed-4f96-80a4-83f5ea5593fb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:00.277861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1079/2199] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:48:00.284556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7102d-6317-477a-8796-f4a6fd4d224d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:00.321818 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7102d-6317-477a-8796-f4a6fd4d224d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:00.344653 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e94d78-d0a9-4a0e-880e-2bde5afc47f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:00.345545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94d78-d0a9-4a0e-880e-2bde5afc47f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:00.345979 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94d78-d0a9-4a0e-880e-2bde5afc47f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:00.346501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94d78-d0a9-4a0e-880e-2bde5afc47f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:00.347816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e94d78-d0a9-4a0e-880e-2bde5afc47f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:00.350280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e94d78-d0a9-4a0e-880e-2bde5afc47f6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:00.549884 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1121/2200] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:48:00 2022] POST /identity/v3/projects => generated 391 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:48:00.550902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17527c98-23ed-4f96-80a4-83f5ea5593fb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:00.571795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17527c98-23ed-4f96-80a4-83f5ea5593fb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:00.708174 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb72be4-c83a-45b3-83bf-962b63394fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:00.709122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb72be4-c83a-45b3-83bf-962b63394fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:00.709844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb72be4-c83a-45b3-83bf-962b63394fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:00.711033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb72be4-c83a-45b3-83bf-962b63394fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:00.712983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb72be4-c83a-45b3-83bf-962b63394fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:00.718635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb72be4-c83a-45b3-83bf-962b63394fc1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:00.840484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:00.848818 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e94d78-d0a9-4a0e-880e-2bde5afc47f6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:00.854578 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f1e94d78-d0a9-4a0e-880e-2bde5afc47f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:00.866146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1080/2201] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:48:00 2022] POST /identity/v3/users => generated 296 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:48:00.875180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb72be4-c83a-45b3-83bf-962b63394fc1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:00.905998 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e94d78-d0a9-4a0e-880e-2bde5afc47f6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:00.921818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb72be4-c83a-45b3-83bf-962b63394fc1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:00.925926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:00.938010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:00.938907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:00.939846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] PATH_INFO: `/v3/projects/e271d2351ea24f7eb3a6edf2f89dd17e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:00.943555 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e271d2351ea24f7eb3a6edf2f89dd17e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:00.953133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:00.957205 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396841c6-ca6d-4c8f-b8cd-c7fc6ea13db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:00.958637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396841c6-ca6d-4c8f-b8cd-c7fc6ea13db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:00.959046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396841c6-ca6d-4c8f-b8cd-c7fc6ea13db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:00.959508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396841c6-ca6d-4c8f-b8cd-c7fc6ea13db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:00.960721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396841c6-ca6d-4c8f-b8cd-c7fc6ea13db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:00.969333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396841c6-ca6d-4c8f-b8cd-c7fc6ea13db3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:00.999353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1081/2202] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:48:01.004884 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396841c6-ca6d-4c8f-b8cd-c7fc6ea13db3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:01.031003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396841c6-ca6d-4c8f-b8cd-c7fc6ea13db3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:01.055486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c6035-e526-4137-a611-0b168e3302fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:01.056493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c6035-e526-4137-a611-0b168e3302fc admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:01.056885 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c6035-e526-4137-a611-0b168e3302fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:01.057340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c6035-e526-4137-a611-0b168e3302fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:01.061135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c6035-e526-4137-a611-0b168e3302fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:01.073614 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c6035-e526-4137-a611-0b168e3302fc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:01.099548 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1082/2203] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:48:01.106348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c6035-e526-4137-a611-0b168e3302fc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:01.127973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c6035-e526-4137-a611-0b168e3302fc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:01.146400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79809d8b-fe48-43b1-a7f0-aa5006166131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:01.147661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809d8b-fe48-43b1-a7f0-aa5006166131 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:01.148360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809d8b-fe48-43b1-a7f0-aa5006166131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:01.148982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809d8b-fe48-43b1-a7f0-aa5006166131 admin admin] PATH_INFO: `/v3/projects/5547d382fd9b4d5c9cb465d036d037c1/users/e3373afe040d41329497f21e9097cd2c/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:01.193216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79809d8b-fe48-43b1-a7f0-aa5006166131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5547d382fd9b4d5c9cb465d036d037c1, user_id=e3373afe040d41329497f21e9097cd2c, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:01.198351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79809d8b-fe48-43b1-a7f0-aa5006166131 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:01.325757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1083/2204] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:48:01 2022] PUT /identity/v3/projects/5547d382fd9b4d5c9cb465d036d037c1/users/e3373afe040d41329497f21e9097cd2c/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:48:01.341779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920784f0-4f5a-4e15-a4fc-620cceeea725 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:01.342037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e271d2351ea24f7eb3a6edf2f89dd17e', 'request_id': 'req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:01.343058 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920784f0-4f5a-4e15-a4fc-620cceeea725 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:01.343334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920784f0-4f5a-4e15-a4fc-620cceeea725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:01.371628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e271d2351ea24f7eb3a6edf2f89dd17e', 'request_id': 'req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:01.392357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-920784f0-4f5a-4e15-a4fc-620cceeea725 None None] MFA Rules not processed for user `e3373afe040d41329497f21e9097cd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:01.394135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-920784f0-4f5a-4e15-a4fc-620cceeea725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:01.502293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1084/2205] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:01.508963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e271d2351ea24f7eb3a6edf2f89dd17e', 'request_id': 'req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:01.525617 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920784f0-4f5a-4e15-a4fc-620cceeea725 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:01.529014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-920784f0-4f5a-4e15-a4fc-620cceeea725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:01.540519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] The token cache is being invalidate because project e271d2351ea24f7eb3a6edf2f89dd17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:01.541073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:01.542293 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:01.545457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1122/2206] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:00 2022] DELETE /identity/v3/projects/e271d2351ea24f7eb3a6edf2f89dd17e => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:01.550731 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:01.554509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:01.642744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920784f0-4f5a-4e15-a4fc-620cceeea725 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:01.658355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccc112-f210-490a-9101-7ddd25f1117c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:01.659552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccc112-f210-490a-9101-7ddd25f1117c service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:01.660174 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccc112-f210-490a-9101-7ddd25f1117c service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:01.660823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccc112-f210-490a-9101-7ddd25f1117c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:01.666308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b8ccc112-f210-490a-9101-7ddd25f1117c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:01.686494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d293e-18ad-4c5d-9c78-982e0251c0c1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:01.692835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:01.693494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:01.693776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:01.696400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] PATH_INFO: `/v3/users/7636eca685e04d3a8e6daa2ed120f7ab` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:01.697849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7636eca685e04d3a8e6daa2ed120f7ab)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:01.698780 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccc112-f210-490a-9101-7ddd25f1117c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:01.700316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:01.700585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccc112-f210-490a-9101-7ddd25f1117c service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:01.715099 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1085/2207] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:48:02.162966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7636eca685e04d3a8e6daa2ed120f7ab'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:02.204993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7636eca685e04d3a8e6daa2ed120f7ab'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:02.304920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7636eca685e04d3a8e6daa2ed120f7ab'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:02.305942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7636eca685e04d3a8e6daa2ed120f7ab'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:02.306937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7636eca685e04d3a8e6daa2ed120f7ab'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:02.347289 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1123/2208] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:01 2022] DELETE /identity/v3/users/7636eca685e04d3a8e6daa2ed120f7ab => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:02.381538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:02.487081 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccc112-f210-490a-9101-7ddd25f1117c service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:02.497801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b8ccc112-f210-490a-9101-7ddd25f1117c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:02.539743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccc112-f210-490a-9101-7ddd25f1117c service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:02.682905 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82725b-2112-463f-bab6-1c06303226e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:02.684709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82725b-2112-463f-bab6-1c06303226e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:02.685179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82725b-2112-463f-bab6-1c06303226e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:02.685626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82725b-2112-463f-bab6-1c06303226e5 admin admin] PATH_INFO: `/v3/users/e72d12632b3448ada7f888fdb609a53b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:02.687490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82725b-2112-463f-bab6-1c06303226e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72d12632b3448ada7f888fdb609a53b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:02.694461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82725b-2112-463f-bab6-1c06303226e5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:02.954951 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:02.957337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:02.985322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044294be-0234-4aaf-ab94-11985d50843c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:02.998679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:03.000542 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:03.001812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:03.002673 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7 admin admin] PATH_INFO: `/v3/projects/9a306c9f165048d2a312b2a47db5446b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:03.004471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a306c9f165048d2a312b2a47db5446b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:03.007178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:03.160096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c82725b-2112-463f-bab6-1c06303226e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72d12632b3448ada7f888fdb609a53b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:03.160993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c82725b-2112-463f-bab6-1c06303226e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72d12632b3448ada7f888fdb609a53b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:03.189346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c82725b-2112-463f-bab6-1c06303226e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72d12632b3448ada7f888fdb609a53b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:03.221641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c82725b-2112-463f-bab6-1c06303226e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72d12632b3448ada7f888fdb609a53b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:03.222666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c82725b-2112-463f-bab6-1c06303226e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72d12632b3448ada7f888fdb609a53b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:03.416571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a306c9f165048d2a312b2a47db5446b', 'request_id': 'req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:03.421074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1086/2209] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:02 2022] DELETE /identity/v3/users/e72d12632b3448ada7f888fdb609a53b => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:03.427827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a6f31-2b6f-4f85-aabc-8901917f262e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:03.428332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a6f31-2b6f-4f85-aabc-8901917f262e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:03.428810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a6f31-2b6f-4f85-aabc-8901917f262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:03.430456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a306c9f165048d2a312b2a47db5446b', 'request_id': 'req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:03.468568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1e7a6f31-2b6f-4f85-aabc-8901917f262e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:03.470005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1e7a6f31-2b6f-4f85-aabc-8901917f262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:03.529939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a306c9f165048d2a312b2a47db5446b', 'request_id': 'req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:03.534675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:03.552756 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7 admin admin] The token cache is being invalidate because project 9a306c9f165048d2a312b2a47db5446b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:03.553049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:03.554129 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bb71f4a4-ccba-4c82-ab4e-fc7e322410d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:03.557379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1124/2210] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:02 2022] DELETE /identity/v3/projects/9a306c9f165048d2a312b2a47db5446b => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:03.565648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1087/2211] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:03.568533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9e0a-74b3-4ecb-b74b-8897da3bafef None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:03.569174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9e0a-74b3-4ecb-b74b-8897da3bafef None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:03.569464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9e0a-74b3-4ecb-b74b-8897da3bafef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:03.580074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a6f31-2b6f-4f85-aabc-8901917f262e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:03.582657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1e7a6f31-2b6f-4f85-aabc-8901917f262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:03.624590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-813e9e0a-74b3-4ecb-b74b-8897da3bafef None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:03.629865 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-813e9e0a-74b3-4ecb-b74b-8897da3bafef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:03.661178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1125/2212] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:03.670185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852445b-a8b4-40e3-a356-bc3c15923c4d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:03.670929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852445b-a8b4-40e3-a356-bc3c15923c4d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:03.671649 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852445b-a8b4-40e3-a356-bc3c15923c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:03.726929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a6f31-2b6f-4f85-aabc-8901917f262e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:03.733843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad68dd-bd37-4146-8570-77510b1e83d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:03.734882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad68dd-bd37-4146-8570-77510b1e83d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:03.735391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad68dd-bd37-4146-8570-77510b1e83d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:03.735936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad68dd-bd37-4146-8570-77510b1e83d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:03.739141 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f852445b-a8b4-40e3-a356-bc3c15923c4d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:03.740849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f852445b-a8b4-40e3-a356-bc3c15923c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:03.757484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad68dd-bd37-4146-8570-77510b1e83d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:03.759235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1126/2213] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:48:03.760034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad68dd-bd37-4146-8570-77510b1e83d0 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:03.764808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852445b-a8b4-40e3-a356-bc3c15923c4d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:03.780954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1088/2214] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:48:03.781392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852445b-a8b4-40e3-a356-bc3c15923c4d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:03.788767 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbfa1b-bacd-452b-a71a-5b5f4e2f4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:03.789391 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbfa1b-bacd-452b-a71a-5b5f4e2f4bee admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:03.789668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbfa1b-bacd-452b-a71a-5b5f4e2f4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:03.789930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbfa1b-bacd-452b-a71a-5b5f4e2f4bee admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:03.790831 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbfa1b-bacd-452b-a71a-5b5f4e2f4bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:48:03.791335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbfa1b-bacd-452b-a71a-5b5f4e2f4bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:03.794831 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbfa1b-bacd-452b-a71a-5b5f4e2f4bee admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:03.814776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1127/2215] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:48:03.822508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad68dd-bd37-4146-8570-77510b1e83d0 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:03.838343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad68dd-bd37-4146-8570-77510b1e83d0 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:03.845020 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcb77a-c967-405f-8d08-528b2344ad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:03.845642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb77a-c967-405f-8d08-528b2344ad6a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:03.845920 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb77a-c967-405f-8d08-528b2344ad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:03.846193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb77a-c967-405f-8d08-528b2344ad6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:03.846825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcb77a-c967-405f-8d08-528b2344ad6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:03.848889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcb77a-c967-405f-8d08-528b2344ad6a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:04.055000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1089/2216] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:48:03 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:48:04.060483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbfa1b-bacd-452b-a71a-5b5f4e2f4bee admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:04.075002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbfa1b-bacd-452b-a71a-5b5f4e2f4bee admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:04.224125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2abed1-8a07-4457-b0b3-740c99a9a2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:04.227287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2abed1-8a07-4457-b0b3-740c99a9a2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:04.231440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2abed1-8a07-4457-b0b3-740c99a9a2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:04.232011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2abed1-8a07-4457-b0b3-740c99a9a2e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:04.234248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2abed1-8a07-4457-b0b3-740c99a9a2e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:04.237604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2abed1-8a07-4457-b0b3-740c99a9a2e1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:04.407342 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1128/2217] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:48:04 2022] POST /identity/v3/users => generated 293 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:48:04.420203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcb77a-c967-405f-8d08-528b2344ad6a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:04.431685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcb77a-c967-405f-8d08-528b2344ad6a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:04.437561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c659310-437d-4f48-b953-578c610deda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:04.439566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c659310-437d-4f48-b953-578c610deda2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:04.439566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c659310-437d-4f48-b953-578c610deda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:04.439566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c659310-437d-4f48-b953-578c610deda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:04.439566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c659310-437d-4f48-b953-578c610deda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:04.440960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c659310-437d-4f48-b953-578c610deda2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:04.453768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1090/2218] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:48:04.458538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2abed1-8a07-4457-b0b3-740c99a9a2e1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:04.477996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2abed1-8a07-4457-b0b3-740c99a9a2e1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:04.487794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde711b9-136d-4756-92f7-f271d5c82d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:04.488222 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde711b9-136d-4756-92f7-f271d5c82d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:04.488675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde711b9-136d-4756-92f7-f271d5c82d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:04.489558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde711b9-136d-4756-92f7-f271d5c82d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:04.490622 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde711b9-136d-4756-92f7-f271d5c82d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:04.492507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde711b9-136d-4756-92f7-f271d5c82d49 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:04.507038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1129/2219] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:48:04.516069 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c659310-437d-4f48-b953-578c610deda2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:04.531007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c659310-437d-4f48-b953-578c610deda2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:04.537945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a344d7-5f0c-47aa-84a3-f2de9be120c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:04.537945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a344d7-5f0c-47aa-84a3-f2de9be120c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:04.537945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a344d7-5f0c-47aa-84a3-f2de9be120c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:04.544827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a344d7-5f0c-47aa-84a3-f2de9be120c7 admin admin] PATH_INFO: `/v3/projects/4cacd46a6af7456392cfb6f32437155a/users/29810922b91b4ba0a3515526586f3393/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:04.548417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde711b9-136d-4756-92f7-f271d5c82d49 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:04.552322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cde711b9-136d-4756-92f7-f271d5c82d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:04.561124 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a344d7-5f0c-47aa-84a3-f2de9be120c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cacd46a6af7456392cfb6f32437155a, user_id=29810922b91b4ba0a3515526586f3393, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:04.564393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a344d7-5f0c-47aa-84a3-f2de9be120c7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:04.575681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde711b9-136d-4756-92f7-f271d5c82d49 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:04.580849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:04.581508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:04.581779 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:04.582048 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] PATH_INFO: `/v3/projects/ab3417909acc4e9a94c8d0ddb075efd1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:04.583184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3417909acc4e9a94c8d0ddb075efd1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:04.585162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:04.678569 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1091/2220] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:48:04 2022] PUT /identity/v3/projects/4cacd46a6af7456392cfb6f32437155a/users/29810922b91b4ba0a3515526586f3393/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:04.689683 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73615867-6a6f-4827-a4c1-ad97ccfb55fb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:04.689971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73615867-6a6f-4827-a4c1-ad97ccfb55fb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:04.690250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73615867-6a6f-4827-a4c1-ad97ccfb55fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:04.738070 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-73615867-6a6f-4827-a4c1-ad97ccfb55fb None None] MFA Rules not processed for user `29810922b91b4ba0a3515526586f3393`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:04.740241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73615867-6a6f-4827-a4c1-ad97ccfb55fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:04.780445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3417909acc4e9a94c8d0ddb075efd1', 'request_id': 'req-1e5fa98b-c664-4c13-86db-b7c8e810bb76'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:04.793987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3417909acc4e9a94c8d0ddb075efd1', 'request_id': 'req-1e5fa98b-c664-4c13-86db-b7c8e810bb76'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:04.856792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1092/2221] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:48:04.869775 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73615867-6a6f-4827-a4c1-ad97ccfb55fb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:04.872023 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73615867-6a6f-4827-a4c1-ad97ccfb55fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:04.909452 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3417909acc4e9a94c8d0ddb075efd1', 'request_id': 'req-1e5fa98b-c664-4c13-86db-b7c8e810bb76'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:04.943543 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] The token cache is being invalidate because project ab3417909acc4e9a94c8d0ddb075efd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:04.945042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:04.947131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:04.955783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1130/2222] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:04 2022] DELETE /identity/v3/projects/ab3417909acc4e9a94c8d0ddb075efd1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:04.959184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:04.961631 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:05.052112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73615867-6a6f-4827-a4c1-ad97ccfb55fb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:05.110276 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fa98b-c664-4c13-86db-b7c8e810bb76 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:05.116837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b40a-bd7f-4198-8b16-cd3d27ca68ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:05.118175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b40a-bd7f-4198-8b16-cd3d27ca68ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:05.118175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b40a-bd7f-4198-8b16-cd3d27ca68ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:05.119461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b40a-bd7f-4198-8b16-cd3d27ca68ce admin admin] PATH_INFO: `/v3/users/f97747e68ec04579bb0bed66b2729460` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:05.123227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8b40a-bd7f-4198-8b16-cd3d27ca68ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97747e68ec04579bb0bed66b2729460)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:05.127437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8b40a-bd7f-4198-8b16-cd3d27ca68ce admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:05.149136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac10112-45de-4647-a74f-651804d200ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:05.150230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10112-45de-4647-a74f-651804d200ba service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:05.150715 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10112-45de-4647-a74f-651804d200ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:05.151194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10112-45de-4647-a74f-651804d200ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:05.154870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bac10112-45de-4647-a74f-651804d200ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:05.253726 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac10112-45de-4647-a74f-651804d200ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:05.256896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac10112-45de-4647-a74f-651804d200ba service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:05.274824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1093/2223] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:48:05.277232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ad41-f34b-4659-bff0-2981337023f3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:05.278503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ad41-f34b-4659-bff0-2981337023f3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:05.278503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ad41-f34b-4659-bff0-2981337023f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:05.311416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f7f0ad41-f34b-4659-bff0-2981337023f3 None None] MFA Rules not processed for user `275bbf3d484d4f04a4e7f150074ce305`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:05.313389 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f7f0ad41-f34b-4659-bff0-2981337023f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:05.392807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1094/2224] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:05.394008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0ad41-f34b-4659-bff0-2981337023f3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:05.396891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f7f0ad41-f34b-4659-bff0-2981337023f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:05.430990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0ad41-f34b-4659-bff0-2981337023f3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:05.452631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:05.453554 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:05.453846 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:05.454133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] PATH_INFO: `/v3/users/29810922b91b4ba0a3515526586f3393` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:05.455953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29810922b91b4ba0a3515526586f3393)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:05.458384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:05.461293 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eed8b40a-bd7f-4198-8b16-cd3d27ca68ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97747e68ec04579bb0bed66b2729460'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:05.483608 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eed8b40a-bd7f-4198-8b16-cd3d27ca68ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97747e68ec04579bb0bed66b2729460'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:05.589132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eed8b40a-bd7f-4198-8b16-cd3d27ca68ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97747e68ec04579bb0bed66b2729460'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:05.590333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eed8b40a-bd7f-4198-8b16-cd3d27ca68ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97747e68ec04579bb0bed66b2729460'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:05.591295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eed8b40a-bd7f-4198-8b16-cd3d27ca68ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97747e68ec04579bb0bed66b2729460'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:05.613455 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1131/2225] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:04 2022] DELETE /identity/v3/users/f97747e68ec04579bb0bed66b2729460 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:05.784047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:05.885607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29810922b91b4ba0a3515526586f3393'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:05.886869 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29810922b91b4ba0a3515526586f3393'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:05.909549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29810922b91b4ba0a3515526586f3393'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:05.925642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29810922b91b4ba0a3515526586f3393'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:05.927140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29810922b91b4ba0a3515526586f3393'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:06.094738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:06.104221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1095/2226] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:05 2022] DELETE /identity/v3/users/29810922b91b4ba0a3515526586f3393 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:06.114123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c8569-6ae2-46e2-b87b-b830ed84e804 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:06.114123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c8569-6ae2-46e2-b87b-b830ed84e804 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:06.114123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c8569-6ae2-46e2-b87b-b830ed84e804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:06.168822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-708c8569-6ae2-46e2-b87b-b830ed84e804 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:06.171086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-708c8569-6ae2-46e2-b87b-b830ed84e804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:06.297953 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1132/2227] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:06.307841 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:06.309531 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:06.386292 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352ac84-0aad-4396-8dc3-b42e3d5e3876 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:06.390958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0c6bc-3eed-4ad4-a058-3a8e823e366c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:06.391581 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0c6bc-3eed-4ad4-a058-3a8e823e366c service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:06.391895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0c6bc-3eed-4ad4-a058-3a8e823e366c service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:06.392162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0c6bc-3eed-4ad4-a058-3a8e823e366c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:06.402997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0c6bc-3eed-4ad4-a058-3a8e823e366c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:06.404603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0c6bc-3eed-4ad4-a058-3a8e823e366c service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:06.415938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1096/2228] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:48:06.534491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c8569-6ae2-46e2-b87b-b830ed84e804 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:06.537614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-708c8569-6ae2-46e2-b87b-b830ed84e804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:06.563662 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c8569-6ae2-46e2-b87b-b830ed84e804 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:06.573863 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:06.574558 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:06.575519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:06.576050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] PATH_INFO: `/v3/projects/922b747259654fbfaa2009d7b33e8a10` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:06.577477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922b747259654fbfaa2009d7b33e8a10)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:06.579703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:06.749547 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922b747259654fbfaa2009d7b33e8a10', 'request_id': 'req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:06.770764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922b747259654fbfaa2009d7b33e8a10', 'request_id': 'req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:06.880822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922b747259654fbfaa2009d7b33e8a10', 'request_id': 'req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:06.897241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] The token cache is being invalidate because project 922b747259654fbfaa2009d7b33e8a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:06.897949 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:06.899075 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:06.906740 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0c6bc-3eed-4ad4-a058-3a8e823e366c service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:06.913810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1133/2229] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:06 2022] DELETE /identity/v3/projects/922b747259654fbfaa2009d7b33e8a10 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:06.926092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0c6bc-3eed-4ad4-a058-3a8e823e366c service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:07.030417 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39c94f-e801-4352-bc58-2726962aabf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:07.031206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39c94f-e801-4352-bc58-2726962aabf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:07.031495 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39c94f-e801-4352-bc58-2726962aabf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:07.031922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39c94f-e801-4352-bc58-2726962aabf6 admin admin] PATH_INFO: `/v3/users/454cbf2aab9e42f5b905a08da6c972b5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:07.033111 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39c94f-e801-4352-bc58-2726962aabf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=454cbf2aab9e42f5b905a08da6c972b5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:07.036722 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39c94f-e801-4352-bc58-2726962aabf6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:07.124610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:07.126421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:07.145557 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f6b99-dafe-424e-86b1-90b86a6ab2d7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:07.151600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcf975-2d42-490d-9e47-75ab607311c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:07.152667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcf975-2d42-490d-9e47-75ab607311c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:07.153147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcf975-2d42-490d-9e47-75ab607311c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:07.153780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcf975-2d42-490d-9e47-75ab607311c8 admin admin] PATH_INFO: `/v3/projects/4cacd46a6af7456392cfb6f32437155a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:07.155784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcf975-2d42-490d-9e47-75ab607311c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cacd46a6af7456392cfb6f32437155a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:07.160259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcf975-2d42-490d-9e47-75ab607311c8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:07.475754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c8bcf975-2d42-490d-9e47-75ab607311c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cacd46a6af7456392cfb6f32437155a', 'request_id': 'req-c8bcf975-2d42-490d-9e47-75ab607311c8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:07.478256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-df39c94f-e801-4352-bc58-2726962aabf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454cbf2aab9e42f5b905a08da6c972b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:07.481379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-df39c94f-e801-4352-bc58-2726962aabf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454cbf2aab9e42f5b905a08da6c972b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:07.489471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c8bcf975-2d42-490d-9e47-75ab607311c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cacd46a6af7456392cfb6f32437155a', 'request_id': 'req-c8bcf975-2d42-490d-9e47-75ab607311c8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:07.513261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-df39c94f-e801-4352-bc58-2726962aabf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454cbf2aab9e42f5b905a08da6c972b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:07.525432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-df39c94f-e801-4352-bc58-2726962aabf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454cbf2aab9e42f5b905a08da6c972b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:07.527322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-df39c94f-e801-4352-bc58-2726962aabf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454cbf2aab9e42f5b905a08da6c972b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:07.577617 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c8bcf975-2d42-490d-9e47-75ab607311c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cacd46a6af7456392cfb6f32437155a', 'request_id': 'req-c8bcf975-2d42-490d-9e47-75ab607311c8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:07.592048 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c8bcf975-2d42-490d-9e47-75ab607311c8 admin admin] The token cache is being invalidate because project 4cacd46a6af7456392cfb6f32437155a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:07.592320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c8bcf975-2d42-490d-9e47-75ab607311c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:07.593123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c8bcf975-2d42-490d-9e47-75ab607311c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:07.595116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1134/2230] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:07 2022] DELETE /identity/v3/projects/4cacd46a6af7456392cfb6f32437155a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:48:07.602683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91be2-b088-41af-8ef9-7cedfb342681 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:07.602683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91be2-b088-41af-8ef9-7cedfb342681 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:07.602683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91be2-b088-41af-8ef9-7cedfb342681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:07.632667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e8b91be2-b088-41af-8ef9-7cedfb342681 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:07.634238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e8b91be2-b088-41af-8ef9-7cedfb342681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:07.728649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1097/2231] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:06 2022] DELETE /identity/v3/users/454cbf2aab9e42f5b905a08da6c972b5 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:07.763427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1135/2232] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:48:07.781459 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3794d2-48b0-49ec-816c-c6c260833e29 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:07.781459 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3794d2-48b0-49ec-816c-c6c260833e29 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:07.781459 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3794d2-48b0-49ec-816c-c6c260833e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:07.815346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cd3794d2-48b0-49ec-816c-c6c260833e29 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:07.816954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cd3794d2-48b0-49ec-816c-c6c260833e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:07.860297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91be2-b088-41af-8ef9-7cedfb342681 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:07.863968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e8b91be2-b088-41af-8ef9-7cedfb342681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:08.042391 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:08.081328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91be2-b088-41af-8ef9-7cedfb342681 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:08.132806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1098/2233] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:48:08.139535 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3794d2-48b0-49ec-816c-c6c260833e29 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:08.164641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3794d2-48b0-49ec-816c-c6c260833e29 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:08.172146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55930fdb-4627-48ff-9ebd-3ffe7f9414b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:08.173794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930fdb-4627-48ff-9ebd-3ffe7f9414b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:08.174238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930fdb-4627-48ff-9ebd-3ffe7f9414b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:08.174588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930fdb-4627-48ff-9ebd-3ffe7f9414b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:08.175414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55930fdb-4627-48ff-9ebd-3ffe7f9414b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:48:08.175908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55930fdb-4627-48ff-9ebd-3ffe7f9414b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:08.178778 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55930fdb-4627-48ff-9ebd-3ffe7f9414b3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:08.199779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1099/2234] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:48:08.214090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55930fdb-4627-48ff-9ebd-3ffe7f9414b3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:08.254029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55930fdb-4627-48ff-9ebd-3ffe7f9414b3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:08.285628 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a969853-c10c-42a6-abcf-b45fbf47d3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:08.286790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a969853-c10c-42a6-abcf-b45fbf47d3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:08.287276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a969853-c10c-42a6-abcf-b45fbf47d3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:08.288731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a969853-c10c-42a6-abcf-b45fbf47d3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:08.291332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a969853-c10c-42a6-abcf-b45fbf47d3b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:08.301039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a969853-c10c-42a6-abcf-b45fbf47d3b0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:08.309368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddce41-0c9e-4fd2-9f36-7b7bac51e05b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebfb233b2504463a4ee9202b5a3ab50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:08.311200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddce41-0c9e-4fd2-9f36-7b7bac51e05b service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:08.311622 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddce41-0c9e-4fd2-9f36-7b7bac51e05b service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:08.312087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddce41-0c9e-4fd2-9f36-7b7bac51e05b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:08.316576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-83ddce41-0c9e-4fd2-9f36-7b7bac51e05b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:08.341288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddce41-0c9e-4fd2-9f36-7b7bac51e05b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:08.354319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddce41-0c9e-4fd2-9f36-7b7bac51e05b service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:08.376623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1136/2235] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:08.378798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff40eb-ec2c-406d-96e1-9dd9cb2877b8 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:08.379380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff40eb-ec2c-406d-96e1-9dd9cb2877b8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:08.379825 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff40eb-ec2c-406d-96e1-9dd9cb2877b8 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:08.391909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1137/2236] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:48:08 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:48:08.393988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f321d7-6c5b-463e-9b48-3424836946d9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:08.394508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f321d7-6c5b-463e-9b48-3424836946d9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:08.394829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f321d7-6c5b-463e-9b48-3424836946d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:08.468474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1100/2237] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:48:08 2022] POST /identity/v3/projects => generated 375 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:48:08.475118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a969853-c10c-42a6-abcf-b45fbf47d3b0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:08.491078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-27f321d7-6c5b-463e-9b48-3424836946d9 None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:08.498038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-27f321d7-6c5b-463e-9b48-3424836946d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:08.631225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a969853-c10c-42a6-abcf-b45fbf47d3b0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:08.641987 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d652487-f229-45e5-a357-30b5a1bb379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:08.642585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1138/2238] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:48:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:08.643294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d652487-f229-45e5-a357-30b5a1bb379a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:08.643294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d652487-f229-45e5-a357-30b5a1bb379a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:08.648309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d652487-f229-45e5-a357-30b5a1bb379a admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:08.648309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d652487-f229-45e5-a357-30b5a1bb379a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:08.662101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f321d7-6c5b-463e-9b48-3424836946d9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:08.663606 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-27f321d7-6c5b-463e-9b48-3424836946d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:08.667779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d652487-f229-45e5-a357-30b5a1bb379a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:08.833376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:08.835088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1101/2239] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:48:08 2022] POST /identity/v3/users => generated 288 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:48:08.835961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f321d7-6c5b-463e-9b48-3424836946d9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:08.836803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d652487-f229-45e5-a357-30b5a1bb379a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:08.846976 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d143a-ce05-44b2-b0c5-05b7a9b78fd6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75138f08ea2b4813b095635d920599d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:08.847376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8d652487-f229-45e5-a357-30b5a1bb379a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:08.848723 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d143a-ce05-44b2-b0c5-05b7a9b78fd6 service glance] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:08.850314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d143a-ce05-44b2-b0c5-05b7a9b78fd6 service glance] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:08.850788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d143a-ce05-44b2-b0c5-05b7a9b78fd6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:08.872875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d143a-ce05-44b2-b0c5-05b7a9b78fd6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:08.876536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d143a-ce05-44b2-b0c5-05b7a9b78fd6 service glance] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:08.880437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d652487-f229-45e5-a357-30b5a1bb379a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:08.908184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25249a7-5d0f-4f18-ba31-423247ea4c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:08.909260 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25249a7-5d0f-4f18-ba31-423247ea4c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:08.910141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25249a7-5d0f-4f18-ba31-423247ea4c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:08.910889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25249a7-5d0f-4f18-ba31-423247ea4c85 admin admin] PATH_INFO: `/v3/projects/6781430fc3e249c8a662cf5993b6ff2d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:08.912605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25249a7-5d0f-4f18-ba31-423247ea4c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6781430fc3e249c8a662cf5993b6ff2d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:08.916393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25249a7-5d0f-4f18-ba31-423247ea4c85 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:08.920792 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1139/2240] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:48:08.921988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d143a-ce05-44b2-b0c5-05b7a9b78fd6 service glance] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:08.966664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:08.973622 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d143a-ce05-44b2-b0c5-05b7a9b78fd6 service glance] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:08.983212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb634852-e322-43e6-9273-e11bb4fe3aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:08.984456 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb634852-e322-43e6-9273-e11bb4fe3aac admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:08.985132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb634852-e322-43e6-9273-e11bb4fe3aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:08.985674 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb634852-e322-43e6-9273-e11bb4fe3aac admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:08.986947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb634852-e322-43e6-9273-e11bb4fe3aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:08.990367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb634852-e322-43e6-9273-e11bb4fe3aac admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:09.009907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1140/2241] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:48:09.017901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb634852-e322-43e6-9273-e11bb4fe3aac admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:09.034466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb634852-e322-43e6-9273-e11bb4fe3aac admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:09.041624 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf46dbc-42e0-4d7b-9d44-ae69ea9358cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:09.043908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf46dbc-42e0-4d7b-9d44-ae69ea9358cf admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:09.044390 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf46dbc-42e0-4d7b-9d44-ae69ea9358cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:09.044823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf46dbc-42e0-4d7b-9d44-ae69ea9358cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:09.045711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf46dbc-42e0-4d7b-9d44-ae69ea9358cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:09.047262 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf46dbc-42e0-4d7b-9d44-ae69ea9358cf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:09.060134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1141/2242] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:48:09.066430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf46dbc-42e0-4d7b-9d44-ae69ea9358cf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:09.093035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf46dbc-42e0-4d7b-9d44-ae69ea9358cf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:09.114421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a25249a7-5d0f-4f18-ba31-423247ea4c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6781430fc3e249c8a662cf5993b6ff2d', 'request_id': 'req-a25249a7-5d0f-4f18-ba31-423247ea4c85'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:09.124526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a25249a7-5d0f-4f18-ba31-423247ea4c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6781430fc3e249c8a662cf5993b6ff2d', 'request_id': 'req-a25249a7-5d0f-4f18-ba31-423247ea4c85'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:09.196232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a589d-478f-4613-8e4f-fcf196b61f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:09.197562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a589d-478f-4613-8e4f-fcf196b61f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:09.198066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a589d-478f-4613-8e4f-fcf196b61f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:09.199094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a589d-478f-4613-8e4f-fcf196b61f69 admin admin] PATH_INFO: `/v3/projects/bb9aa58f8b6a45f3944a8759d883cf98/users/99e8e99046c34765bb650abae54df98a/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:09.227431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a589d-478f-4613-8e4f-fcf196b61f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9aa58f8b6a45f3944a8759d883cf98, user_id=99e8e99046c34765bb650abae54df98a, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:09.231983 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a589d-478f-4613-8e4f-fcf196b61f69 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:09.418695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a25249a7-5d0f-4f18-ba31-423247ea4c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6781430fc3e249c8a662cf5993b6ff2d', 'request_id': 'req-a25249a7-5d0f-4f18-ba31-423247ea4c85'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:09.433573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a25249a7-5d0f-4f18-ba31-423247ea4c85 admin admin] The token cache is being invalidate because project 6781430fc3e249c8a662cf5993b6ff2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:09.433998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a25249a7-5d0f-4f18-ba31-423247ea4c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:09.434955 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a25249a7-5d0f-4f18-ba31-423247ea4c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:09.436738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1102/2243] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:08 2022] DELETE /identity/v3/projects/6781430fc3e249c8a662cf5993b6ff2d => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:09.456885 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a7352-a4b3-4fbc-a82e-af026befa1df None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:09.457199 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1142/2244] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:48:09 2022] PUT /identity/v3/projects/bb9aa58f8b6a45f3944a8759d883cf98/users/99e8e99046c34765bb650abae54df98a/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:09.457330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a7352-a4b3-4fbc-a82e-af026befa1df None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:09.457529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a7352-a4b3-4fbc-a82e-af026befa1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:09.458641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bf52c-6394-4f82-80c9-40725eba4196 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:09.458933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bf52c-6394-4f82-80c9-40725eba4196 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:09.459206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bf52c-6394-4f82-80c9-40725eba4196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:09.487012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cb0a7352-a4b3-4fbc-a82e-af026befa1df None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:09.488399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cb0a7352-a4b3-4fbc-a82e-af026befa1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:09.503134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-935bf52c-6394-4f82-80c9-40725eba4196 None None] MFA Rules not processed for user `99e8e99046c34765bb650abae54df98a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:09.505141 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-935bf52c-6394-4f82-80c9-40725eba4196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:09.607861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1103/2245] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:09.607861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee243-00a0-47ff-8c2c-4265789c3e47 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:09.607861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee243-00a0-47ff-8c2c-4265789c3e47 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:09.607861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee243-00a0-47ff-8c2c-4265789c3e47 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:09.609672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1104/2246] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:48:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:48:09.612138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add9b63-8c1e-470a-8a29-59de18929b16 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:09.612850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add9b63-8c1e-470a-8a29-59de18929b16 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:09.613786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add9b63-8c1e-470a-8a29-59de18929b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:09.618308 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1143/2247] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:09.620267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c152b8b-071a-461e-acae-326d1370df94 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:09.620743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c152b8b-071a-461e-acae-326d1370df94 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:09.621196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c152b8b-071a-461e-acae-326d1370df94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:09.657222 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6c152b8b-071a-461e-acae-326d1370df94 None None] MFA Rules not processed for user `8956453f963242a087d2f90d70ed8f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:09.659141 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6c152b8b-071a-461e-acae-326d1370df94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:09.668973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0add9b63-8c1e-470a-8a29-59de18929b16 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:09.672308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0add9b63-8c1e-470a-8a29-59de18929b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:09.703744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1105/2248] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:09.703744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add9b63-8c1e-470a-8a29-59de18929b16 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:09.703744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0add9b63-8c1e-470a-8a29-59de18929b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:09.760821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1144/2249] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:48:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:09.762298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c152b8b-071a-461e-acae-326d1370df94 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:09.780796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c152b8b-071a-461e-acae-326d1370df94 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:09.786128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce06ea-5e05-4d98-9ee1-510326ec994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:09.786755 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce06ea-5e05-4d98-9ee1-510326ec994d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:09.787044 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce06ea-5e05-4d98-9ee1-510326ec994d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:09.787466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce06ea-5e05-4d98-9ee1-510326ec994d admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:09.789079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce06ea-5e05-4d98-9ee1-510326ec994d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:48:09.789835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce06ea-5e05-4d98-9ee1-510326ec994d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:09.793875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce06ea-5e05-4d98-9ee1-510326ec994d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:09.820123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add9b63-8c1e-470a-8a29-59de18929b16 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:09.826035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1145/2250] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:48:09.827860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bd29e-f3a3-49a3-b1c1-e1c4de07f499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:09.828632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce06ea-5e05-4d98-9ee1-510326ec994d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:09.828953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bd29e-f3a3-49a3-b1c1-e1c4de07f499 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:09.829510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bd29e-f3a3-49a3-b1c1-e1c4de07f499 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:09.830870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bd29e-f3a3-49a3-b1c1-e1c4de07f499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:09.831877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-58ce06ea-5e05-4d98-9ee1-510326ec994d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:09.844450 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bd29e-f3a3-49a3-b1c1-e1c4de07f499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:09.846584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bd29e-f3a3-49a3-b1c1-e1c4de07f499 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:09.848765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce06ea-5e05-4d98-9ee1-510326ec994d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:09.853480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a65dd-5d36-4aa4-b432-e8d8acf326f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:09.854331 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a65dd-5d36-4aa4-b432-e8d8acf326f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:09.855905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a65dd-5d36-4aa4-b432-e8d8acf326f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:09.855905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a65dd-5d36-4aa4-b432-e8d8acf326f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:09.862927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1106/2251] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:09.864422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bd29e-f3a3-49a3-b1c1-e1c4de07f499 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:09.865875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a65dd-5d36-4aa4-b432-e8d8acf326f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:09.868094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a65dd-5d36-4aa4-b432-e8d8acf326f5 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:09.882896 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1146/2252] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:09.891293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bd29e-f3a3-49a3-b1c1-e1c4de07f499 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:09.896848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2dcda-0dbf-438d-9e7f-42e781e46e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:09.897526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2dcda-0dbf-438d-9e7f-42e781e46e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:09.897803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2dcda-0dbf-438d-9e7f-42e781e46e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:09.898073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2dcda-0dbf-438d-9e7f-42e781e46e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:09.898711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2dcda-0dbf-438d-9e7f-42e781e46e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:09.901106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2dcda-0dbf-438d-9e7f-42e781e46e85 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:10.038990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaec7f-11dd-43c2-84f2-0522707a8b14 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:10.039906 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaec7f-11dd-43c2-84f2-0522707a8b14 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:10.040612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaec7f-11dd-43c2-84f2-0522707a8b14 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:10.043920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1147/2253] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:48:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:48:10.049690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1107/2254] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:48:09 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:48:10.055367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaec7f-11dd-43c2-84f2-0522707a8b14 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:10.077724 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449d3d5-df8f-4da2-9fa2-b48be0204ef6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:10.078155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449d3d5-df8f-4da2-9fa2-b48be0204ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:10.078594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449d3d5-df8f-4da2-9fa2-b48be0204ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:10.135120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9449d3d5-df8f-4da2-9fa2-b48be0204ef6 None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:10.139401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9449d3d5-df8f-4da2-9fa2-b48be0204ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:10.264425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaec7f-11dd-43c2-84f2-0522707a8b14 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:10.273612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27936ec8-599a-4964-b084-3bf07f8ee746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:10.276130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27936ec8-599a-4964-b084-3bf07f8ee746 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:10.276130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27936ec8-599a-4964-b084-3bf07f8ee746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:10.276130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27936ec8-599a-4964-b084-3bf07f8ee746 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:10.278725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27936ec8-599a-4964-b084-3bf07f8ee746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:10.282744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27936ec8-599a-4964-b084-3bf07f8ee746 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:10.299420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1108/2255] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:48:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:10.314932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449d3d5-df8f-4da2-9fa2-b48be0204ef6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:10.400989 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449d3d5-df8f-4da2-9fa2-b48be0204ef6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:10.406825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed2333-2b61-411f-a26a-7a24c9f59f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:10.407943 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed2333-2b61-411f-a26a-7a24c9f59f03 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:10.408418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed2333-2b61-411f-a26a-7a24c9f59f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:10.408882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed2333-2b61-411f-a26a-7a24c9f59f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:10.426569 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed2333-2b61-411f-a26a-7a24c9f59f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:10.429258 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed2333-2b61-411f-a26a-7a24c9f59f03 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:10.444930 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1109/2256] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:48:10.473728 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1148/2257] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:48:10 2022] POST /identity/v3/users => generated 285 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:48:10.480259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed2333-2b61-411f-a26a-7a24c9f59f03 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:10.502198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed2333-2b61-411f-a26a-7a24c9f59f03 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:10.517514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f3617-252e-4161-859f-827c2a0b6ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:10.518564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f3617-252e-4161-859f-827c2a0b6ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:10.519153 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f3617-252e-4161-859f-827c2a0b6ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:10.519744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f3617-252e-4161-859f-827c2a0b6ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:10.520870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f3617-252e-4161-859f-827c2a0b6ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:10.524613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f3617-252e-4161-859f-827c2a0b6ee7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:10.547572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1110/2258] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:48:10.559288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27936ec8-599a-4964-b084-3bf07f8ee746 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:10.573009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27936ec8-599a-4964-b084-3bf07f8ee746 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:10.579915 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17f35f-15f7-428a-89e4-313176f00d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:10.580770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17f35f-15f7-428a-89e4-313176f00d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:10.581314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17f35f-15f7-428a-89e4-313176f00d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:10.581751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17f35f-15f7-428a-89e4-313176f00d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:10.582678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17f35f-15f7-428a-89e4-313176f00d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:10.585081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17f35f-15f7-428a-89e4-313176f00d44 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:10.608890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1149/2259] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:48:10.613651 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f3617-252e-4161-859f-827c2a0b6ee7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:10.629512 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f3617-252e-4161-859f-827c2a0b6ee7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:10.635818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dd650-6dfd-47c0-bccb-893ad1e6908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:10.637490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd650-6dfd-47c0-bccb-893ad1e6908e admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:10.637893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd650-6dfd-47c0-bccb-893ad1e6908e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:10.638360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd650-6dfd-47c0-bccb-893ad1e6908e admin admin] PATH_INFO: `/v3/projects/c19523ec9f6b4602a98ec5d846487d49/users/f6437411fcc641f89ce3d561f08ef0c1/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:10.713192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20dd650-6dfd-47c0-bccb-893ad1e6908e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19523ec9f6b4602a98ec5d846487d49, user_id=f6437411fcc641f89ce3d561f08ef0c1, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:10.717211 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20dd650-6dfd-47c0-bccb-893ad1e6908e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:10.888338 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1111/2260] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:48:10 2022] PUT /identity/v3/projects/c19523ec9f6b4602a98ec5d846487d49/users/f6437411fcc641f89ce3d561f08ef0c1/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:10.909340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65015839-5c71-4f08-b930-172aea87e438 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:10.910271 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65015839-5c71-4f08-b930-172aea87e438 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:10.910786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65015839-5c71-4f08-b930-172aea87e438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:10.954246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:10.987744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-65015839-5c71-4f08-b930-172aea87e438 None None] MFA Rules not processed for user `f6437411fcc641f89ce3d561f08ef0c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:10.989103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-65015839-5c71-4f08-b930-172aea87e438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:11.149103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1150/2261] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:11.165556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dd650-6dfd-47c0-bccb-893ad1e6908e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:11.174887 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d20dd650-6dfd-47c0-bccb-893ad1e6908e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:11.477002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dd650-6dfd-47c0-bccb-893ad1e6908e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:11.497809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72673d9d-d7f0-4b70-b149-152a98f9211e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75138f08ea2b4813b095635d920599d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:11.497809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72673d9d-d7f0-4b70-b149-152a98f9211e service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:11.497809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72673d9d-d7f0-4b70-b149-152a98f9211e service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:11.497809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72673d9d-d7f0-4b70-b149-152a98f9211e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:11.544850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72673d9d-d7f0-4b70-b149-152a98f9211e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:11.547690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72673d9d-d7f0-4b70-b149-152a98f9211e service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:11.581524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1112/2262] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:12.480137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:13.177958 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:14.596358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:16.659281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:17.709237 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65015839-5c71-4f08-b930-172aea87e438 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:17.711398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-65015839-5c71-4f08-b930-172aea87e438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:17.877964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65015839-5c71-4f08-b930-172aea87e438 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:17.891451 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c58cc-11a2-4f69-a75c-4f84a77f0fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:17.892070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c58cc-11a2-4f69-a75c-4f84a77f0fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:17.892350 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c58cc-11a2-4f69-a75c-4f84a77f0fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:17.893413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c58cc-11a2-4f69-a75c-4f84a77f0fbd admin admin] PATH_INFO: `/v3/users/e3373afe040d41329497f21e9097cd2c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:17.894630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c58cc-11a2-4f69-a75c-4f84a77f0fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3373afe040d41329497f21e9097cd2c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:17.897519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c58cc-11a2-4f69-a75c-4f84a77f0fbd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:18.203643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f85c58cc-11a2-4f69-a75c-4f84a77f0fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3373afe040d41329497f21e9097cd2c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.231749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f85c58cc-11a2-4f69-a75c-4f84a77f0fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3373afe040d41329497f21e9097cd2c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.341104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f85c58cc-11a2-4f69-a75c-4f84a77f0fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3373afe040d41329497f21e9097cd2c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.343553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f85c58cc-11a2-4f69-a75c-4f84a77f0fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3373afe040d41329497f21e9097cd2c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.345169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f85c58cc-11a2-4f69-a75c-4f84a77f0fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3373afe040d41329497f21e9097cd2c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.367699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:18.383698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1151/2263] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:17 2022] DELETE /identity/v3/users/e3373afe040d41329497f21e9097cd2c => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:18.384846 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf345a39-a56a-463d-ad38-369d25ac738c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:18.385121 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf345a39-a56a-463d-ad38-369d25ac738c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:18.386008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf345a39-a56a-463d-ad38-369d25ac738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:18.440506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cf345a39-a56a-463d-ad38-369d25ac738c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:18.442241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cf345a39-a56a-463d-ad38-369d25ac738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:18.555351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df729be-c2c4-43ba-b59f-f3f95f3089d4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:18.555351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df729be-c2c4-43ba-b59f-f3f95f3089d4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:18.555351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df729be-c2c4-43ba-b59f-f3f95f3089d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:18.589103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1113/2264] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:18.598298 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8df729be-c2c4-43ba-b59f-f3f95f3089d4 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:18.599596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8df729be-c2c4-43ba-b59f-f3f95f3089d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:18.630775 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf345a39-a56a-463d-ad38-369d25ac738c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:18.636828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cf345a39-a56a-463d-ad38-369d25ac738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:18.766440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1152/2265] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:48:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:18.799435 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df729be-c2c4-43ba-b59f-f3f95f3089d4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:18.801872 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8df729be-c2c4-43ba-b59f-f3f95f3089d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:18.877011 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf345a39-a56a-463d-ad38-369d25ac738c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:18.884827 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0716ba-2faa-411c-b281-11ad69b344a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:18.886349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0716ba-2faa-411c-b281-11ad69b344a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:18.886876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0716ba-2faa-411c-b281-11ad69b344a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:18.887619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0716ba-2faa-411c-b281-11ad69b344a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:18.904798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0716ba-2faa-411c-b281-11ad69b344a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:18.908363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0716ba-2faa-411c-b281-11ad69b344a0 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:18.936164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1114/2266] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:19.015120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df729be-c2c4-43ba-b59f-f3f95f3089d4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:19.025786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae522b6-e37d-45dd-ad40-27c01c88b2c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:19.027943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae522b6-e37d-45dd-ad40-27c01c88b2c4 service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:19.034431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae522b6-e37d-45dd-ad40-27c01c88b2c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:19.034431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae522b6-e37d-45dd-ad40-27c01c88b2c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:19.052360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae522b6-e37d-45dd-ad40-27c01c88b2c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:19.056377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae522b6-e37d-45dd-ad40-27c01c88b2c4 service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:19.094553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1153/2267] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:48:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 10:48:20.069959 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:20.570683 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0716ba-2faa-411c-b281-11ad69b344a0 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:20.572652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ad0716ba-2faa-411c-b281-11ad69b344a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:20.645559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0716ba-2faa-411c-b281-11ad69b344a0 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:20.666534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:20.667851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:20.669021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:20.669467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb admin admin] PATH_INFO: `/v3/projects/5547d382fd9b4d5c9cb465d036d037c1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:20.671706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5547d382fd9b4d5c9cb465d036d037c1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:20.676615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:20.940771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:20.966580 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5547d382fd9b4d5c9cb465d036d037c1', 'request_id': 'req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:20.984980 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5547d382fd9b4d5c9cb465d036d037c1', 'request_id': 'req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:21.080891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5547d382fd9b4d5c9cb465d036d037c1', 'request_id': 'req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:21.117375 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb admin admin] The token cache is being invalidate because project 5547d382fd9b4d5c9cb465d036d037c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:21.117723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:21.122491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b1d632b-da8d-4ab9-bb43-058b3e4bf4bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:21.168127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1115/2268] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:20 2022] DELETE /identity/v3/projects/5547d382fd9b4d5c9cb465d036d037c1 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:23.395543 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:23.537748 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:26.506896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:27.815788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:29.040836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:30.882042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:31.191300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:32.898939 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae522b6-e37d-45dd-ad40-27c01c88b2c4 service swift] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:32.904045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:32.906785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3ae522b6-e37d-45dd-ad40-27c01c88b2c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:32.926757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae522b6-e37d-45dd-ad40-27c01c88b2c4 service swift] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:33.009644 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:33.010646 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:33.011037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:33.011359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] PATH_INFO: `/v3/users/99e8e99046c34765bb650abae54df98a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:33.012660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e8e99046c34765bb650abae54df98a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:33.014597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:33.057714 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:33.279017 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e8e99046c34765bb650abae54df98a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:33.303500 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e8e99046c34765bb650abae54df98a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:33.394551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e8e99046c34765bb650abae54df98a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:33.395322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e8e99046c34765bb650abae54df98a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:33.396139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e8e99046c34765bb650abae54df98a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:33.417824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1154/2269] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:32 2022] DELETE /identity/v3/users/99e8e99046c34765bb650abae54df98a => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:33.419565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9944-e962-4112-81e5-5e4de3820317 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:33.419844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9944-e962-4112-81e5-5e4de3820317 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:33.420114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9944-e962-4112-81e5-5e4de3820317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:33.443486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e31e9944-e962-4112-81e5-5e4de3820317 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:33.448977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e31e9944-e962-4112-81e5-5e4de3820317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:33.528199 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1116/2270] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:33.541750 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:33.546183 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:33.643875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d3c6b-2cfc-4b62-be8d-d714a463ac54 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:33.648769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26063cdf-b0b1-4f52-b8b2-1ff1b5fbc689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:33.649436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26063cdf-b0b1-4f52-b8b2-1ff1b5fbc689 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:33.649907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26063cdf-b0b1-4f52-b8b2-1ff1b5fbc689 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:33.650385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26063cdf-b0b1-4f52-b8b2-1ff1b5fbc689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:33.663144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26063cdf-b0b1-4f52-b8b2-1ff1b5fbc689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:33.664670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26063cdf-b0b1-4f52-b8b2-1ff1b5fbc689 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:33.676321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1155/2271] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:33.974453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:34.539348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e9944-e962-4112-81e5-5e4de3820317 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:34.540934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e31e9944-e962-4112-81e5-5e4de3820317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:34.561606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e9944-e962-4112-81e5-5e4de3820317 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:34.566420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1624412-e8e2-4d4b-9d01-33904f46d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:34.567063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1624412-e8e2-4d4b-9d01-33904f46d200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:34.567365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1624412-e8e2-4d4b-9d01-33904f46d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:34.567634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1624412-e8e2-4d4b-9d01-33904f46d200 admin admin] PATH_INFO: `/v3/projects/bb9aa58f8b6a45f3944a8759d883cf98` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:34.568836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1624412-e8e2-4d4b-9d01-33904f46d200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9aa58f8b6a45f3944a8759d883cf98)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:34.571651 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1624412-e8e2-4d4b-9d01-33904f46d200 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:34.805328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f1624412-e8e2-4d4b-9d01-33904f46d200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9aa58f8b6a45f3944a8759d883cf98', 'request_id': 'req-f1624412-e8e2-4d4b-9d01-33904f46d200'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:34.812801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f1624412-e8e2-4d4b-9d01-33904f46d200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9aa58f8b6a45f3944a8759d883cf98', 'request_id': 'req-f1624412-e8e2-4d4b-9d01-33904f46d200'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:34.903326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:34.937711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f1624412-e8e2-4d4b-9d01-33904f46d200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9aa58f8b6a45f3944a8759d883cf98', 'request_id': 'req-f1624412-e8e2-4d4b-9d01-33904f46d200'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:34.954251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f1624412-e8e2-4d4b-9d01-33904f46d200 admin admin] The token cache is being invalidate because project bb9aa58f8b6a45f3944a8759d883cf98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:34.954453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f1624412-e8e2-4d4b-9d01-33904f46d200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:34.955135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f1624412-e8e2-4d4b-9d01-33904f46d200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:34.956792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1117/2272] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:34 2022] DELETE /identity/v3/projects/bb9aa58f8b6a45f3944a8759d883cf98 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:34.962271 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b8852-aa39-4b72-a795-ea71deeb84f1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:34.962553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b8852-aa39-4b72-a795-ea71deeb84f1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:34.962831 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b8852-aa39-4b72-a795-ea71deeb84f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:34.985212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5a3b8852-aa39-4b72-a795-ea71deeb84f1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:34.986444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5a3b8852-aa39-4b72-a795-ea71deeb84f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:35.074589 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1156/2273] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:48:35.082674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7551f47-3bc4-434b-abd5-769175d7f6a8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:35.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7551f47-3bc4-434b-abd5-769175d7f6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:35.086282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7551f47-3bc4-434b-abd5-769175d7f6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:35.112925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e7551f47-3bc4-434b-abd5-769175d7f6a8 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:35.114430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e7551f47-3bc4-434b-abd5-769175d7f6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:35.125796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1118/2274] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:35.130895 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b8852-aa39-4b72-a795-ea71deeb84f1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:35.146292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b8852-aa39-4b72-a795-ea71deeb84f1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:35.154235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037c200-6c54-4595-b28c-496c91971f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:35.154981 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037c200-6c54-4595-b28c-496c91971f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:35.155268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037c200-6c54-4595-b28c-496c91971f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:35.155548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037c200-6c54-4595-b28c-496c91971f45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:35.156273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037c200-6c54-4595-b28c-496c91971f45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:48:35.156613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037c200-6c54-4595-b28c-496c91971f45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:35.158417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037c200-6c54-4595-b28c-496c91971f45 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:35.174471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1157/2275] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:48:35.184561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7551f47-3bc4-434b-abd5-769175d7f6a8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:35.203954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7551f47-3bc4-434b-abd5-769175d7f6a8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:35.222817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcaabe-8c83-4831-84be-7d32e024b4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:35.222817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcaabe-8c83-4831-84be-7d32e024b4ed admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:35.222817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcaabe-8c83-4831-84be-7d32e024b4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:35.222817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcaabe-8c83-4831-84be-7d32e024b4ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:35.223269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcaabe-8c83-4831-84be-7d32e024b4ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:35.224658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcaabe-8c83-4831-84be-7d32e024b4ed admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:35.416606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1119/2276] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:48:35 2022] POST /identity/v3/projects => generated 369 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:48:35.423421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037c200-6c54-4595-b28c-496c91971f45 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:35.446634 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037c200-6c54-4595-b28c-496c91971f45 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:35.520031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897b907-5058-4fbc-890d-4b8a1ad57cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:35.520718 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897b907-5058-4fbc-890d-4b8a1ad57cab admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:35.521039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897b907-5058-4fbc-890d-4b8a1ad57cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:35.521388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897b907-5058-4fbc-890d-4b8a1ad57cab admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:35.522180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897b907-5058-4fbc-890d-4b8a1ad57cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:35.524316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897b907-5058-4fbc-890d-4b8a1ad57cab admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:35.645891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1158/2277] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:48:35 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:48:35.651231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcaabe-8c83-4831-84be-7d32e024b4ed admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:35.661993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcaabe-8c83-4831-84be-7d32e024b4ed admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:35.667662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d6576-17e2-4c12-bb74-f6d55fbb6c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:35.668326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d6576-17e2-4c12-bb74-f6d55fbb6c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:35.668607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d6576-17e2-4c12-bb74-f6d55fbb6c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:35.668881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d6576-17e2-4c12-bb74-f6d55fbb6c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:35.669559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d6576-17e2-4c12-bb74-f6d55fbb6c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:35.671289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d6576-17e2-4c12-bb74-f6d55fbb6c17 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:35.683503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1120/2278] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:48:35.688009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897b907-5058-4fbc-890d-4b8a1ad57cab admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:35.700010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897b907-5058-4fbc-890d-4b8a1ad57cab admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:35.706128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee109a9-bb2e-4186-b38e-1130aba40718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:35.709697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee109a9-bb2e-4186-b38e-1130aba40718 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:35.709697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee109a9-bb2e-4186-b38e-1130aba40718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:35.709697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee109a9-bb2e-4186-b38e-1130aba40718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:35.709697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee109a9-bb2e-4186-b38e-1130aba40718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:35.709697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee109a9-bb2e-4186-b38e-1130aba40718 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:35.724467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1159/2279] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:48:35.730600 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d6576-17e2-4c12-bb74-f6d55fbb6c17 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:35.741198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d6576-17e2-4c12-bb74-f6d55fbb6c17 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:35.746520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747bbad-b041-45c6-b1e7-ac9b2eca62ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:35.747177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747bbad-b041-45c6-b1e7-ac9b2eca62ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:35.747455 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747bbad-b041-45c6-b1e7-ac9b2eca62ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:35.747752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747bbad-b041-45c6-b1e7-ac9b2eca62ff admin admin] PATH_INFO: `/v3/projects/2e83e231255f450191b5ec9b9b3b2b4b/users/d91b02360144424c97a5bf0ec4d80bca/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:35.765086 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747bbad-b041-45c6-b1e7-ac9b2eca62ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e83e231255f450191b5ec9b9b3b2b4b, user_id=d91b02360144424c97a5bf0ec4d80bca, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:35.767736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747bbad-b041-45c6-b1e7-ac9b2eca62ff admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:35.919707 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1121/2280] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:48:35 2022] PUT /identity/v3/projects/2e83e231255f450191b5ec9b9b3b2b4b/users/d91b02360144424c97a5bf0ec4d80bca/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:35.927170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbdbb9-0024-4d1d-a989-5bcb7e32afe1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:35.928024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbdbb9-0024-4d1d-a989-5bcb7e32afe1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:35.928024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbdbb9-0024-4d1d-a989-5bcb7e32afe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:35.969052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dafbdbb9-0024-4d1d-a989-5bcb7e32afe1 None None] MFA Rules not processed for user `d91b02360144424c97a5bf0ec4d80bca`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:35.970301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dafbdbb9-0024-4d1d-a989-5bcb7e32afe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:36.064994 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1160/2281] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:36.082257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747bbad-b041-45c6-b1e7-ac9b2eca62ff admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:36.086355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2747bbad-b041-45c6-b1e7-ac9b2eca62ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:36.168005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747bbad-b041-45c6-b1e7-ac9b2eca62ff admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:36.172421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e4a24-1900-43aa-8be1-bde85aa4d1cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:36.173154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e4a24-1900-43aa-8be1-bde85aa4d1cd service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:36.173455 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e4a24-1900-43aa-8be1-bde85aa4d1cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:36.173718 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e4a24-1900-43aa-8be1-bde85aa4d1cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:36.185584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e4a24-1900-43aa-8be1-bde85aa4d1cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:36.187449 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e4a24-1900-43aa-8be1-bde85aa4d1cd service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:36.200664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1122/2282] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:36.228604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbdbb9-0024-4d1d-a989-5bcb7e32afe1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:36.361818 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbdbb9-0024-4d1d-a989-5bcb7e32afe1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:36.371515 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:36.372630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:36.372876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:36.373226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] PATH_INFO: `/v3/users/d91b02360144424c97a5bf0ec4d80bca` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:36.374635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91b02360144424c97a5bf0ec4d80bca)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:36.377411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:36.675897 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91b02360144424c97a5bf0ec4d80bca'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:36.691859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91b02360144424c97a5bf0ec4d80bca'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:36.846251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91b02360144424c97a5bf0ec4d80bca'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:36.847524 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91b02360144424c97a5bf0ec4d80bca'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:36.850441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91b02360144424c97a5bf0ec4d80bca'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:36.869581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1161/2283] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:36 2022] DELETE /identity/v3/users/d91b02360144424c97a5bf0ec4d80bca => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:36.874565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0c815-bcb2-46ba-95c9-6da86daeaf5d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:36.875088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0c815-bcb2-46ba-95c9-6da86daeaf5d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:36.875088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0c815-bcb2-46ba-95c9-6da86daeaf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:36.897565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-67e0c815-bcb2-46ba-95c9-6da86daeaf5d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:36.899524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-67e0c815-bcb2-46ba-95c9-6da86daeaf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:36.988538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1123/2284] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:48:36.999333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:37.000841 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:37.002639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:37.086734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37d36-9823-4de9-afa5-315017c46462 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:37.094133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51740c5a-ad8e-40c2-b217-af5752bb3e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:37.095158 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740c5a-ad8e-40c2-b217-af5752bb3e19 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:37.096092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740c5a-ad8e-40c2-b217-af5752bb3e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:37.096605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740c5a-ad8e-40c2-b217-af5752bb3e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:37.117834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51740c5a-ad8e-40c2-b217-af5752bb3e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:37.120074 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51740c5a-ad8e-40c2-b217-af5752bb3e19 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:37.132182 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1162/2285] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:37.754041 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0c815-bcb2-46ba-95c9-6da86daeaf5d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:37.755557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-67e0c815-bcb2-46ba-95c9-6da86daeaf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:37.755974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:37.771487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0c815-bcb2-46ba-95c9-6da86daeaf5d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:37.779481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:37.780242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:37.780840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:37.781266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] PATH_INFO: `/v3/projects/2e83e231255f450191b5ec9b9b3b2b4b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:37.782593 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e83e231255f450191b5ec9b9b3b2b4b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:37.784831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:38.038196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e83e231255f450191b5ec9b9b3b2b4b', 'request_id': 'req-e019a5ec-85c4-4180-8460-5f4c257c58cb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:38.049304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e83e231255f450191b5ec9b9b3b2b4b', 'request_id': 'req-e019a5ec-85c4-4180-8460-5f4c257c58cb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:38.160490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e83e231255f450191b5ec9b9b3b2b4b', 'request_id': 'req-e019a5ec-85c4-4180-8460-5f4c257c58cb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:38.175255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] The token cache is being invalidate because project 2e83e231255f450191b5ec9b9b3b2b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:38.175546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:38.176326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:38.177902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1124/2286] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:37 2022] DELETE /identity/v3/projects/2e83e231255f450191b5ec9b9b3b2b4b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:39.373489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab111469-efde-4b7f-8d28-5e4ea9fec138 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:39.374786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab111469-efde-4b7f-8d28-5e4ea9fec138 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:39.375292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab111469-efde-4b7f-8d28-5e4ea9fec138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:39.402248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ab111469-efde-4b7f-8d28-5e4ea9fec138 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:39.404639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ab111469-efde-4b7f-8d28-5e4ea9fec138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:39.479777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1163/2287] 10.222.0.91 () {58 vars in 967 bytes} [Wed Aug 24 10:48:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:39.495837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:39.497850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:39.621405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019a5ec-85c4-4180-8460-5f4c257c58cb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:39.628422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc72139-5994-4981-9e3f-5998b755a7c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:39.629460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc72139-5994-4981-9e3f-5998b755a7c4 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:39.630407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc72139-5994-4981-9e3f-5998b755a7c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:39.630726 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc72139-5994-4981-9e3f-5998b755a7c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:39.645246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc72139-5994-4981-9e3f-5998b755a7c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:39.647028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc72139-5994-4981-9e3f-5998b755a7c4 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:39.659522 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1125/2288] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:48:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 10:48:40.109322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:40.847433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:41.837525 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab111469-efde-4b7f-8d28-5e4ea9fec138 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:41.840362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ab111469-efde-4b7f-8d28-5e4ea9fec138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:41.955109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b9d03-a8fc-45d6-aca9-2c821d5a90ce None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:41.955616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b9d03-a8fc-45d6-aca9-2c821d5a90ce None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:41.955891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b9d03-a8fc-45d6-aca9-2c821d5a90ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:41.965268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab111469-efde-4b7f-8d28-5e4ea9fec138 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:41.973878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:41.974933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:41.975662 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:41.976013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] PATH_INFO: `/v3/users/f6437411fcc641f89ce3d561f08ef0c1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:41.977302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6437411fcc641f89ce3d561f08ef0c1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:41.980031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:41.985400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-018b9d03-a8fc-45d6-aca9-2c821d5a90ce None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:41.987305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-018b9d03-a8fc-45d6-aca9-2c821d5a90ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:42.011075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1126/2289] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:48:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:42.021679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b9d03-a8fc-45d6-aca9-2c821d5a90ce None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:42.046401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b9d03-a8fc-45d6-aca9-2c821d5a90ce None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:42.056266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a73067-67e3-4719-9404-d010dadced36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:42.058293 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73067-67e3-4719-9404-d010dadced36 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:42.058880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73067-67e3-4719-9404-d010dadced36 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:42.059442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73067-67e3-4719-9404-d010dadced36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:42.073939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a73067-67e3-4719-9404-d010dadced36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:42.076079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a73067-67e3-4719-9404-d010dadced36 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:42.087596 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1127/2290] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:48:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:42.329916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6437411fcc641f89ce3d561f08ef0c1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:42.354979 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6437411fcc641f89ce3d561f08ef0c1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:42.465384 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6437411fcc641f89ce3d561f08ef0c1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:42.467770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6437411fcc641f89ce3d561f08ef0c1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:42.469342 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6437411fcc641f89ce3d561f08ef0c1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:42.514693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1164/2291] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:41 2022] DELETE /identity/v3/users/f6437411fcc641f89ce3d561f08ef0c1 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:42.529436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7799b-ec5a-454c-81a0-84fbcef4b8e0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:42.530867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7799b-ec5a-454c-81a0-84fbcef4b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:42.531610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7799b-ec5a-454c-81a0-84fbcef4b8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:42.571424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-79a7799b-ec5a-454c-81a0-84fbcef4b8e0 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:42.585140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-79a7799b-ec5a-454c-81a0-84fbcef4b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:42.709098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1128/2292] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:42.733379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:42.735890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:42.801181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:42.866028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:42.877946 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce164bba-9a39-4944-bf07-639659aa89a2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:42.881585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9e8db-662c-4312-83ee-e0ab66120907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:42.884267 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9e8db-662c-4312-83ee-e0ab66120907 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:42.886491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9e8db-662c-4312-83ee-e0ab66120907 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:42.888641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9e8db-662c-4312-83ee-e0ab66120907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:42.911028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9e8db-662c-4312-83ee-e0ab66120907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:42.914729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9e8db-662c-4312-83ee-e0ab66120907 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:42.937400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1165/2293] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:43.273807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7799b-ec5a-454c-81a0-84fbcef4b8e0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:43.279414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-79a7799b-ec5a-454c-81a0-84fbcef4b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:43.324003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7799b-ec5a-454c-81a0-84fbcef4b8e0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:43.336429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ed060-48b7-46c2-950b-f81d32840750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:43.338166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ed060-48b7-46c2-950b-f81d32840750 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:43.338453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ed060-48b7-46c2-950b-f81d32840750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:43.338776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ed060-48b7-46c2-950b-f81d32840750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:43.346177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6d1ed060-48b7-46c2-950b-f81d32840750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:43.508208 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ed060-48b7-46c2-950b-f81d32840750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:43.511009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ed060-48b7-46c2-950b-f81d32840750 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:43.534427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1129/2294] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:43.932183 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9e8db-662c-4312-83ee-e0ab66120907 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:43.940008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-76e9e8db-662c-4312-83ee-e0ab66120907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:43.996000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9e8db-662c-4312-83ee-e0ab66120907 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:44.012993 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:44.015269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:44.015269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:44.015269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] PATH_INFO: `/v3/projects/c19523ec9f6b4602a98ec5d846487d49` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:44.016136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c19523ec9f6b4602a98ec5d846487d49)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:44.018232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:44.332391 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c19523ec9f6b4602a98ec5d846487d49', 'request_id': 'req-8494063a-85db-4740-99eb-ca4896df6873'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:44.358365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c19523ec9f6b4602a98ec5d846487d49', 'request_id': 'req-8494063a-85db-4740-99eb-ca4896df6873'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:44.521102 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c19523ec9f6b4602a98ec5d846487d49', 'request_id': 'req-8494063a-85db-4740-99eb-ca4896df6873'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:44.552021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] The token cache is being invalidate because project c19523ec9f6b4602a98ec5d846487d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:44.552681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:44.553714 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:44.578433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1166/2295] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:43 2022] DELETE /identity/v3/projects/c19523ec9f6b4602a98ec5d846487d49 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:44.603802 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:44.742141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:45.543935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:46.201504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:46.599155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:47.007236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:47.565607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:48.185069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:48.248562 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:48.792673 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:48.965697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:49.515874 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:49.607273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:49.906822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:50.025304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:50.788676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:51.181613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:51.554446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:51.583775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:52.105453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:52.131618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:52.508947 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:52.743956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:52.942723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.075198 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.143665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.177601 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.269006 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.378125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.490077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.526218 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.630732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.658029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.808284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.842290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.994930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:54.052047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:54.422789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:03.989518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445313ec-2f95-4d63-8f51-42c958246545 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:03.990136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445313ec-2f95-4d63-8f51-42c958246545 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:03.990136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445313ec-2f95-4d63-8f51-42c958246545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:04.021576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-445313ec-2f95-4d63-8f51-42c958246545 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:04.023576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-445313ec-2f95-4d63-8f51-42c958246545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:04.113518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1130/2296] 10.222.0.91 () {58 vars in 967 bytes} [Wed Aug 24 10:49:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:04.129585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:04.131171 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:04.216665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494063a-85db-4740-99eb-ca4896df6873 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:04.222004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf3cd8-44e9-449b-9137-6d9ece288bef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:04.222708 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf3cd8-44e9-449b-9137-6d9ece288bef service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:04.223060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf3cd8-44e9-449b-9137-6d9ece288bef service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:04.223508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf3cd8-44e9-449b-9137-6d9ece288bef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:04.239004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf3cd8-44e9-449b-9137-6d9ece288bef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:04.240866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf3cd8-44e9-449b-9137-6d9ece288bef service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:04.253247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1167/2297] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:49:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:49:08.028946 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445313ec-2f95-4d63-8f51-42c958246545 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:08.030666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-445313ec-2f95-4d63-8f51-42c958246545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:08.113004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445313ec-2f95-4d63-8f51-42c958246545 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:08.118874 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94acf5-030d-4367-8864-62cdf81d5d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:08.119403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94acf5-030d-4367-8864-62cdf81d5d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:08.119931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94acf5-030d-4367-8864-62cdf81d5d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:08.120103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94acf5-030d-4367-8864-62cdf81d5d4d admin admin] PATH_INFO: `/v3/users/275bbf3d484d4f04a4e7f150074ce305` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:08.121328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94acf5-030d-4367-8864-62cdf81d5d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=275bbf3d484d4f04a4e7f150074ce305)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:08.123447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94acf5-030d-4367-8864-62cdf81d5d4d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:08.314230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac94acf5-030d-4367-8864-62cdf81d5d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275bbf3d484d4f04a4e7f150074ce305'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:08.315324 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac94acf5-030d-4367-8864-62cdf81d5d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275bbf3d484d4f04a4e7f150074ce305'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:08.333109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac94acf5-030d-4367-8864-62cdf81d5d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275bbf3d484d4f04a4e7f150074ce305'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:08.335462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:08.341685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac94acf5-030d-4367-8864-62cdf81d5d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275bbf3d484d4f04a4e7f150074ce305'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:08.347441 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac94acf5-030d-4367-8864-62cdf81d5d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275bbf3d484d4f04a4e7f150074ce305'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:08.411374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1131/2298] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:49:08 2022] DELETE /identity/v3/users/275bbf3d484d4f04a4e7f150074ce305 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:49:08.763107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf3cd8-44e9-449b-9137-6d9ece288bef service swift] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:08.780457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf3cd8-44e9-449b-9137-6d9ece288bef service swift] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:08.866273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f361d-9ba3-4e48-bcf5-f201af139b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:08.866869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f361d-9ba3-4e48-bcf5-f201af139b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:08.867154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f361d-9ba3-4e48-bcf5-f201af139b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:08.867425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f361d-9ba3-4e48-bcf5-f201af139b31 admin admin] PATH_INFO: `/v3/projects/359a4f374fbb42539a65b5dd0cc958b4` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:08.868929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f361d-9ba3-4e48-bcf5-f201af139b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=359a4f374fbb42539a65b5dd0cc958b4)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:08.870849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f361d-9ba3-4e48-bcf5-f201af139b31 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:09.018938 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:09.020712 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4e6f361d-9ba3-4e48-bcf5-f201af139b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359a4f374fbb42539a65b5dd0cc958b4', 'request_id': 'req-4e6f361d-9ba3-4e48-bcf5-f201af139b31'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:09.030611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4e6f361d-9ba3-4e48-bcf5-f201af139b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359a4f374fbb42539a65b5dd0cc958b4', 'request_id': 'req-4e6f361d-9ba3-4e48-bcf5-f201af139b31'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:09.163736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4e6f361d-9ba3-4e48-bcf5-f201af139b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359a4f374fbb42539a65b5dd0cc958b4', 'request_id': 'req-4e6f361d-9ba3-4e48-bcf5-f201af139b31'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:09.177545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4e6f361d-9ba3-4e48-bcf5-f201af139b31 admin admin] The token cache is being invalidate because project 359a4f374fbb42539a65b5dd0cc958b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:49:09.178953 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4e6f361d-9ba3-4e48-bcf5-f201af139b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:09.178953 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4e6f361d-9ba3-4e48-bcf5-f201af139b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:09.180144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1168/2299] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:49:08 2022] DELETE /identity/v3/projects/359a4f374fbb42539a65b5dd0cc958b4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:49:09.185948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87416706-bf54-439d-af18-aae9f978dd5b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:09.186993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87416706-bf54-439d-af18-aae9f978dd5b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:09.187613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87416706-bf54-439d-af18-aae9f978dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:09.210369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-87416706-bf54-439d-af18-aae9f978dd5b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:09.211793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-87416706-bf54-439d-af18-aae9f978dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:09.286818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1132/2300] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:09.298929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca79a92-8332-4960-8ad1-236e82f53f1d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:09.299468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca79a92-8332-4960-8ad1-236e82f53f1d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:09.299468 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca79a92-8332-4960-8ad1-236e82f53f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:09.322978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4ca79a92-8332-4960-8ad1-236e82f53f1d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:09.325786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4ca79a92-8332-4960-8ad1-236e82f53f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:09.338218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1169/2301] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:09.351978 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87416706-bf54-439d-af18-aae9f978dd5b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:09.364179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87416706-bf54-439d-af18-aae9f978dd5b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:09.370543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43766ac3-23ba-4fc9-b267-22cc76575e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:09.371174 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43766ac3-23ba-4fc9-b267-22cc76575e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:09.371522 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43766ac3-23ba-4fc9-b267-22cc76575e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:09.371929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43766ac3-23ba-4fc9-b267-22cc76575e92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:09.372657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43766ac3-23ba-4fc9-b267-22cc76575e92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:49:09.373038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43766ac3-23ba-4fc9-b267-22cc76575e92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:09.374787 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43766ac3-23ba-4fc9-b267-22cc76575e92 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:09.393046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1133/2302] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:49:09.399147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca79a92-8332-4960-8ad1-236e82f53f1d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:09.413769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca79a92-8332-4960-8ad1-236e82f53f1d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:09.420246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fe405-cd7b-48d6-b6d6-7c43f14b9216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:09.420880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fe405-cd7b-48d6-b6d6-7c43f14b9216 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:09.421163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fe405-cd7b-48d6-b6d6-7c43f14b9216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:09.421436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fe405-cd7b-48d6-b6d6-7c43f14b9216 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:09.422072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fe405-cd7b-48d6-b6d6-7c43f14b9216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:09.424026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fe405-cd7b-48d6-b6d6-7c43f14b9216 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:09.670550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1170/2303] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:49:09 2022] POST /identity/v3/projects => generated 369 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:49:09.675609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43766ac3-23ba-4fc9-b267-22cc76575e92 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:09.693920 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43766ac3-23ba-4fc9-b267-22cc76575e92 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:09.778225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f8fea-4b52-4fb2-9674-07fb5685c5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:09.778861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f8fea-4b52-4fb2-9674-07fb5685c5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:09.779143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f8fea-4b52-4fb2-9674-07fb5685c5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:09.779405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f8fea-4b52-4fb2-9674-07fb5685c5f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:09.780075 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f8fea-4b52-4fb2-9674-07fb5685c5f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:09.782065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f8fea-4b52-4fb2-9674-07fb5685c5f6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:09.888752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1134/2304] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:49:09 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:49:09.894485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fe405-cd7b-48d6-b6d6-7c43f14b9216 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:09.907744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fe405-cd7b-48d6-b6d6-7c43f14b9216 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:09.912825 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae54ce-ef53-4fad-9fa7-4dae5c3e7e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:09.913889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae54ce-ef53-4fad-9fa7-4dae5c3e7e5e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:09.913889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae54ce-ef53-4fad-9fa7-4dae5c3e7e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:09.914151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae54ce-ef53-4fad-9fa7-4dae5c3e7e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:09.914684 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae54ce-ef53-4fad-9fa7-4dae5c3e7e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:09.916758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae54ce-ef53-4fad-9fa7-4dae5c3e7e5e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:09.928623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1171/2305] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:49:09.934755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f8fea-4b52-4fb2-9674-07fb5685c5f6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:09.947503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f8fea-4b52-4fb2-9674-07fb5685c5f6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:09.952904 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594142c-362d-4fb3-8f33-1a6f8ec4dd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:09.953937 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594142c-362d-4fb3-8f33-1a6f8ec4dd1f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:09.954248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594142c-362d-4fb3-8f33-1a6f8ec4dd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:09.954524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594142c-362d-4fb3-8f33-1a6f8ec4dd1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:09.955233 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594142c-362d-4fb3-8f33-1a6f8ec4dd1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:09.956955 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594142c-362d-4fb3-8f33-1a6f8ec4dd1f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:09.971621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1135/2306] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:49:09.976865 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae54ce-ef53-4fad-9fa7-4dae5c3e7e5e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:09.994904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae54ce-ef53-4fad-9fa7-4dae5c3e7e5e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:10.007547 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdb4b0-cda1-4f46-87e6-a6140f11c6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:10.009202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdb4b0-cda1-4f46-87e6-a6140f11c6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:10.010132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdb4b0-cda1-4f46-87e6-a6140f11c6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:10.010419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdb4b0-cda1-4f46-87e6-a6140f11c6c0 admin admin] PATH_INFO: `/v3/projects/4fd6a8d0f8e640f6b9b3667aafbed8e3/users/ea55bfa7a71942d9aa3ec85b1c221389/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:10.035329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdb4b0-cda1-4f46-87e6-a6140f11c6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd6a8d0f8e640f6b9b3667aafbed8e3, user_id=ea55bfa7a71942d9aa3ec85b1c221389, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:10.041450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdb4b0-cda1-4f46-87e6-a6140f11c6c0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:10.126051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1172/2307] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:49:09 2022] PUT /identity/v3/projects/4fd6a8d0f8e640f6b9b3667aafbed8e3/users/ea55bfa7a71942d9aa3ec85b1c221389/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:49:10.144465 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43dc47-227f-4ee8-9a89-06e389672dce None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:10.144955 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43dc47-227f-4ee8-9a89-06e389672dce None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:10.145436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43dc47-227f-4ee8-9a89-06e389672dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:10.181438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3a43dc47-227f-4ee8-9a89-06e389672dce None None] MFA Rules not processed for user `ea55bfa7a71942d9aa3ec85b1c221389`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:10.182575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3a43dc47-227f-4ee8-9a89-06e389672dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:10.245416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:10.285688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1136/2308] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:10.299497 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdb4b0-cda1-4f46-87e6-a6140f11c6c0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:10.304445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-64fdb4b0-cda1-4f46-87e6-a6140f11c6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:10.382828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdb4b0-cda1-4f46-87e6-a6140f11c6c0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:10.389215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806bed5-4e9b-4005-80cb-366504ca7054 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75138f08ea2b4813b095635d920599d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:10.389991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806bed5-4e9b-4005-80cb-366504ca7054 service glance] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:10.390282 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806bed5-4e9b-4005-80cb-366504ca7054 service glance] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:10.390707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806bed5-4e9b-4005-80cb-366504ca7054 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:10.401421 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806bed5-4e9b-4005-80cb-366504ca7054 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:10.402736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806bed5-4e9b-4005-80cb-366504ca7054 service glance] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:10.414308 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1173/2309] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:49:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:49:10.440159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6d1c-5aa0-49ae-a364-ffabd9761e28 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:10.440455 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6d1c-5aa0-49ae-a364-ffabd9761e28 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:10.440739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6d1c-5aa0-49ae-a364-ffabd9761e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:10.465272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-005f6d1c-5aa0-49ae-a364-ffabd9761e28 None None] MFA Rules not processed for user `5eec554b613142b0a8ec4976501fb45d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:10.466515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-005f6d1c-5aa0-49ae-a364-ffabd9761e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:10.541746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1137/2310] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:20.409208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=60,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:20.528397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=34 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:36.974097 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c180e3-82de-4115-8862-9c439351ad6d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:36.974844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c180e3-82de-4115-8862-9c439351ad6d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:36.974844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c180e3-82de-4115-8862-9c439351ad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:36.999891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-76c180e3-82de-4115-8862-9c439351ad6d None None] MFA Rules not processed for user `c1e0da5f2891468383a43fd3e1af3d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:37.001115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-76c180e3-82de-4115-8862-9c439351ad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:37.063742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1174/2311] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:49:39.870897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f6d1c-5aa0-49ae-a364-ffabd9761e28 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:39.949357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f6d1c-5aa0-49ae-a364-ffabd9761e28 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:39.953839 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:39.954493 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:39.954776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:39.955041 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] PATH_INFO: `/v3/users/ea55bfa7a71942d9aa3ec85b1c221389` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:39.956183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea55bfa7a71942d9aa3ec85b1c221389)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:39.958123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:40.206304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea55bfa7a71942d9aa3ec85b1c221389'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:40.207114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea55bfa7a71942d9aa3ec85b1c221389'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:40.228276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea55bfa7a71942d9aa3ec85b1c221389'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:40.239229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea55bfa7a71942d9aa3ec85b1c221389'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:40.239998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea55bfa7a71942d9aa3ec85b1c221389'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:40.366309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1138/2312] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:49:39 2022] DELETE /identity/v3/users/ea55bfa7a71942d9aa3ec85b1c221389 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:49:40.373928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2dc19-8633-41ea-a892-7690d09cca11 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:40.374637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2dc19-8633-41ea-a892-7690d09cca11 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:40.374743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2dc19-8633-41ea-a892-7690d09cca11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:40.407206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2dc2dc19-8633-41ea-a892-7690d09cca11 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:40.413730 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2dc2dc19-8633-41ea-a892-7690d09cca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:40.486581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1175/2313] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:40.501234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:40.502629 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:40.589222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdf42c-bcb4-4c9f-8564-fff78d1f5f54 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:40.594159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7893026-40e9-4d6a-85d5-bdebdba576c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:40.595103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7893026-40e9-4d6a-85d5-bdebdba576c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:40.595103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7893026-40e9-4d6a-85d5-bdebdba576c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:40.596247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7893026-40e9-4d6a-85d5-bdebdba576c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:40.606291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7893026-40e9-4d6a-85d5-bdebdba576c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:40.607825 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7893026-40e9-4d6a-85d5-bdebdba576c9 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:40.622020 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1139/2314] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:49:41.225052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2dc19-8633-41ea-a892-7690d09cca11 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:41.227285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2dc2dc19-8633-41ea-a892-7690d09cca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:41.239780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2dc19-8633-41ea-a892-7690d09cca11 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:41.255071 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df2f8d-79b2-493a-9156-f26a0140768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:41.256720 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df2f8d-79b2-493a-9156-f26a0140768a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:41.256720 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df2f8d-79b2-493a-9156-f26a0140768a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:41.257774 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df2f8d-79b2-493a-9156-f26a0140768a admin admin] PATH_INFO: `/v3/projects/4fd6a8d0f8e640f6b9b3667aafbed8e3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:41.258302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df2f8d-79b2-493a-9156-f26a0140768a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd6a8d0f8e640f6b9b3667aafbed8e3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:41.261223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df2f8d-79b2-493a-9156-f26a0140768a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:41.432854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-09df2f8d-79b2-493a-9156-f26a0140768a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd6a8d0f8e640f6b9b3667aafbed8e3', 'request_id': 'req-09df2f8d-79b2-493a-9156-f26a0140768a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:41.441607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-09df2f8d-79b2-493a-9156-f26a0140768a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd6a8d0f8e640f6b9b3667aafbed8e3', 'request_id': 'req-09df2f8d-79b2-493a-9156-f26a0140768a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:41.541637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-09df2f8d-79b2-493a-9156-f26a0140768a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd6a8d0f8e640f6b9b3667aafbed8e3', 'request_id': 'req-09df2f8d-79b2-493a-9156-f26a0140768a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:41.555880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-09df2f8d-79b2-493a-9156-f26a0140768a admin admin] The token cache is being invalidate because project 4fd6a8d0f8e640f6b9b3667aafbed8e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:49:41.556064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-09df2f8d-79b2-493a-9156-f26a0140768a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:41.557523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-09df2f8d-79b2-493a-9156-f26a0140768a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:41.559132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1176/2315] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:49:41 2022] DELETE /identity/v3/projects/4fd6a8d0f8e640f6b9b3667aafbed8e3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:49:41.563997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf47c6-7572-455b-baa5-d1b36f8ecb53 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:41.564474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf47c6-7572-455b-baa5-d1b36f8ecb53 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:41.564691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf47c6-7572-455b-baa5-d1b36f8ecb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:41.587384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5bbf47c6-7572-455b-baa5-d1b36f8ecb53 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:41.588618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5bbf47c6-7572-455b-baa5-d1b36f8ecb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:41.607503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:41.664382 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1140/2316] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:41.672734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052776c5-3688-495d-af96-780087bdce53 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:41.673053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052776c5-3688-495d-af96-780087bdce53 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:41.673414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052776c5-3688-495d-af96-780087bdce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:41.696414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-052776c5-3688-495d-af96-780087bdce53 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:41.697647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-052776c5-3688-495d-af96-780087bdce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:41.706248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1177/2317] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:49:41.711414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf47c6-7572-455b-baa5-d1b36f8ecb53 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:41.723997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf47c6-7572-455b-baa5-d1b36f8ecb53 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:41.729939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8259600-0b8f-4906-835a-f6ddeac9de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:41.729939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8259600-0b8f-4906-835a-f6ddeac9de86 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:41.729939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8259600-0b8f-4906-835a-f6ddeac9de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:41.729939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8259600-0b8f-4906-835a-f6ddeac9de86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:41.730537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8259600-0b8f-4906-835a-f6ddeac9de86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:49:41.730833 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8259600-0b8f-4906-835a-f6ddeac9de86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:41.732472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8259600-0b8f-4906-835a-f6ddeac9de86 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:41.747429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1141/2318] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:49:41.752407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052776c5-3688-495d-af96-780087bdce53 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:41.762832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052776c5-3688-495d-af96-780087bdce53 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:41.770001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8f0ae-4677-4ef9-b5e2-8892bedb5107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:41.770001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8f0ae-4677-4ef9-b5e2-8892bedb5107 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:41.770001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8f0ae-4677-4ef9-b5e2-8892bedb5107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:41.770001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8f0ae-4677-4ef9-b5e2-8892bedb5107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:41.770396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8f0ae-4677-4ef9-b5e2-8892bedb5107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:41.771884 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8f0ae-4677-4ef9-b5e2-8892bedb5107 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:41.953782 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:41.961876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1178/2319] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:49:41 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:49:41.969167 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8259600-0b8f-4906-835a-f6ddeac9de86 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:41.980221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8259600-0b8f-4906-835a-f6ddeac9de86 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:42.062852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4cfb5-6de1-4414-926f-1660ee9811aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:42.063466 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4cfb5-6de1-4414-926f-1660ee9811aa admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:42.063772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4cfb5-6de1-4414-926f-1660ee9811aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:42.064052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4cfb5-6de1-4414-926f-1660ee9811aa admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:42.064681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4cfb5-6de1-4414-926f-1660ee9811aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:42.066606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4cfb5-6de1-4414-926f-1660ee9811aa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:42.264430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1142/2320] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:49:41 2022] POST /identity/v3/users => generated 287 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:49:42.268290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8f0ae-4677-4ef9-b5e2-8892bedb5107 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:42.282449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8f0ae-4677-4ef9-b5e2-8892bedb5107 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:42.287539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e992c-0836-4cfd-a628-3efb850905df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:42.288232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e992c-0836-4cfd-a628-3efb850905df admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:42.288693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e992c-0836-4cfd-a628-3efb850905df admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:42.289539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e992c-0836-4cfd-a628-3efb850905df admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:42.291417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e992c-0836-4cfd-a628-3efb850905df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:42.293294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e992c-0836-4cfd-a628-3efb850905df admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:42.309240 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1179/2321] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:49:42.313433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4cfb5-6de1-4414-926f-1660ee9811aa admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:42.326347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4cfb5-6de1-4414-926f-1660ee9811aa admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:42.332338 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea54ab-57ed-4050-89e2-f47279ac9a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:42.333834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea54ab-57ed-4050-89e2-f47279ac9a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:42.333834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea54ab-57ed-4050-89e2-f47279ac9a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:42.333834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea54ab-57ed-4050-89e2-f47279ac9a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:42.334543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea54ab-57ed-4050-89e2-f47279ac9a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:42.336380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea54ab-57ed-4050-89e2-f47279ac9a21 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:42.352910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1143/2322] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:49:42.356952 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e992c-0836-4cfd-a628-3efb850905df admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:42.370151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e992c-0836-4cfd-a628-3efb850905df admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:42.377346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7011c-9eaa-41aa-b0ff-b2904f3750b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:42.378284 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7011c-9eaa-41aa-b0ff-b2904f3750b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:42.381790 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7011c-9eaa-41aa-b0ff-b2904f3750b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:42.381790 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7011c-9eaa-41aa-b0ff-b2904f3750b8 admin admin] PATH_INFO: `/v3/projects/6f26b5b368514f8781fbedd92795155c/users/dda6afaed88d40b98f1b4b056bd528c8/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:42.399537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7011c-9eaa-41aa-b0ff-b2904f3750b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f26b5b368514f8781fbedd92795155c, user_id=dda6afaed88d40b98f1b4b056bd528c8, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:42.404375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7011c-9eaa-41aa-b0ff-b2904f3750b8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:42.493059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1180/2323] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:49:42 2022] PUT /identity/v3/projects/6f26b5b368514f8781fbedd92795155c/users/dda6afaed88d40b98f1b4b056bd528c8/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:49:42.504553 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b7d7e-8ba3-41a1-8187-3ec0668d99cb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:42.504840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b7d7e-8ba3-41a1-8187-3ec0668d99cb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:42.505118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b7d7e-8ba3-41a1-8187-3ec0668d99cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:42.537872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9f2b7d7e-8ba3-41a1-8187-3ec0668d99cb None None] MFA Rules not processed for user `dda6afaed88d40b98f1b4b056bd528c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:42.539828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9f2b7d7e-8ba3-41a1-8187-3ec0668d99cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:42.641773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1144/2324] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:42.660076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7011c-9eaa-41aa-b0ff-b2904f3750b8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:42.662549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4ac7011c-9eaa-41aa-b0ff-b2904f3750b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:42.758866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7011c-9eaa-41aa-b0ff-b2904f3750b8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:42.763370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882f1e6-edc1-45f8-a003-96be21db1f3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:42.764312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882f1e6-edc1-45f8-a003-96be21db1f3a service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:42.765038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882f1e6-edc1-45f8-a003-96be21db1f3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:42.765775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882f1e6-edc1-45f8-a003-96be21db1f3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:42.776764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882f1e6-edc1-45f8-a003-96be21db1f3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:42.778441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882f1e6-edc1-45f8-a003-96be21db1f3a service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:42.790346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1181/2325] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:49:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:49:52.636145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:52.784973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:55.658489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b7d7e-8ba3-41a1-8187-3ec0668d99cb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:55.738028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b7d7e-8ba3-41a1-8187-3ec0668d99cb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:55.746877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:55.747832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:55.748302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:55.748785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] PATH_INFO: `/v3/users/dda6afaed88d40b98f1b4b056bd528c8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:55.750118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda6afaed88d40b98f1b4b056bd528c8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:55.752177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:56.098231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda6afaed88d40b98f1b4b056bd528c8'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:56.098959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda6afaed88d40b98f1b4b056bd528c8'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:56.113046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda6afaed88d40b98f1b4b056bd528c8'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:56.121564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda6afaed88d40b98f1b4b056bd528c8'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:56.123598 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda6afaed88d40b98f1b4b056bd528c8'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:56.250182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1145/2326] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:49:55 2022] DELETE /identity/v3/users/dda6afaed88d40b98f1b4b056bd528c8 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:49:56.254814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411f8d4-385e-4164-95ad-14703da4370f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:56.255363 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411f8d4-385e-4164-95ad-14703da4370f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:56.255363 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411f8d4-385e-4164-95ad-14703da4370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:56.278200 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1411f8d4-385e-4164-95ad-14703da4370f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:56.279282 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1411f8d4-385e-4164-95ad-14703da4370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:56.342258 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1182/2327] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:56.353430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:56.354919 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:56.421038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973c646-4b68-400c-b1fa-bb3152b5f93e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:56.425199 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbaac0e-f7c9-4a7d-84b1-7d2fd3d8cd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:56.425837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaac0e-f7c9-4a7d-84b1-7d2fd3d8cd88 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:56.426118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaac0e-f7c9-4a7d-84b1-7d2fd3d8cd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:56.426392 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaac0e-f7c9-4a7d-84b1-7d2fd3d8cd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:56.437760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbaac0e-f7c9-4a7d-84b1-7d2fd3d8cd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:56.439223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbaac0e-f7c9-4a7d-84b1-7d2fd3d8cd88 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:56.450462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1146/2328] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:49:56.965874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411f8d4-385e-4164-95ad-14703da4370f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:56.971159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1411f8d4-385e-4164-95ad-14703da4370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:56.982130 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411f8d4-385e-4164-95ad-14703da4370f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:56.987268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95709a7d-ef96-4f63-8aa9-7aea784d25da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:56.988086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95709a7d-ef96-4f63-8aa9-7aea784d25da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:56.988217 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95709a7d-ef96-4f63-8aa9-7aea784d25da admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:56.988627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95709a7d-ef96-4f63-8aa9-7aea784d25da admin admin] PATH_INFO: `/v3/projects/6f26b5b368514f8781fbedd92795155c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:56.990702 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95709a7d-ef96-4f63-8aa9-7aea784d25da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f26b5b368514f8781fbedd92795155c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:56.994141 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95709a7d-ef96-4f63-8aa9-7aea784d25da admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:57.146439 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-95709a7d-ef96-4f63-8aa9-7aea784d25da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f26b5b368514f8781fbedd92795155c', 'request_id': 'req-95709a7d-ef96-4f63-8aa9-7aea784d25da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:57.153934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-95709a7d-ef96-4f63-8aa9-7aea784d25da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f26b5b368514f8781fbedd92795155c', 'request_id': 'req-95709a7d-ef96-4f63-8aa9-7aea784d25da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:57.267674 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-95709a7d-ef96-4f63-8aa9-7aea784d25da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f26b5b368514f8781fbedd92795155c', 'request_id': 'req-95709a7d-ef96-4f63-8aa9-7aea784d25da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:57.282742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-95709a7d-ef96-4f63-8aa9-7aea784d25da admin admin] The token cache is being invalidate because project 6f26b5b368514f8781fbedd92795155c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:49:57.283030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-95709a7d-ef96-4f63-8aa9-7aea784d25da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:57.283710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-95709a7d-ef96-4f63-8aa9-7aea784d25da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:49:57.285640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1183/2329] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:49:56 2022] DELETE /identity/v3/projects/6f26b5b368514f8781fbedd92795155c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:49:57.291229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a43cd2-a67c-4722-a752-957d606a0bcd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:57.291908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a43cd2-a67c-4722-a752-957d606a0bcd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:57.291908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a43cd2-a67c-4722-a752-957d606a0bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:57.325698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e9a43cd2-a67c-4722-a752-957d606a0bcd None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:57.327200 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e9a43cd2-a67c-4722-a752-957d606a0bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:57.360017 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:57.422772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1147/2330] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:57.441866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9212e0-73fa-47d7-9a40-a2d4a0d8225c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:57.441866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9212e0-73fa-47d7-9a40-a2d4a0d8225c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:57.441866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9212e0-73fa-47d7-9a40-a2d4a0d8225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:57.465134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ba9212e0-73fa-47d7-9a40-a2d4a0d8225c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:57.466401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ba9212e0-73fa-47d7-9a40-a2d4a0d8225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:57.475371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1184/2331] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:57.479915 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a43cd2-a67c-4722-a752-957d606a0bcd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:57.490084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a43cd2-a67c-4722-a752-957d606a0bcd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:57.496244 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724070b-c667-4593-a048-6fa3bf4ee00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:57.496793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724070b-c667-4593-a048-6fa3bf4ee00d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:57.497074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724070b-c667-4593-a048-6fa3bf4ee00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:57.497348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724070b-c667-4593-a048-6fa3bf4ee00d admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:57.498004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724070b-c667-4593-a048-6fa3bf4ee00d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:49:57.498309 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724070b-c667-4593-a048-6fa3bf4ee00d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:57.500028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724070b-c667-4593-a048-6fa3bf4ee00d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:57.513746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1148/2332] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:49:57.518359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9212e0-73fa-47d7-9a40-a2d4a0d8225c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:57.528271 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9212e0-73fa-47d7-9a40-a2d4a0d8225c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:57.532963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448b7aa-6d3d-4148-9bbc-c3054b4fbbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:57.533569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448b7aa-6d3d-4148-9bbc-c3054b4fbbab admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:57.533849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448b7aa-6d3d-4148-9bbc-c3054b4fbbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:57.534125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448b7aa-6d3d-4148-9bbc-c3054b4fbbab admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:57.534757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448b7aa-6d3d-4148-9bbc-c3054b4fbbab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:57.536742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448b7aa-6d3d-4148-9bbc-c3054b4fbbab admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:57.649126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1185/2333] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:49:57 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:49:57.653413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724070b-c667-4593-a048-6fa3bf4ee00d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:57.665359 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724070b-c667-4593-a048-6fa3bf4ee00d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:57.733538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a99547-e022-464c-9cd4-3f71259d12d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:57.734150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a99547-e022-464c-9cd4-3f71259d12d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:57.734435 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a99547-e022-464c-9cd4-3f71259d12d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:57.734710 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a99547-e022-464c-9cd4-3f71259d12d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:57.735334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a99547-e022-464c-9cd4-3f71259d12d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:57.737305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a99547-e022-464c-9cd4-3f71259d12d8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:57.838584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1149/2334] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:49:57 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:49:57.842644 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448b7aa-6d3d-4148-9bbc-c3054b4fbbab admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:57.854851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448b7aa-6d3d-4148-9bbc-c3054b4fbbab admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:57.862082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06111c5-454b-4523-a7b1-c32aa5f2d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:57.862712 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06111c5-454b-4523-a7b1-c32aa5f2d48a admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:57.862992 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06111c5-454b-4523-a7b1-c32aa5f2d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:57.863333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06111c5-454b-4523-a7b1-c32aa5f2d48a admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:57.864025 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06111c5-454b-4523-a7b1-c32aa5f2d48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:57.865710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06111c5-454b-4523-a7b1-c32aa5f2d48a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:57.878132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1186/2335] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:49:57.882405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a99547-e022-464c-9cd4-3f71259d12d8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:57.892963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a99547-e022-464c-9cd4-3f71259d12d8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:57.897957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513c98b-ccee-4d77-b4d2-2320eba5682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:57.898867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513c98b-ccee-4d77-b4d2-2320eba5682b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:57.899151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513c98b-ccee-4d77-b4d2-2320eba5682b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:57.899429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513c98b-ccee-4d77-b4d2-2320eba5682b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:57.900114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513c98b-ccee-4d77-b4d2-2320eba5682b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:57.901771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513c98b-ccee-4d77-b4d2-2320eba5682b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:57.914380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1150/2336] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:49:57.918978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06111c5-454b-4523-a7b1-c32aa5f2d48a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:57.930243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06111c5-454b-4523-a7b1-c32aa5f2d48a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:57.935308 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8a839-d09e-42cb-bf8e-e094a4837632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:57.936010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8a839-d09e-42cb-bf8e-e094a4837632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:57.936296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8a839-d09e-42cb-bf8e-e094a4837632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:57.936572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8a839-d09e-42cb-bf8e-e094a4837632 admin admin] PATH_INFO: `/v3/projects/e961ee9404de4464b721d31c607cae20/users/5ccf8ad84e9141d69df712cd5a8d14eb/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:57.952901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8a839-d09e-42cb-bf8e-e094a4837632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e961ee9404de4464b721d31c607cae20, user_id=5ccf8ad84e9141d69df712cd5a8d14eb, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:57.955618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8a839-d09e-42cb-bf8e-e094a4837632 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:58.072569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1187/2337] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:49:57 2022] PUT /identity/v3/projects/e961ee9404de4464b721d31c607cae20/users/5ccf8ad84e9141d69df712cd5a8d14eb/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:49:58.078669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc22019-0677-46aa-b6ca-143982d70c5e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:58.078956 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc22019-0677-46aa-b6ca-143982d70c5e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:58.079226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc22019-0677-46aa-b6ca-143982d70c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:58.102779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7bc22019-0677-46aa-b6ca-143982d70c5e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:58.102779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7bc22019-0677-46aa-b6ca-143982d70c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:58.166206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1151/2338] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:58.176414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8a839-d09e-42cb-bf8e-e094a4837632 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:58.178333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-77e8a839-d09e-42cb-bf8e-e094a4837632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:58.207479 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:58.252114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8a839-d09e-42cb-bf8e-e094a4837632 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:58.256681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39da46-d773-417d-8f96-3d26c7b38309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:58.257383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39da46-d773-417d-8f96-3d26c7b38309 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:58.257874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39da46-d773-417d-8f96-3d26c7b38309 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:58.258199 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39da46-d773-417d-8f96-3d26c7b38309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:58.268215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39da46-d773-417d-8f96-3d26c7b38309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:58.269653 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39da46-d773-417d-8f96-3d26c7b38309 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:58.281500 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1188/2339] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:49:59.995186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c06f4-d03d-4242-b672-fa81d8d7ca5b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:59.999248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c06f4-d03d-4242-b672-fa81d8d7ca5b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:59.999248 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c06f4-d03d-4242-b672-fa81d8d7ca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:00.046107 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-398c06f4-d03d-4242-b672-fa81d8d7ca5b None None] MFA Rules not processed for user `5ccf8ad84e9141d69df712cd5a8d14eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:00.048009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-398c06f4-d03d-4242-b672-fa81d8d7ca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:00.079471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:00.158657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1152/2340] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:49:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:00.184061 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39da46-d773-417d-8f96-3d26c7b38309 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:00.186594 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9d39da46-d773-417d-8f96-3d26c7b38309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:00.273698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39da46-d773-417d-8f96-3d26c7b38309 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:00.278214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de54ea1-fcbd-499c-a9e0-5ef6fe927f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:00.278860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de54ea1-fcbd-499c-a9e0-5ef6fe927f1c service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:00.279134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de54ea1-fcbd-499c-a9e0-5ef6fe927f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:00.279405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de54ea1-fcbd-499c-a9e0-5ef6fe927f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:00.289758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de54ea1-fcbd-499c-a9e0-5ef6fe927f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:00.297367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de54ea1-fcbd-499c-a9e0-5ef6fe927f1c service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:00.302517 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1189/2341] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:50:02.645605 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8df845-56b8-4b29-9751-b432bec01daf None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:02.646336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8df845-56b8-4b29-9751-b432bec01daf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:02.646508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8df845-56b8-4b29-9751-b432bec01daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:02.668640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1b8df845-56b8-4b29-9751-b432bec01daf None None] MFA Rules not processed for user `5ccf8ad84e9141d69df712cd5a8d14eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:02.669992 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1b8df845-56b8-4b29-9751-b432bec01daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:02.677712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1153/2342] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:50:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:10.310133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=43 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:11.647073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de54ea1-fcbd-499c-a9e0-5ef6fe927f1c service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:11.659090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de54ea1-fcbd-499c-a9e0-5ef6fe927f1c service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:11.663672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a833d62-ce14-402a-8eae-a0285b4853e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:11.664315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a833d62-ce14-402a-8eae-a0285b4853e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:11.664618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a833d62-ce14-402a-8eae-a0285b4853e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:11.664891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a833d62-ce14-402a-8eae-a0285b4853e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:11.667066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7a833d62-ce14-402a-8eae-a0285b4853e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:11.782627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a833d62-ce14-402a-8eae-a0285b4853e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:11.784081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a833d62-ce14-402a-8eae-a0285b4853e5 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:11.797699 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1190/2343] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:12.662965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=22 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:16.067659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8df845-56b8-4b29-9751-b432bec01daf None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:16.069693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1b8df845-56b8-4b29-9751-b432bec01daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:16.082787 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8df845-56b8-4b29-9751-b432bec01daf None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:16.086434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0faad-d53c-4d89-a456-bd8e431f57bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:16.087036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0faad-d53c-4d89-a456-bd8e431f57bd service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:16.087310 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0faad-d53c-4d89-a456-bd8e431f57bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:16.087576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0faad-d53c-4d89-a456-bd8e431f57bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:16.089409 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-27b0faad-d53c-4d89-a456-bd8e431f57bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:16.104330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0faad-d53c-4d89-a456-bd8e431f57bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:16.105760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0faad-d53c-4d89-a456-bd8e431f57bd service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:16.120860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1154/2344] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:21.791843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=34 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:23.173273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a833d62-ce14-402a-8eae-a0285b4853e5 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:23.187095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a833d62-ce14-402a-8eae-a0285b4853e5 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:23.188152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0fe55-e8ff-4bb4-816d-893275526df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:23.188807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0fe55-e8ff-4bb4-816d-893275526df4 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:23.189083 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0fe55-e8ff-4bb4-816d-893275526df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:23.189469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0fe55-e8ff-4bb4-816d-893275526df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:23.191469 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-61c0fe55-e8ff-4bb4-816d-893275526df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:23.205253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0fe55-e8ff-4bb4-816d-893275526df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:23.207108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0fe55-e8ff-4bb4-816d-893275526df4 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:23.218632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1191/2345] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:50:23.938608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508b2c-d48e-491b-9e53-25f42e734e73 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:23.939428 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508b2c-d48e-491b-9e53-25f42e734e73 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:23.939632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508b2c-d48e-491b-9e53-25f42e734e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:23.962922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-89508b2c-d48e-491b-9e53-25f42e734e73 None None] MFA Rules not processed for user `ae1db5003ba24c71a7a68c68a74c7197`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:23.964285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-89508b2c-d48e-491b-9e53-25f42e734e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:24.034388 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1155/2346] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:50:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:50:24.899913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0fe55-e8ff-4bb4-816d-893275526df4 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:24.899913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-61c0fe55-e8ff-4bb4-816d-893275526df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:24.984879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0fe55-e8ff-4bb4-816d-893275526df4 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:24.993355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb79a2-c398-4b97-a37f-9e321b1e4bd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebfb233b2504463a4ee9202b5a3ab50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:24.993355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb79a2-c398-4b97-a37f-9e321b1e4bd2 service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:24.993355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb79a2-c398-4b97-a37f-9e321b1e4bd2 service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:24.993355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb79a2-c398-4b97-a37f-9e321b1e4bd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:24.995430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-27fb79a2-c398-4b97-a37f-9e321b1e4bd2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:25.011703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb79a2-c398-4b97-a37f-9e321b1e4bd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:25.013595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb79a2-c398-4b97-a37f-9e321b1e4bd2 service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:25.027108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1192/2347] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:28.028606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89508b2c-d48e-491b-9e53-25f42e734e73 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:28.030207 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-89508b2c-d48e-491b-9e53-25f42e734e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:28.046403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89508b2c-d48e-491b-9e53-25f42e734e73 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:28.052170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5199fc-0430-41d5-8090-b8fb1c9d18ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:28.054455 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5199fc-0430-41d5-8090-b8fb1c9d18ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:28.054995 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5199fc-0430-41d5-8090-b8fb1c9d18ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:28.061621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5199fc-0430-41d5-8090-b8fb1c9d18ab admin admin] PATH_INFO: `/v3/users/5eec554b613142b0a8ec4976501fb45d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:28.061621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5199fc-0430-41d5-8090-b8fb1c9d18ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eec554b613142b0a8ec4976501fb45d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:28.061621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5199fc-0430-41d5-8090-b8fb1c9d18ab admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:28.266592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2a5199fc-0430-41d5-8090-b8fb1c9d18ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eec554b613142b0a8ec4976501fb45d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:28.267259 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2a5199fc-0430-41d5-8090-b8fb1c9d18ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eec554b613142b0a8ec4976501fb45d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:28.280710 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2a5199fc-0430-41d5-8090-b8fb1c9d18ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eec554b613142b0a8ec4976501fb45d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:28.291368 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2a5199fc-0430-41d5-8090-b8fb1c9d18ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eec554b613142b0a8ec4976501fb45d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:28.292824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2a5199fc-0430-41d5-8090-b8fb1c9d18ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eec554b613142b0a8ec4976501fb45d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:28.406840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1156/2348] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:50:28 2022] DELETE /identity/v3/users/5eec554b613142b0a8ec4976501fb45d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:28.752746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb79a2-c398-4b97-a37f-9e321b1e4bd2 service placement] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:28.771214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb79a2-c398-4b97-a37f-9e321b1e4bd2 service placement] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:28.844753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf33b9-5089-4c3e-8f34-50e5f1045196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:28.845521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf33b9-5089-4c3e-8f34-50e5f1045196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:28.845866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf33b9-5089-4c3e-8f34-50e5f1045196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:28.846243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf33b9-5089-4c3e-8f34-50e5f1045196 admin admin] PATH_INFO: `/v3/projects/28863afc908d4415ad856f0e067f5d6b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:28.848559 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf33b9-5089-4c3e-8f34-50e5f1045196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28863afc908d4415ad856f0e067f5d6b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:28.849610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf33b9-5089-4c3e-8f34-50e5f1045196 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:29.044363 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b5bf33b9-5089-4c3e-8f34-50e5f1045196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28863afc908d4415ad856f0e067f5d6b', 'request_id': 'req-b5bf33b9-5089-4c3e-8f34-50e5f1045196'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:29.051290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b5bf33b9-5089-4c3e-8f34-50e5f1045196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28863afc908d4415ad856f0e067f5d6b', 'request_id': 'req-b5bf33b9-5089-4c3e-8f34-50e5f1045196'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:29.136164 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b5bf33b9-5089-4c3e-8f34-50e5f1045196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28863afc908d4415ad856f0e067f5d6b', 'request_id': 'req-b5bf33b9-5089-4c3e-8f34-50e5f1045196'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:29.149411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b5bf33b9-5089-4c3e-8f34-50e5f1045196 admin admin] The token cache is being invalidate because project 28863afc908d4415ad856f0e067f5d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:50:29.149988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b5bf33b9-5089-4c3e-8f34-50e5f1045196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:29.150783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b5bf33b9-5089-4c3e-8f34-50e5f1045196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:29.152355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1193/2349] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:50:28 2022] DELETE /identity/v3/projects/28863afc908d4415ad856f0e067f5d6b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:29.158680 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fbdd1-75cb-4a8c-864a-e2526bc02dea None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:29.159235 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fbdd1-75cb-4a8c-864a-e2526bc02dea None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:29.159235 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fbdd1-75cb-4a8c-864a-e2526bc02dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:29.207243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-092fbdd1-75cb-4a8c-864a-e2526bc02dea None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:29.213134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-092fbdd1-75cb-4a8c-864a-e2526bc02dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:29.355779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1157/2350] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:29.359531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445e345-e924-4737-b6c4-6397ebad31c1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:29.359857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445e345-e924-4737-b6c4-6397ebad31c1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:29.360133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445e345-e924-4737-b6c4-6397ebad31c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:29.381192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:29.387211 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0445e345-e924-4737-b6c4-6397ebad31c1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:29.389435 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0445e345-e924-4737-b6c4-6397ebad31c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:29.402341 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1194/2351] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:29.404251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fbdd1-75cb-4a8c-864a-e2526bc02dea None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:29.414481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:29.423521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fbdd1-75cb-4a8c-864a-e2526bc02dea None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:29.431665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddade83c-4f59-4012-a8a4-d4ca8f532d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:29.432608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddade83c-4f59-4012-a8a4-d4ca8f532d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:29.432895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddade83c-4f59-4012-a8a4-d4ca8f532d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:29.433352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddade83c-4f59-4012-a8a4-d4ca8f532d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:29.434054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddade83c-4f59-4012-a8a4-d4ca8f532d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:50:29.434358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddade83c-4f59-4012-a8a4-d4ca8f532d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:29.436005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddade83c-4f59-4012-a8a4-d4ca8f532d3c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:29.458718 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1158/2352] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:50:29.472056 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445e345-e924-4737-b6c4-6397ebad31c1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:29.484018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445e345-e924-4737-b6c4-6397ebad31c1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:29.491367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e3956-fb3b-4334-bd79-f7ad0948c21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:29.492273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e3956-fb3b-4334-bd79-f7ad0948c21e admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:29.492559 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e3956-fb3b-4334-bd79-f7ad0948c21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:29.492888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e3956-fb3b-4334-bd79-f7ad0948c21e admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:29.493711 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e3956-fb3b-4334-bd79-f7ad0948c21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:29.495688 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e3956-fb3b-4334-bd79-f7ad0948c21e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:29.648415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1195/2353] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:50:29 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:50:29.652760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddade83c-4f59-4012-a8a4-d4ca8f532d3c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:29.666692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddade83c-4f59-4012-a8a4-d4ca8f532d3c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:29.748393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e11f7-3369-4f9e-85b4-8194cf6a6323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:29.749004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e11f7-3369-4f9e-85b4-8194cf6a6323 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:29.749513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e11f7-3369-4f9e-85b4-8194cf6a6323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:29.749723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e11f7-3369-4f9e-85b4-8194cf6a6323 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:29.750168 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e11f7-3369-4f9e-85b4-8194cf6a6323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:29.752397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e11f7-3369-4f9e-85b4-8194cf6a6323 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:29.922697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1159/2354] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:50:29 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:50:29.924136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e3956-fb3b-4334-bd79-f7ad0948c21e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:29.939784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e3956-fb3b-4334-bd79-f7ad0948c21e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:29.946505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032daa8e-851b-481d-919e-e50a89a078c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:29.947596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032daa8e-851b-481d-919e-e50a89a078c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:29.948340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032daa8e-851b-481d-919e-e50a89a078c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:29.948637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032daa8e-851b-481d-919e-e50a89a078c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:29.949902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032daa8e-851b-481d-919e-e50a89a078c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:29.952216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032daa8e-851b-481d-919e-e50a89a078c6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:29.971126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1196/2355] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:50:29.972194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e11f7-3369-4f9e-85b4-8194cf6a6323 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:29.987597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e11f7-3369-4f9e-85b4-8194cf6a6323 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:29.995623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9f87b-08c3-4575-96f1-94a42d589cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:29.996311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9f87b-08c3-4575-96f1-94a42d589cab admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:29.997320 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9f87b-08c3-4575-96f1-94a42d589cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:29.997320 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9f87b-08c3-4575-96f1-94a42d589cab admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:29.997829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9f87b-08c3-4575-96f1-94a42d589cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:29.999618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9f87b-08c3-4575-96f1-94a42d589cab admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:30.016120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1160/2356] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:50:30.026557 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032daa8e-851b-481d-919e-e50a89a078c6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:30.037484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032daa8e-851b-481d-919e-e50a89a078c6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:30.043610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360ee5f-6d7b-42ab-84e8-93290874d59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:30.044317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360ee5f-6d7b-42ab-84e8-93290874d59a admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:30.044595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360ee5f-6d7b-42ab-84e8-93290874d59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:30.044865 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360ee5f-6d7b-42ab-84e8-93290874d59a admin admin] PATH_INFO: `/v3/projects/e658bf6421dc42b0bdc7e0352ac0f9e6/users/bb2ab51f75f84727831566a44db3d9d0/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:30.072053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360ee5f-6d7b-42ab-84e8-93290874d59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e658bf6421dc42b0bdc7e0352ac0f9e6, user_id=bb2ab51f75f84727831566a44db3d9d0, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:30.074987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360ee5f-6d7b-42ab-84e8-93290874d59a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:30.229693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1197/2357] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:50:30 2022] PUT /identity/v3/projects/e658bf6421dc42b0bdc7e0352ac0f9e6/users/bb2ab51f75f84727831566a44db3d9d0/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:50:30.236163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fccd0f-57aa-4e6c-a19a-144cf4bbfab8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:30.236163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fccd0f-57aa-4e6c-a19a-144cf4bbfab8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:30.236163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fccd0f-57aa-4e6c-a19a-144cf4bbfab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:30.258600 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c2fccd0f-57aa-4e6c-a19a-144cf4bbfab8 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:30.259973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c2fccd0f-57aa-4e6c-a19a-144cf4bbfab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:30.343587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1161/2358] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:30.353989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360ee5f-6d7b-42ab-84e8-93290874d59a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:30.355754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b360ee5f-6d7b-42ab-84e8-93290874d59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:30.429398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360ee5f-6d7b-42ab-84e8-93290874d59a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:30.433627 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310be4d-9bfc-4ffe-8b51-b56790145c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:30.434273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310be4d-9bfc-4ffe-8b51-b56790145c4d service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:30.434574 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310be4d-9bfc-4ffe-8b51-b56790145c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:30.434830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310be4d-9bfc-4ffe-8b51-b56790145c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:30.446760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310be4d-9bfc-4ffe-8b51-b56790145c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:30.452152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310be4d-9bfc-4ffe-8b51-b56790145c4d service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:30.460201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1198/2359] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:50:30.779202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fccd0f-57aa-4e6c-a19a-144cf4bbfab8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:30.780657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c2fccd0f-57aa-4e6c-a19a-144cf4bbfab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:30.888272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fccd0f-57aa-4e6c-a19a-144cf4bbfab8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:30.895116 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16352d8e-ea48-4ca6-a7e2-d0b1a8e16996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:30.895882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352d8e-ea48-4ca6-a7e2-d0b1a8e16996 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:30.896163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352d8e-ea48-4ca6-a7e2-d0b1a8e16996 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:30.896461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352d8e-ea48-4ca6-a7e2-d0b1a8e16996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:30.898751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-16352d8e-ea48-4ca6-a7e2-d0b1a8e16996 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:30.906925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:30.972113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16352d8e-ea48-4ca6-a7e2-d0b1a8e16996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:30.974074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16352d8e-ea48-4ca6-a7e2-d0b1a8e16996 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:30.986751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1162/2360] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:32.770907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310be4d-9bfc-4ffe-8b51-b56790145c4d service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:32.791472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310be4d-9bfc-4ffe-8b51-b56790145c4d service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:32.797180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a57806-c166-413d-8843-04c03627dc71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:32.797783 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a57806-c166-413d-8843-04c03627dc71 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:32.798075 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a57806-c166-413d-8843-04c03627dc71 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:32.798322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a57806-c166-413d-8843-04c03627dc71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:32.800438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-27a57806-c166-413d-8843-04c03627dc71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:32.887078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a57806-c166-413d-8843-04c03627dc71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:32.889209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a57806-c166-413d-8843-04c03627dc71 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:32.902665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1199/2361] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:37.756550 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8907d7-db00-4925-8e75-dbb5e2f1d114 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:37.757506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8907d7-db00-4925-8e75-dbb5e2f1d114 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:37.758090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8907d7-db00-4925-8e75-dbb5e2f1d114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:37.810895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1f8907d7-db00-4925-8e75-dbb5e2f1d114 None None] MFA Rules not processed for user `bb2ab51f75f84727831566a44db3d9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:37.812892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1f8907d7-db00-4925-8e75-dbb5e2f1d114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:37.957606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1163/2362] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:50:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:37.966610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a57806-c166-413d-8843-04c03627dc71 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:37.972850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-27a57806-c166-413d-8843-04c03627dc71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:37.998027 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a57806-c166-413d-8843-04c03627dc71 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:38.010149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c2eb6-fac0-4bcd-8881-a78acc925c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:38.011102 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c2eb6-fac0-4bcd-8881-a78acc925c2e service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:38.011694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c2eb6-fac0-4bcd-8881-a78acc925c2e service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:38.011937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c2eb6-fac0-4bcd-8881-a78acc925c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:38.031380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c2eb6-fac0-4bcd-8881-a78acc925c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:38.033104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c2eb6-fac0-4bcd-8881-a78acc925c2e service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:38.048094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1200/2363] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:38.244154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8907d7-db00-4925-8e75-dbb5e2f1d114 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:38.250350 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8907d7-db00-4925-8e75-dbb5e2f1d114 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:38.254395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49084d2b-61c9-4021-a492-dee050e85cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:38.255010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49084d2b-61c9-4021-a492-dee050e85cad service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:38.255331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49084d2b-61c9-4021-a492-dee050e85cad service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:38.257381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49084d2b-61c9-4021-a492-dee050e85cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:38.260303 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-49084d2b-61c9-4021-a492-dee050e85cad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:38.275567 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49084d2b-61c9-4021-a492-dee050e85cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:38.278250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49084d2b-61c9-4021-a492-dee050e85cad service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:38.293360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1164/2364] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:41.115108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0487a-b7b6-447e-8205-b37a3f103728 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:41.116296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0487a-b7b6-447e-8205-b37a3f103728 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:41.116296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0487a-b7b6-447e-8205-b37a3f103728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:41.151319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-51f0487a-b7b6-447e-8205-b37a3f103728 None None] MFA Rules not processed for user `bb2ab51f75f84727831566a44db3d9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:41.152917 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-51f0487a-b7b6-447e-8205-b37a3f103728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:41.161771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1201/2365] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:50:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:41.702380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49084d2b-61c9-4021-a492-dee050e85cad service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:41.704225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-49084d2b-61c9-4021-a492-dee050e85cad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:41.730867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49084d2b-61c9-4021-a492-dee050e85cad service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:41.736239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8c346-2dad-48ac-b785-2fab612ad50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:41.736984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c346-2dad-48ac-b785-2fab612ad50d service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:41.737419 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c346-2dad-48ac-b785-2fab612ad50d service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:41.737670 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c346-2dad-48ac-b785-2fab612ad50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:41.742265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-37f8c346-2dad-48ac-b785-2fab612ad50d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:41.761702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8c346-2dad-48ac-b785-2fab612ad50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:41.764375 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8c346-2dad-48ac-b785-2fab612ad50d service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:41.776488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1165/2366] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:44.649683 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2e426-bc96-4caf-9be4-dcdc1e6f6c04 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:44.650438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2e426-bc96-4caf-9be4-dcdc1e6f6c04 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:44.650951 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2e426-bc96-4caf-9be4-dcdc1e6f6c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:44.678488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3eb2e426-bc96-4caf-9be4-dcdc1e6f6c04 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:44.679733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3eb2e426-bc96-4caf-9be4-dcdc1e6f6c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:44.692489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1202/2367] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 10:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:44.711091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8c346-2dad-48ac-b785-2fab612ad50d service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:44.730911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8c346-2dad-48ac-b785-2fab612ad50d service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:44.739866 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c918d9-4f06-41b3-936d-455ca4d8fac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:44.740799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c918d9-4f06-41b3-936d-455ca4d8fac4 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:44.741936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c918d9-4f06-41b3-936d-455ca4d8fac4 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:44.741936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c918d9-4f06-41b3-936d-455ca4d8fac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:44.758807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c918d9-4f06-41b3-936d-455ca4d8fac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:44.760457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c918d9-4f06-41b3-936d-455ca4d8fac4 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:44.772185 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1166/2368] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:50:49.198557 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2e426-bc96-4caf-9be4-dcdc1e6f6c04 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:49.223143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2e426-bc96-4caf-9be4-dcdc1e6f6c04 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:49.237418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134ece8-46fb-4b46-9fae-b82c6287b28f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:49.238621 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134ece8-46fb-4b46-9fae-b82c6287b28f service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:49.238864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134ece8-46fb-4b46-9fae-b82c6287b28f service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:49.239209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134ece8-46fb-4b46-9fae-b82c6287b28f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:49.243321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7134ece8-46fb-4b46-9fae-b82c6287b28f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:49.267375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134ece8-46fb-4b46-9fae-b82c6287b28f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:49.270388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134ece8-46fb-4b46-9fae-b82c6287b28f service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:49.286066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1203/2369] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:50.117578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d181a1-9ad4-480b-a281-7152c6debab1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:50.118236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d181a1-9ad4-480b-a281-7152c6debab1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:50.118236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d181a1-9ad4-480b-a281-7152c6debab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:50.142518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b8d181a1-9ad4-480b-a281-7152c6debab1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:50.144339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b8d181a1-9ad4-480b-a281-7152c6debab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:50.158803 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1167/2370] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 10:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:50.181573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134ece8-46fb-4b46-9fae-b82c6287b28f service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:50.189098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:50.194231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134ece8-46fb-4b46-9fae-b82c6287b28f service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:50.202700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de12c1-9f6a-4d5c-b9d5-d14f1b72f2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:50.203335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de12c1-9f6a-4d5c-b9d5-d14f1b72f2dd service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:50.203490 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de12c1-9f6a-4d5c-b9d5-d14f1b72f2dd service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:50.203885 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de12c1-9f6a-4d5c-b9d5-d14f1b72f2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:50.217654 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de12c1-9f6a-4d5c-b9d5-d14f1b72f2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:50.220083 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de12c1-9f6a-4d5c-b9d5-d14f1b72f2dd service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:50.234070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1204/2371] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:55.882504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f6be4-8019-4db5-b9db-d355e9a96bf8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:55.883695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f6be4-8019-4db5-b9db-d355e9a96bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:55.883695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f6be4-8019-4db5-b9db-d355e9a96bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:55.910894 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-129f6be4-8019-4db5-b9db-d355e9a96bf8 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:55.913431 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-129f6be4-8019-4db5-b9db-d355e9a96bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:55.932339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1168/2372] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 10:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:55.951442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de12c1-9f6a-4d5c-b9d5-d14f1b72f2dd service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:55.967770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de12c1-9f6a-4d5c-b9d5-d14f1b72f2dd service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:55.979503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6f94d-5f41-4ca9-aa3f-a5a81168a401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:55.979503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f94d-5f41-4ca9-aa3f-a5a81168a401 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:55.979503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f94d-5f41-4ca9-aa3f-a5a81168a401 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:55.980556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f94d-5f41-4ca9-aa3f-a5a81168a401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:55.999904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6f94d-5f41-4ca9-aa3f-a5a81168a401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:56.003249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6f94d-5f41-4ca9-aa3f-a5a81168a401 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:56.016258 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1205/2373] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:00.017964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ec64d-9a55-4db0-8186-deea2ff15045 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.020196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ec64d-9a55-4db0-8186-deea2ff15045 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.020196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ec64d-9a55-4db0-8186-deea2ff15045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.042616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-750ec64d-9a55-4db0-8186-deea2ff15045 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:00.043910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-750ec64d-9a55-4db0-8186-deea2ff15045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:00.097443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:00.115304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1169/2374] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:51:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:00.336382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6f94d-5f41-4ca9-aa3f-a5a81168a401 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:00.337859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-77e6f94d-5f41-4ca9-aa3f-a5a81168a401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:00.466819 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6f94d-5f41-4ca9-aa3f-a5a81168a401 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:00.481092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579036fc-cc21-46d8-9ef2-1f78da276efd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:00.481725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579036fc-cc21-46d8-9ef2-1f78da276efd service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.482008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579036fc-cc21-46d8-9ef2-1f78da276efd service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.482283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579036fc-cc21-46d8-9ef2-1f78da276efd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.497572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579036fc-cc21-46d8-9ef2-1f78da276efd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:00.499192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579036fc-cc21-46d8-9ef2-1f78da276efd service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:00.509170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1206/2375] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:51:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:51:00.645527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9391a-1aff-488b-9928-0585899f714f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.646105 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9391a-1aff-488b-9928-0585899f714f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.646546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9391a-1aff-488b-9928-0585899f714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.687453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-20c9391a-1aff-488b-9928-0585899f714f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:00.691376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-20c9391a-1aff-488b-9928-0585899f714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:00.704782 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1170/2376] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 10:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:00.753053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579036fc-cc21-46d8-9ef2-1f78da276efd service swift] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:00.787693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579036fc-cc21-46d8-9ef2-1f78da276efd service swift] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:00.796818 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b945fb-594a-49c5-8cf1-7a33ffa566a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:00.797744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b945fb-594a-49c5-8cf1-7a33ffa566a8 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.798198 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b945fb-594a-49c5-8cf1-7a33ffa566a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.798647 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b945fb-594a-49c5-8cf1-7a33ffa566a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.814618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b945fb-594a-49c5-8cf1-7a33ffa566a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:00.816540 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b945fb-594a-49c5-8cf1-7a33ffa566a8 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:00.830978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1207/2377] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:04.994384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaed66-de77-42c1-89d7-0abaa7d8c428 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:04.995403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaed66-de77-42c1-89d7-0abaa7d8c428 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:04.995890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaed66-de77-42c1-89d7-0abaa7d8c428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:05.018378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-77aaed66-de77-42c1-89d7-0abaa7d8c428 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:05.019916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-77aaed66-de77-42c1-89d7-0abaa7d8c428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:05.032059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1171/2378] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 10:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:05.055862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b945fb-594a-49c5-8cf1-7a33ffa566a8 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:05.072605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b945fb-594a-49c5-8cf1-7a33ffa566a8 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:05.079338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199305-d3b0-487a-998b-370e672bbcba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:05.081470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199305-d3b0-487a-998b-370e672bbcba service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:05.081470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199305-d3b0-487a-998b-370e672bbcba service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:05.081470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199305-d3b0-487a-998b-370e672bbcba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:05.095160 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07199305-d3b0-487a-998b-370e672bbcba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:05.096881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07199305-d3b0-487a-998b-370e672bbcba service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:05.110953 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1208/2379] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:09.488377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96324377-6d09-4818-a8af-9797c71fb77d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:09.488839 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96324377-6d09-4818-a8af-9797c71fb77d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:09.488957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96324377-6d09-4818-a8af-9797c71fb77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:09.541462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-96324377-6d09-4818-a8af-9797c71fb77d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:09.543111 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-96324377-6d09-4818-a8af-9797c71fb77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:09.554252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1172/2380] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 10:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:09.592370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199305-d3b0-487a-998b-370e672bbcba service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:09.611772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199305-d3b0-487a-998b-370e672bbcba service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:09.633156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee54aa-cf0b-4d87-950c-587972dec63c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:09.633847 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee54aa-cf0b-4d87-950c-587972dec63c service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:09.634157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee54aa-cf0b-4d87-950c-587972dec63c service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:09.634437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee54aa-cf0b-4d87-950c-587972dec63c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:09.644650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee54aa-cf0b-4d87-950c-587972dec63c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:09.646550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee54aa-cf0b-4d87-950c-587972dec63c service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:09.680576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1209/2381] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:15.788323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96324377-6d09-4818-a8af-9797c71fb77d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:15.800656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96324377-6d09-4818-a8af-9797c71fb77d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:15.804456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e83a8c-2834-4987-8f22-64e34b56cc23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:15.805076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e83a8c-2834-4987-8f22-64e34b56cc23 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:15.805357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e83a8c-2834-4987-8f22-64e34b56cc23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:15.805630 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e83a8c-2834-4987-8f22-64e34b56cc23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:15.807619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-57e83a8c-2834-4987-8f22-64e34b56cc23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:15.818269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e83a8c-2834-4987-8f22-64e34b56cc23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:15.820844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e83a8c-2834-4987-8f22-64e34b56cc23 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:15.829916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1173/2382] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:17.470771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee54aa-cf0b-4d87-950c-587972dec63c service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:17.485346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee54aa-cf0b-4d87-950c-587972dec63c service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:17.498491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f6a78-be79-4b23-861d-fc5d53bda9f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:17.499147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f6a78-be79-4b23-861d-fc5d53bda9f1 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:17.499424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f6a78-be79-4b23-861d-fc5d53bda9f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:17.499694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f6a78-be79-4b23-861d-fc5d53bda9f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:17.501696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7a0f6a78-be79-4b23-861d-fc5d53bda9f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:17.515795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f6a78-be79-4b23-861d-fc5d53bda9f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:17.517485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f6a78-be79-4b23-861d-fc5d53bda9f1 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:17.529701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1210/2383] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:24.951237 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e17fca-edce-47de-a3a9-a7beacda0c67 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:24.960015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e17fca-edce-47de-a3a9-a7beacda0c67 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:24.960015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e17fca-edce-47de-a3a9-a7beacda0c67 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:24.960015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1174/2384] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:51:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:51:24.969059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63b609-08ab-44b1-9634-7bac2c9576e9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:24.970716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63b609-08ab-44b1-9634-7bac2c9576e9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:24.971541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63b609-08ab-44b1-9634-7bac2c9576e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:24.989193 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=67 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:25.011750 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-eb63b609-08ab-44b1-9634-7bac2c9576e9 None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:25.013542 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-eb63b609-08ab-44b1-9634-7bac2c9576e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:25.032175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1211/2385] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:51:25.043627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e17fca-edce-47de-a3a9-a7beacda0c67 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:25.051240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-64e17fca-edce-47de-a3a9-a7beacda0c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:25.145573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e17fca-edce-47de-a3a9-a7beacda0c67 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:25.154021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a18da0-be47-48b9-b5ee-88dc9fa5df3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75138f08ea2b4813b095635d920599d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:25.154895 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a18da0-be47-48b9-b5ee-88dc9fa5df3c service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:25.155377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a18da0-be47-48b9-b5ee-88dc9fa5df3c service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:25.155928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a18da0-be47-48b9-b5ee-88dc9fa5df3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:25.183275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a18da0-be47-48b9-b5ee-88dc9fa5df3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:25.184926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a18da0-be47-48b9-b5ee-88dc9fa5df3c service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:25.200303 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1175/2386] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:25.471612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34912829-6b51-4fe6-9a14-72c1f30c5572 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:25.472150 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34912829-6b51-4fe6-9a14-72c1f30c5572 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:25.472442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34912829-6b51-4fe6-9a14-72c1f30c5572 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:25.474002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1212/2387] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:51:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:51:25.482224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c89ac4-933c-4e45-bbae-7d9eae116518 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:25.482487 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c89ac4-933c-4e45-bbae-7d9eae116518 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:25.482747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c89ac4-933c-4e45-bbae-7d9eae116518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:25.512454 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-51c89ac4-933c-4e45-bbae-7d9eae116518 None None] MFA Rules not processed for user `8956453f963242a087d2f90d70ed8f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:25.514444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-51c89ac4-933c-4e45-bbae-7d9eae116518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:25.525567 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1176/2388] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:51:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:51:25.555992 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34912829-6b51-4fe6-9a14-72c1f30c5572 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:25.578382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34912829-6b51-4fe6-9a14-72c1f30c5572 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:25.582714 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddbe21-ff23-4a6f-83be-33bf0d3728c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:25.583322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbe21-ff23-4a6f-83be-33bf0d3728c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:25.584144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbe21-ff23-4a6f-83be-33bf0d3728c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:25.587604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbe21-ff23-4a6f-83be-33bf0d3728c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:25.592576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddbe21-ff23-4a6f-83be-33bf0d3728c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:25.594014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddbe21-ff23-4a6f-83be-33bf0d3728c0 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:25.604070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1213/2389] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:25.730959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab294c9a-aed6-4af7-9890-cbf6c5938019 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:25.731252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab294c9a-aed6-4af7-9890-cbf6c5938019 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:25.731515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab294c9a-aed6-4af7-9890-cbf6c5938019 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:25.732950 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1177/2390] 10.222.0.91 () {54 vars in 921 bytes} [Wed Aug 24 10:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:51:25.739868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1fb7b-3879-46cb-864e-4c577a0329d1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:25.740269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1fb7b-3879-46cb-864e-4c577a0329d1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:25.741235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1fb7b-3879-46cb-864e-4c577a0329d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:25.761896 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-cea1fb7b-3879-46cb-864e-4c577a0329d1 None None] MFA Rules not processed for user `4ae21e13a4414168bd1741dfd642274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:25.763112 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cea1fb7b-3879-46cb-864e-4c577a0329d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:25.773846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1214/2391] 10.222.0.91 () {58 vars in 1018 bytes} [Wed Aug 24 10:51:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:25.785653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab294c9a-aed6-4af7-9890-cbf6c5938019 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:25.797898 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab294c9a-aed6-4af7-9890-cbf6c5938019 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:25.801914 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f40a1c-b563-4686-bf3d-1b57ea49038d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:25.802478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f40a1c-b563-4686-bf3d-1b57ea49038d service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:25.802759 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f40a1c-b563-4686-bf3d-1b57ea49038d service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:25.803001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f40a1c-b563-4686-bf3d-1b57ea49038d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:25.814427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f40a1c-b563-4686-bf3d-1b57ea49038d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:25.815962 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f40a1c-b563-4686-bf3d-1b57ea49038d service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:25.827008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1178/2392] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:51:28.720941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4ba64-b65d-4e85-a2f2-8edf1afa388b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:28.721733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4ba64-b65d-4e85-a2f2-8edf1afa388b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:28.721733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4ba64-b65d-4e85-a2f2-8edf1afa388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:28.746882 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b6e4ba64-b65d-4e85-a2f2-8edf1afa388b None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:28.748147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b6e4ba64-b65d-4e85-a2f2-8edf1afa388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:28.756540 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1215/2393] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:51:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:28.773653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f40a1c-b563-4686-bf3d-1b57ea49038d service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:28.787851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f40a1c-b563-4686-bf3d-1b57ea49038d service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:28.796188 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39f220-5c07-4d6c-8102-3359728dfc5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:28.797231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39f220-5c07-4d6c-8102-3359728dfc5e service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:28.797666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39f220-5c07-4d6c-8102-3359728dfc5e service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:28.798188 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39f220-5c07-4d6c-8102-3359728dfc5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:28.822410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39f220-5c07-4d6c-8102-3359728dfc5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:28.827470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39f220-5c07-4d6c-8102-3359728dfc5e service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:28.870719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1179/2394] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:51:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 10:51:29.909081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf8f13-75cc-4ac6-a40c-a66a5972018b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:29.909606 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf8f13-75cc-4ac6-a40c-a66a5972018b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:29.909606 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf8f13-75cc-4ac6-a40c-a66a5972018b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:29.965838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-eaaf8f13-75cc-4ac6-a40c-a66a5972018b None None] MFA Rules not processed for user `5ccf8ad84e9141d69df712cd5a8d14eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:29.968580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-eaaf8f13-75cc-4ac6-a40c-a66a5972018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:30.081009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1216/2395] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:51:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:38.846667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=61 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:40.071973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=39 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:45.988147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f8688-f19c-4759-8ef9-ab7a19c63b04 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:45.989009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f8688-f19c-4759-8ef9-ab7a19c63b04 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:45.989452 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f8688-f19c-4759-8ef9-ab7a19c63b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:46.014432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-142f8688-f19c-4759-8ef9-ab7a19c63b04 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:46.016090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-142f8688-f19c-4759-8ef9-ab7a19c63b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:46.026505 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1180/2396] 10.222.0.91 () {58 vars in 967 bytes} [Wed Aug 24 10:51:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:46.040473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf8f13-75cc-4ac6-a40c-a66a5972018b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:46.055042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf8f13-75cc-4ac6-a40c-a66a5972018b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:46.060611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b17ff-3fae-4f95-8203-8020f2d13e98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:46.061311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b17ff-3fae-4f95-8203-8020f2d13e98 service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:46.061662 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b17ff-3fae-4f95-8203-8020f2d13e98 service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:46.062010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b17ff-3fae-4f95-8203-8020f2d13e98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:46.071180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b17ff-3fae-4f95-8203-8020f2d13e98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:46.073156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b17ff-3fae-4f95-8203-8020f2d13e98 service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:46.082598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1217/2397] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:51:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:51:54.533783 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85c0b2-dd66-4ef7-b39f-48b8ee3fdae9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:54.534419 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85c0b2-dd66-4ef7-b39f-48b8ee3fdae9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:54.534419 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85c0b2-dd66-4ef7-b39f-48b8ee3fdae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:54.554571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7b85c0b2-dd66-4ef7-b39f-48b8ee3fdae9 None None] MFA Rules not processed for user `bb2ab51f75f84727831566a44db3d9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:54.555690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7b85c0b2-dd66-4ef7-b39f-48b8ee3fdae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:54.562717 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1181/2398] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:51:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:56.078822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:02.994169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21dc9e-1ab1-44bf-bff2-35440141330e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:02.994977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21dc9e-1ab1-44bf-bff2-35440141330e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:02.994977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21dc9e-1ab1-44bf-bff2-35440141330e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:03.025416 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3a21dc9e-1ab1-44bf-bff2-35440141330e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:03.027377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3a21dc9e-1ab1-44bf-bff2-35440141330e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:03.040915 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1218/2399] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 10:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:03.061089 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85c0b2-dd66-4ef7-b39f-48b8ee3fdae9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:03.084880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85c0b2-dd66-4ef7-b39f-48b8ee3fdae9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:03.090584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa79f5-3dd6-488a-8a45-f1fc8385ff1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:03.091202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa79f5-3dd6-488a-8a45-f1fc8385ff1b service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:03.091479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa79f5-3dd6-488a-8a45-f1fc8385ff1b service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:03.091772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa79f5-3dd6-488a-8a45-f1fc8385ff1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:03.103129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa79f5-3dd6-488a-8a45-f1fc8385ff1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:03.104879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa79f5-3dd6-488a-8a45-f1fc8385ff1b service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:03.117685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1182/2400] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:04.194680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21dc9e-1ab1-44bf-bff2-35440141330e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:04.205884 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21dc9e-1ab1-44bf-bff2-35440141330e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:04.211550 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7818f-470b-46d7-b6e9-592258dccaf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:04.212498 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7818f-470b-46d7-b6e9-592258dccaf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:04.213043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7818f-470b-46d7-b6e9-592258dccaf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:04.213457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7818f-470b-46d7-b6e9-592258dccaf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:04.216696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-aed7818f-470b-46d7-b6e9-592258dccaf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:04.241814 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7818f-470b-46d7-b6e9-592258dccaf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:04.244358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7818f-470b-46d7-b6e9-592258dccaf9 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:04.262121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1219/2401] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:06.932037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed34e7e-a55c-45f1-ba7d-547c6cb164dc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:06.932667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed34e7e-a55c-45f1-ba7d-547c6cb164dc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:06.933077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed34e7e-a55c-45f1-ba7d-547c6cb164dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:06.959557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-eed34e7e-a55c-45f1-ba7d-547c6cb164dc None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:06.960831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eed34e7e-a55c-45f1-ba7d-547c6cb164dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:06.972448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1183/2402] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 10:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:06.994324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7818f-470b-46d7-b6e9-592258dccaf9 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:07.010655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7818f-470b-46d7-b6e9-592258dccaf9 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:07.020433 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca08add-0730-4906-926e-b53255471e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:07.022598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca08add-0730-4906-926e-b53255471e33 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:07.022598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca08add-0730-4906-926e-b53255471e33 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:07.022598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca08add-0730-4906-926e-b53255471e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:07.033462 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca08add-0730-4906-926e-b53255471e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:07.035940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca08add-0730-4906-926e-b53255471e33 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:07.056045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1220/2403] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:08.411923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed34e7e-a55c-45f1-ba7d-547c6cb164dc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:08.414208 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eed34e7e-a55c-45f1-ba7d-547c6cb164dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:08.518403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed34e7e-a55c-45f1-ba7d-547c6cb164dc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:08.524818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87372d6f-e1ba-4ae2-a0ad-689179b6c27c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebfb233b2504463a4ee9202b5a3ab50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:08.525545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87372d6f-e1ba-4ae2-a0ad-689179b6c27c service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:08.525872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87372d6f-e1ba-4ae2-a0ad-689179b6c27c service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:08.526147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87372d6f-e1ba-4ae2-a0ad-689179b6c27c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:08.528041 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-87372d6f-e1ba-4ae2-a0ad-689179b6c27c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:08.541103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87372d6f-e1ba-4ae2-a0ad-689179b6c27c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:08.542990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87372d6f-e1ba-4ae2-a0ad-689179b6c27c service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:08.557340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1184/2404] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:08.586459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca08add-0730-4906-926e-b53255471e33 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:08.588644 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3ca08add-0730-4906-926e-b53255471e33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:08.607457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca08add-0730-4906-926e-b53255471e33 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:08.612852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9df55d-c15d-46e9-ac52-4d64a4f01258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:08.614234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9df55d-c15d-46e9-ac52-4d64a4f01258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:08.614710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9df55d-c15d-46e9-ac52-4d64a4f01258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:08.615446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9df55d-c15d-46e9-ac52-4d64a4f01258 admin admin] PATH_INFO: `/v3/users/ae1db5003ba24c71a7a68c68a74c7197` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:08.617124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9df55d-c15d-46e9-ac52-4d64a4f01258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1db5003ba24c71a7a68c68a74c7197)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:08.619103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9df55d-c15d-46e9-ac52-4d64a4f01258 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:09.033527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1f9df55d-c15d-46e9-ac52-4d64a4f01258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1db5003ba24c71a7a68c68a74c7197'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:09.060804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1f9df55d-c15d-46e9-ac52-4d64a4f01258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1db5003ba24c71a7a68c68a74c7197'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:09.229836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1f9df55d-c15d-46e9-ac52-4d64a4f01258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1db5003ba24c71a7a68c68a74c7197'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:09.230869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1f9df55d-c15d-46e9-ac52-4d64a4f01258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1db5003ba24c71a7a68c68a74c7197'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:09.231566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1f9df55d-c15d-46e9-ac52-4d64a4f01258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1db5003ba24c71a7a68c68a74c7197'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:09.259077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1221/2405] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:08 2022] DELETE /identity/v3/users/ae1db5003ba24c71a7a68c68a74c7197 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:09.878648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87372d6f-e1ba-4ae2-a0ad-689179b6c27c service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:09.885731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=48 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:09.898318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87372d6f-e1ba-4ae2-a0ad-689179b6c27c service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:10.016627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04509729-1613-4c6c-bf44-9f8fd42502c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:10.017757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04509729-1613-4c6c-bf44-9f8fd42502c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:10.018438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04509729-1613-4c6c-bf44-9f8fd42502c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:10.018749 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04509729-1613-4c6c-bf44-9f8fd42502c5 admin admin] PATH_INFO: `/v3/projects/8c9b9a4f5ddb477da493acd905e9bee1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:10.023702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04509729-1613-4c6c-bf44-9f8fd42502c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9b9a4f5ddb477da493acd905e9bee1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:10.028087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04509729-1613-4c6c-bf44-9f8fd42502c5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:10.189565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-04509729-1613-4c6c-bf44-9f8fd42502c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9b9a4f5ddb477da493acd905e9bee1', 'request_id': 'req-04509729-1613-4c6c-bf44-9f8fd42502c5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:10.200676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-04509729-1613-4c6c-bf44-9f8fd42502c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9b9a4f5ddb477da493acd905e9bee1', 'request_id': 'req-04509729-1613-4c6c-bf44-9f8fd42502c5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:10.317812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-04509729-1613-4c6c-bf44-9f8fd42502c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9b9a4f5ddb477da493acd905e9bee1', 'request_id': 'req-04509729-1613-4c6c-bf44-9f8fd42502c5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:10.329829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-04509729-1613-4c6c-bf44-9f8fd42502c5 admin admin] The token cache is being invalidate because project 8c9b9a4f5ddb477da493acd905e9bee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:10.330128 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-04509729-1613-4c6c-bf44-9f8fd42502c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:10.330921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-04509729-1613-4c6c-bf44-9f8fd42502c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:10.340259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e922e52-6630-4169-9209-20a92c354543 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:10.340846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e922e52-6630-4169-9209-20a92c354543 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:10.340846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e922e52-6630-4169-9209-20a92c354543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:10.343739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1185/2406] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:09 2022] DELETE /identity/v3/projects/8c9b9a4f5ddb477da493acd905e9bee1 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:10.368962 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6e922e52-6630-4169-9209-20a92c354543 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:10.371213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6e922e52-6630-4169-9209-20a92c354543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:10.473961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1222/2407] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:10.481157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44437-3306-4c49-bd6e-2ef6d3eae260 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:10.481436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44437-3306-4c49-bd6e-2ef6d3eae260 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:10.481710 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44437-3306-4c49-bd6e-2ef6d3eae260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:10.507515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-86a44437-3306-4c49-bd6e-2ef6d3eae260 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:10.508889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-86a44437-3306-4c49-bd6e-2ef6d3eae260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:10.519353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1186/2408] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:10.525609 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e922e52-6630-4169-9209-20a92c354543 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:10.544134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e922e52-6630-4169-9209-20a92c354543 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:10.552450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c8bf2-5f37-4b35-98f3-8f593e70dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:10.553131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c8bf2-5f37-4b35-98f3-8f593e70dff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:10.553411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c8bf2-5f37-4b35-98f3-8f593e70dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:10.553961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c8bf2-5f37-4b35-98f3-8f593e70dff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:10.554668 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c8bf2-5f37-4b35-98f3-8f593e70dff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:52:10.555179 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c8bf2-5f37-4b35-98f3-8f593e70dff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:10.557095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c8bf2-5f37-4b35-98f3-8f593e70dff3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:10.575773 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1223/2409] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:52:10.578321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a44437-3306-4c49-bd6e-2ef6d3eae260 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:10.595565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a44437-3306-4c49-bd6e-2ef6d3eae260 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:10.605003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dffe9-a95d-49cf-aca0-d9032b6b1f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:10.605618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dffe9-a95d-49cf-aca0-d9032b6b1f61 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:10.605890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dffe9-a95d-49cf-aca0-d9032b6b1f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:10.606157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dffe9-a95d-49cf-aca0-d9032b6b1f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:10.606768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dffe9-a95d-49cf-aca0-d9032b6b1f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:10.610765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dffe9-a95d-49cf-aca0-d9032b6b1f61 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:10.775019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1187/2410] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:10 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:10.777680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb15c-1056-4a2f-a5a7-cfaf3508ad8a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:10.777997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb15c-1056-4a2f-a5a7-cfaf3508ad8a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:10.783735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb15c-1056-4a2f-a5a7-cfaf3508ad8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:10.787658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dffe9-a95d-49cf-aca0-d9032b6b1f61 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:10.805633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-01adb15c-1056-4a2f-a5a7-cfaf3508ad8a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:10.806767 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-01adb15c-1056-4a2f-a5a7-cfaf3508ad8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:10.870705 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:10.876204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dffe9-a95d-49cf-aca0-d9032b6b1f61 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:10.883014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35ca00-58a5-4d7e-84ef-333907ce5d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:10.883692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35ca00-58a5-4d7e-84ef-333907ce5d5b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:10.883932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35ca00-58a5-4d7e-84ef-333907ce5d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:10.884183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35ca00-58a5-4d7e-84ef-333907ce5d5b admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:10.884829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35ca00-58a5-4d7e-84ef-333907ce5d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:10.886883 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35ca00-58a5-4d7e-84ef-333907ce5d5b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:10.900143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:10.943521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1224/2411] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 10:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:10.965676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adb15c-1056-4a2f-a5a7-cfaf3508ad8a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:10.967401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-01adb15c-1056-4a2f-a5a7-cfaf3508ad8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:10.991685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1188/2412] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:10 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:10.995321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35ca00-58a5-4d7e-84ef-333907ce5d5b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:11.019000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35ca00-58a5-4d7e-84ef-333907ce5d5b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:11.039333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab7552-7276-4037-9044-4785cd2cc933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:11.040002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab7552-7276-4037-9044-4785cd2cc933 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:11.040279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab7552-7276-4037-9044-4785cd2cc933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:11.040552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab7552-7276-4037-9044-4785cd2cc933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:11.041274 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab7552-7276-4037-9044-4785cd2cc933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:11.042951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab7552-7276-4037-9044-4785cd2cc933 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:11.065925 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1189/2413] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:52:11.070071 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab7552-7276-4037-9044-4785cd2cc933 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:11.094653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab7552-7276-4037-9044-4785cd2cc933 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:11.103367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3db51b-d84c-42c4-9016-744ea2afc360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:11.104388 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db51b-d84c-42c4-9016-744ea2afc360 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:11.104698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db51b-d84c-42c4-9016-744ea2afc360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:11.105403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db51b-d84c-42c4-9016-744ea2afc360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:11.105811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3db51b-d84c-42c4-9016-744ea2afc360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:11.107991 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3db51b-d84c-42c4-9016-744ea2afc360 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:11.128211 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1190/2414] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:11.133180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3db51b-d84c-42c4-9016-744ea2afc360 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:11.146942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adb15c-1056-4a2f-a5a7-cfaf3508ad8a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:11.151516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3db51b-d84c-42c4-9016-744ea2afc360 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:11.156383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8de639-6e58-42aa-b613-16469d74a970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:11.157032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8de639-6e58-42aa-b613-16469d74a970 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:11.157319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8de639-6e58-42aa-b613-16469d74a970 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:11.157699 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8de639-6e58-42aa-b613-16469d74a970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:11.161219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cf466-2977-4862-a800-86ed8986e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:11.162526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cf466-2977-4862-a800-86ed8986e00a admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:11.162821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cf466-2977-4862-a800-86ed8986e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:11.163104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cf466-2977-4862-a800-86ed8986e00a admin admin] PATH_INFO: `/v3/projects/b608254199304ef7b69f0eb2076ce523/users/c9ff0ef6170f469693250d80671f96da/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:11.184471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8de639-6e58-42aa-b613-16469d74a970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:11.185344 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cf466-2977-4862-a800-86ed8986e00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b608254199304ef7b69f0eb2076ce523, user_id=c9ff0ef6170f469693250d80671f96da, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:11.188499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cf466-2977-4862-a800-86ed8986e00a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:11.195216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8de639-6e58-42aa-b613-16469d74a970 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:11.215798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1225/2415] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:11.280691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1191/2416] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:11 2022] PUT /identity/v3/projects/b608254199304ef7b69f0eb2076ce523/users/c9ff0ef6170f469693250d80671f96da/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:11.283289 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cca82-8bf9-42d3-9284-edb59a808e7d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:11.283926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cca82-8bf9-42d3-9284-edb59a808e7d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:11.284515 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cca82-8bf9-42d3-9284-edb59a808e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:11.338996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1a1cca82-8bf9-42d3-9284-edb59a808e7d None None] MFA Rules not processed for user `c9ff0ef6170f469693250d80671f96da`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:11.340596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1a1cca82-8bf9-42d3-9284-edb59a808e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:11.449934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1226/2417] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:11.469074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cf466-2977-4862-a800-86ed8986e00a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:11.471271 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-003cf466-2977-4862-a800-86ed8986e00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:11.589616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cf466-2977-4862-a800-86ed8986e00a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:11.599844 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce731308-feef-4755-b9fe-5418a90e9a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:11.601024 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce731308-feef-4755-b9fe-5418a90e9a07 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:11.601311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce731308-feef-4755-b9fe-5418a90e9a07 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:11.602462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce731308-feef-4755-b9fe-5418a90e9a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:11.613163 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce731308-feef-4755-b9fe-5418a90e9a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:11.615284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce731308-feef-4755-b9fe-5418a90e9a07 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:11.630542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1192/2418] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:52:15.095189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f84a6f-95cd-4c8b-99d2-8483ad128896 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:15.095828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f84a6f-95cd-4c8b-99d2-8483ad128896 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:15.096091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f84a6f-95cd-4c8b-99d2-8483ad128896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:15.119995 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-21f84a6f-95cd-4c8b-99d2-8483ad128896 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:15.121625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-21f84a6f-95cd-4c8b-99d2-8483ad128896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:15.170561 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:15.199645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1227/2419] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:15.222102 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce731308-feef-4755-b9fe-5418a90e9a07 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:15.234764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce731308-feef-4755-b9fe-5418a90e9a07 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:15.242549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663ac4-340c-4cc2-8def-fc127d8e9322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:15.243169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663ac4-340c-4cc2-8def-fc127d8e9322 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:15.243447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663ac4-340c-4cc2-8def-fc127d8e9322 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:15.243747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663ac4-340c-4cc2-8def-fc127d8e9322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:15.257652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d663ac4-340c-4cc2-8def-fc127d8e9322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:15.259284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d663ac4-340c-4cc2-8def-fc127d8e9322 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:15.270715 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1193/2420] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:18.090196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f84a6f-95cd-4c8b-99d2-8483ad128896 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:18.102571 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f84a6f-95cd-4c8b-99d2-8483ad128896 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:18.108081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:18.108736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:18.109015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:18.109291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] PATH_INFO: `/v3/users/c9ff0ef6170f469693250d80671f96da` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:18.110454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ff0ef6170f469693250d80671f96da)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:18.112452 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:18.355563 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ff0ef6170f469693250d80671f96da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:18.369968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ff0ef6170f469693250d80671f96da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:18.465669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ff0ef6170f469693250d80671f96da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:18.466390 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ff0ef6170f469693250d80671f96da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:18.467091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ff0ef6170f469693250d80671f96da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:18.486164 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1228/2421] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:18 2022] DELETE /identity/v3/users/c9ff0ef6170f469693250d80671f96da => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:18.493429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60520a-eaa1-4db1-b02c-20292a7bcfbf None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:18.494143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60520a-eaa1-4db1-b02c-20292a7bcfbf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:18.494143 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60520a-eaa1-4db1-b02c-20292a7bcfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:18.524440 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6e60520a-eaa1-4db1-b02c-20292a7bcfbf None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:18.525677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6e60520a-eaa1-4db1-b02c-20292a7bcfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:18.605042 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1194/2422] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:18.617780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:18.621947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:18.707916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01b6db-20c4-4544-9172-ef43f95a03da admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:18.711912 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a9f1a-527a-43db-8bcf-7d54f7681211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:18.712583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a9f1a-527a-43db-8bcf-7d54f7681211 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:18.712901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a9f1a-527a-43db-8bcf-7d54f7681211 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:18.713207 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a9f1a-527a-43db-8bcf-7d54f7681211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:18.724724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a9f1a-527a-43db-8bcf-7d54f7681211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:18.726204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a9f1a-527a-43db-8bcf-7d54f7681211 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:18.736560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1229/2423] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:52:19.256761 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60520a-eaa1-4db1-b02c-20292a7bcfbf None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:19.262106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6e60520a-eaa1-4db1-b02c-20292a7bcfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:19.281971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60520a-eaa1-4db1-b02c-20292a7bcfbf None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:19.290623 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a9dd0-792c-4ffa-9824-247a4675ba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:19.291545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a9dd0-792c-4ffa-9824-247a4675ba24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:19.292065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a9dd0-792c-4ffa-9824-247a4675ba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:19.292432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a9dd0-792c-4ffa-9824-247a4675ba24 admin admin] PATH_INFO: `/v3/projects/b608254199304ef7b69f0eb2076ce523` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:19.294127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a9dd0-792c-4ffa-9824-247a4675ba24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b608254199304ef7b69f0eb2076ce523)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:19.298254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a9dd0-792c-4ffa-9824-247a4675ba24 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:19.322125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:19.445947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8901eb-de73-40ee-8fd1-c082773c91b5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:19.446594 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8901eb-de73-40ee-8fd1-c082773c91b5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:19.446594 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8901eb-de73-40ee-8fd1-c082773c91b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:19.450012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-306a9dd0-792c-4ffa-9824-247a4675ba24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b608254199304ef7b69f0eb2076ce523', 'request_id': 'req-306a9dd0-792c-4ffa-9824-247a4675ba24'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:19.459870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-306a9dd0-792c-4ffa-9824-247a4675ba24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b608254199304ef7b69f0eb2076ce523', 'request_id': 'req-306a9dd0-792c-4ffa-9824-247a4675ba24'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:19.475232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2a8901eb-de73-40ee-8fd1-c082773c91b5 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:19.476574 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2a8901eb-de73-40ee-8fd1-c082773c91b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:19.538115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-306a9dd0-792c-4ffa-9824-247a4675ba24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b608254199304ef7b69f0eb2076ce523', 'request_id': 'req-306a9dd0-792c-4ffa-9824-247a4675ba24'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:19.551620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:19.559267 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-306a9dd0-792c-4ffa-9824-247a4675ba24 admin admin] The token cache is being invalidate because project b608254199304ef7b69f0eb2076ce523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:19.560432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-306a9dd0-792c-4ffa-9824-247a4675ba24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:19.560432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-306a9dd0-792c-4ffa-9824-247a4675ba24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:19.562550 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1195/2424] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:19 2022] DELETE /identity/v3/projects/b608254199304ef7b69f0eb2076ce523 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:19.567264 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aca0fe-d911-4d1f-b451-c2d433b2f6b7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:19.567577 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aca0fe-d911-4d1f-b451-c2d433b2f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:19.567894 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aca0fe-d911-4d1f-b451-c2d433b2f6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:19.571857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1230/2425] 10.222.0.59 () {58 vars in 1016 bytes} [Wed Aug 24 10:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:19.591691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e0aca0fe-d911-4d1f-b451-c2d433b2f6b7 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:19.593642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e0aca0fe-d911-4d1f-b451-c2d433b2f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:19.598303 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8901eb-de73-40ee-8fd1-c082773c91b5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:19.600436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2a8901eb-de73-40ee-8fd1-c082773c91b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:19.614997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1196/2426] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:19.617907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2b3cc-7469-4694-8006-6279c5a07e05 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:19.618381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2b3cc-7469-4694-8006-6279c5a07e05 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:19.618870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2b3cc-7469-4694-8006-6279c5a07e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:19.647687 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f8b2b3cc-7469-4694-8006-6279c5a07e05 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:19.648958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f8b2b3cc-7469-4694-8006-6279c5a07e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:19.657348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1197/2427] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:19.662289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2b3cc-7469-4694-8006-6279c5a07e05 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:19.672113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2b3cc-7469-4694-8006-6279c5a07e05 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:19.679316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8414bb-2a5e-4e65-88cd-05bba1ec7d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:19.680195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8414bb-2a5e-4e65-88cd-05bba1ec7d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:19.680680 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8414bb-2a5e-4e65-88cd-05bba1ec7d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:19.681046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8414bb-2a5e-4e65-88cd-05bba1ec7d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:19.681858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8414bb-2a5e-4e65-88cd-05bba1ec7d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:52:19.682314 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8414bb-2a5e-4e65-88cd-05bba1ec7d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:19.684328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8414bb-2a5e-4e65-88cd-05bba1ec7d0a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:19.699931 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1198/2428] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:52:19.704699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8414bb-2a5e-4e65-88cd-05bba1ec7d0a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:19.720483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8414bb-2a5e-4e65-88cd-05bba1ec7d0a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:19.727025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5479-1d88-4444-8989-5968a3c2c189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:19.727638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8901eb-de73-40ee-8fd1-c082773c91b5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:19.729286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5479-1d88-4444-8989-5968a3c2c189 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:19.729286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5479-1d88-4444-8989-5968a3c2c189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:19.729286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5479-1d88-4444-8989-5968a3c2c189 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:19.729286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d5479-1d88-4444-8989-5968a3c2c189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:19.732098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d5479-1d88-4444-8989-5968a3c2c189 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:19.737556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1a9a2-2726-4b09-b74e-287db71de97d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:19.740216 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1a9a2-2726-4b09-b74e-287db71de97d service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:19.740693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1a9a2-2726-4b09-b74e-287db71de97d service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:19.741166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1a9a2-2726-4b09-b74e-287db71de97d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:19.759162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1a9a2-2726-4b09-b74e-287db71de97d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:19.762180 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1a9a2-2726-4b09-b74e-287db71de97d service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:19.777183 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1231/2429] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:19.845718 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1199/2430] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:19 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:19.851686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1a9a2-2726-4b09-b74e-287db71de97d service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:19.866696 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1a9a2-2726-4b09-b74e-287db71de97d service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:19.936861 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189d0b2-d925-4f03-b79b-04d577b5818b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:19.937479 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189d0b2-d925-4f03-b79b-04d577b5818b admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:19.937757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189d0b2-d925-4f03-b79b-04d577b5818b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:19.938063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189d0b2-d925-4f03-b79b-04d577b5818b admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:19.938703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189d0b2-d925-4f03-b79b-04d577b5818b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:19.940686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189d0b2-d925-4f03-b79b-04d577b5818b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:20.026948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1232/2431] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:19 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:20.032984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5479-1d88-4444-8989-5968a3c2c189 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:20.048454 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5479-1d88-4444-8989-5968a3c2c189 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:20.054665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d74cf5-20bc-4076-9677-f4c38ca47df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:20.055282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d74cf5-20bc-4076-9677-f4c38ca47df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:20.055555 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d74cf5-20bc-4076-9677-f4c38ca47df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:20.055938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d74cf5-20bc-4076-9677-f4c38ca47df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:20.056591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d74cf5-20bc-4076-9677-f4c38ca47df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:20.058223 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d74cf5-20bc-4076-9677-f4c38ca47df5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:20.072672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1200/2432] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:20.076803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189d0b2-d925-4f03-b79b-04d577b5818b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:20.088740 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189d0b2-d925-4f03-b79b-04d577b5818b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:20.093768 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96fd5b-686a-4582-a803-7a6d29e8bffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:20.094378 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96fd5b-686a-4582-a803-7a6d29e8bffb admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:20.094654 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96fd5b-686a-4582-a803-7a6d29e8bffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:20.094947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96fd5b-686a-4582-a803-7a6d29e8bffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:20.095597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96fd5b-686a-4582-a803-7a6d29e8bffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:20.097262 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96fd5b-686a-4582-a803-7a6d29e8bffb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:20.109155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1233/2433] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:20.114406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d74cf5-20bc-4076-9677-f4c38ca47df5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:20.125522 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d74cf5-20bc-4076-9677-f4c38ca47df5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:20.133631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b480c-246a-42af-a655-6404f8ed02e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:20.134297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b480c-246a-42af-a655-6404f8ed02e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:20.134613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b480c-246a-42af-a655-6404f8ed02e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:20.134905 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b480c-246a-42af-a655-6404f8ed02e1 admin admin] PATH_INFO: `/v3/projects/32a0cce570784ec4ac21908b478cd743/users/063188f961364809aaf17d5b0ddf93c6/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:20.156121 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b480c-246a-42af-a655-6404f8ed02e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a0cce570784ec4ac21908b478cd743, user_id=063188f961364809aaf17d5b0ddf93c6, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:20.158951 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b480c-246a-42af-a655-6404f8ed02e1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:20.370410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1201/2434] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:20 2022] PUT /identity/v3/projects/32a0cce570784ec4ac21908b478cd743/users/063188f961364809aaf17d5b0ddf93c6/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:20.383466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d9bbb-b13c-45f6-a2f2-1fcbeb703fe5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:20.383887 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d9bbb-b13c-45f6-a2f2-1fcbeb703fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:20.384244 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d9bbb-b13c-45f6-a2f2-1fcbeb703fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:20.415983 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d16d9bbb-b13c-45f6-a2f2-1fcbeb703fe5 None None] MFA Rules not processed for user `063188f961364809aaf17d5b0ddf93c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:20.417365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d16d9bbb-b13c-45f6-a2f2-1fcbeb703fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:20.479278 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:20.500127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1234/2435] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:20.506953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b480c-246a-42af-a655-6404f8ed02e1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:20.605399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b480c-246a-42af-a655-6404f8ed02e1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:20.611602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab188-c25d-4405-8c7d-151e18e402ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:20.613572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab188-c25d-4405-8c7d-151e18e402ee admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:20.615088 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab188-c25d-4405-8c7d-151e18e402ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:20.615800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab188-c25d-4405-8c7d-151e18e402ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:20.618294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ab188-c25d-4405-8c7d-151e18e402ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:20.620986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ab188-c25d-4405-8c7d-151e18e402ee admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:20.707856 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1202/2436] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:20 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:20.714144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d9bbb-b13c-45f6-a2f2-1fcbeb703fe5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:20.729437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d9bbb-b13c-45f6-a2f2-1fcbeb703fe5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:20.820410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a71d4-eae4-45bd-8a1a-05faeb717eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:20.821246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a71d4-eae4-45bd-8a1a-05faeb717eaf admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:20.821527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a71d4-eae4-45bd-8a1a-05faeb717eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:20.821800 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a71d4-eae4-45bd-8a1a-05faeb717eaf admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:20.822460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a71d4-eae4-45bd-8a1a-05faeb717eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:20.824500 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a71d4-eae4-45bd-8a1a-05faeb717eaf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:20.943890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1235/2437] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:20 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:20.948708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab188-c25d-4405-8c7d-151e18e402ee admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:20.958973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:20.963399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab188-c25d-4405-8c7d-151e18e402ee admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:20.968721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d850954-1eec-4fe9-9285-cd7922d28eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:20.969361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850954-1eec-4fe9-9285-cd7922d28eed admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:20.969619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850954-1eec-4fe9-9285-cd7922d28eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:20.969896 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850954-1eec-4fe9-9285-cd7922d28eed admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:20.970545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d850954-1eec-4fe9-9285-cd7922d28eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:20.972632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d850954-1eec-4fe9-9285-cd7922d28eed admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:20.984330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1203/2438] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:20.988956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a71d4-eae4-45bd-8a1a-05faeb717eaf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:21.001407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a71d4-eae4-45bd-8a1a-05faeb717eaf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:21.006990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360a2a8-3ffb-46ef-b535-304c9aa80911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:21.007611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360a2a8-3ffb-46ef-b535-304c9aa80911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:21.007934 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360a2a8-3ffb-46ef-b535-304c9aa80911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:21.008209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360a2a8-3ffb-46ef-b535-304c9aa80911 admin admin] PATH_INFO: `/v3/projects/aaec8b096b164f81a41dc867c3a1fba9/users/c2269408e3e74645bf7bc55ed4de4875/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:21.026891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360a2a8-3ffb-46ef-b535-304c9aa80911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaec8b096b164f81a41dc867c3a1fba9, user_id=c2269408e3e74645bf7bc55ed4de4875, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:21.030205 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360a2a8-3ffb-46ef-b535-304c9aa80911 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:21.127665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1236/2439] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:20 2022] PUT /identity/v3/projects/aaec8b096b164f81a41dc867c3a1fba9/users/c2269408e3e74645bf7bc55ed4de4875/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:21.133774 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d850954-1eec-4fe9-9285-cd7922d28eed admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:21.146572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d850954-1eec-4fe9-9285-cd7922d28eed admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:21.215801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32589553-f6df-48c7-9e58-d75ca9699552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:21.216327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32589553-f6df-48c7-9e58-d75ca9699552 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:21.216607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32589553-f6df-48c7-9e58-d75ca9699552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:21.216882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32589553-f6df-48c7-9e58-d75ca9699552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:21.217561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32589553-f6df-48c7-9e58-d75ca9699552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:21.219393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32589553-f6df-48c7-9e58-d75ca9699552 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:21.230729 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1204/2440] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:21.242507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360a2a8-3ffb-46ef-b535-304c9aa80911 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:21.255538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360a2a8-3ffb-46ef-b535-304c9aa80911 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:21.262295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ab1e2-5ac5-49ce-9cc2-be761b3384e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:21.263060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ab1e2-5ac5-49ce-9cc2-be761b3384e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:21.263401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ab1e2-5ac5-49ce-9cc2-be761b3384e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:21.263739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ab1e2-5ac5-49ce-9cc2-be761b3384e4 admin admin] PATH_INFO: `/v3/projects/aaec8b096b164f81a41dc867c3a1fba9/users/c2269408e3e74645bf7bc55ed4de4875/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:21.265907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ab1e2-5ac5-49ce-9cc2-be761b3384e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaec8b096b164f81a41dc867c3a1fba9, user_id=c2269408e3e74645bf7bc55ed4de4875, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:21.268822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ab1e2-5ac5-49ce-9cc2-be761b3384e4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:21.292000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1237/2441] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:21 2022] PUT /identity/v3/projects/aaec8b096b164f81a41dc867c3a1fba9/users/c2269408e3e74645bf7bc55ed4de4875/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:21.305246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c091d-ff8e-4bd1-aa6c-f687e6a417b5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:21.305643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c091d-ff8e-4bd1-aa6c-f687e6a417b5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:21.305976 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c091d-ff8e-4bd1-aa6c-f687e6a417b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:21.345006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a75c091d-ff8e-4bd1-aa6c-f687e6a417b5 None None] MFA Rules not processed for user `c2269408e3e74645bf7bc55ed4de4875`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:21.347086 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a75c091d-ff8e-4bd1-aa6c-f687e6a417b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:21.454846 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1205/2442] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:21.475685 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ab1e2-5ac5-49ce-9cc2-be761b3384e4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:21.485762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e17ab1e2-5ac5-49ce-9cc2-be761b3384e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:21.555215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ab1e2-5ac5-49ce-9cc2-be761b3384e4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:21.558853 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132361a9-18e3-49b3-8146-383b7bd30fbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:21.559460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132361a9-18e3-49b3-8146-383b7bd30fbd service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:21.559767 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132361a9-18e3-49b3-8146-383b7bd30fbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:21.560067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132361a9-18e3-49b3-8146-383b7bd30fbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:21.572348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132361a9-18e3-49b3-8146-383b7bd30fbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:21.573817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132361a9-18e3-49b3-8146-383b7bd30fbd service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:21.585877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1238/2443] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:22.794355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c091d-ff8e-4bd1-aa6c-f687e6a417b5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:22.881074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c091d-ff8e-4bd1-aa6c-f687e6a417b5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:22.888067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:22.888724 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:22.889001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:22.889279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] PATH_INFO: `/v3/users/063188f961364809aaf17d5b0ddf93c6` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:22.890572 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063188f961364809aaf17d5b0ddf93c6)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:22.892613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:22.927444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:23.188326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063188f961364809aaf17d5b0ddf93c6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:23.189037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063188f961364809aaf17d5b0ddf93c6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:23.202007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063188f961364809aaf17d5b0ddf93c6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:23.210832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063188f961364809aaf17d5b0ddf93c6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:23.211651 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063188f961364809aaf17d5b0ddf93c6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:23.309607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1206/2444] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:22 2022] DELETE /identity/v3/users/063188f961364809aaf17d5b0ddf93c6 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:23.314954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2cec1-28d5-4b7b-91a1-211cd0288a54 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:23.315823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2cec1-28d5-4b7b-91a1-211cd0288a54 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:23.315823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2cec1-28d5-4b7b-91a1-211cd0288a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:23.338501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dfc2cec1-28d5-4b7b-91a1-211cd0288a54 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:23.340201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dfc2cec1-28d5-4b7b-91a1-211cd0288a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:23.395222 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:23.418695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1239/2445] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:23.429412 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:23.431056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:23.508664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ad580-9707-4c82-8149-cd3f45cf7658 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:23.512795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c77ef-1e1a-4b3a-b80e-93f2dd60bbff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:23.513416 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c77ef-1e1a-4b3a-b80e-93f2dd60bbff service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:23.513701 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c77ef-1e1a-4b3a-b80e-93f2dd60bbff service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:23.514004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c77ef-1e1a-4b3a-b80e-93f2dd60bbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:23.525695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c77ef-1e1a-4b3a-b80e-93f2dd60bbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:23.527202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c77ef-1e1a-4b3a-b80e-93f2dd60bbff service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:23.540344 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1207/2446] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:24.065803 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2cec1-28d5-4b7b-91a1-211cd0288a54 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:24.068082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dfc2cec1-28d5-4b7b-91a1-211cd0288a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:24.102995 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2cec1-28d5-4b7b-91a1-211cd0288a54 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:24.108234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:24.108903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:24.109186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:24.109464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] PATH_INFO: `/v3/projects/32a0cce570784ec4ac21908b478cd743` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:24.110835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a0cce570784ec4ac21908b478cd743)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:24.113422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:24.278064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a0cce570784ec4ac21908b478cd743', 'request_id': 'req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:24.286915 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a0cce570784ec4ac21908b478cd743', 'request_id': 'req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:24.403442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a0cce570784ec4ac21908b478cd743', 'request_id': 'req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:24.418549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] The token cache is being invalidate because project 32a0cce570784ec4ac21908b478cd743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:24.418549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:24.418549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:24.421140 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1240/2447] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:24 2022] DELETE /identity/v3/projects/32a0cce570784ec4ac21908b478cd743 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:24.426618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c77ef-1e1a-4b3a-b80e-93f2dd60bbff service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:24.437316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c77ef-1e1a-4b3a-b80e-93f2dd60bbff service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:24.508068 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba17a2b-869b-4db2-94ef-4b285764b9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:24.508731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba17a2b-869b-4db2-94ef-4b285764b9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:24.509045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba17a2b-869b-4db2-94ef-4b285764b9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:24.509328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba17a2b-869b-4db2-94ef-4b285764b9a3 admin admin] PATH_INFO: `/v3/users/c2269408e3e74645bf7bc55ed4de4875` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:24.510642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba17a2b-869b-4db2-94ef-4b285764b9a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2269408e3e74645bf7bc55ed4de4875)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:24.512831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba17a2b-869b-4db2-94ef-4b285764b9a3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:24.724071 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:24.730842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-aba17a2b-869b-4db2-94ef-4b285764b9a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2269408e3e74645bf7bc55ed4de4875'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:24.731529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-aba17a2b-869b-4db2-94ef-4b285764b9a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2269408e3e74645bf7bc55ed4de4875'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:24.744948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-aba17a2b-869b-4db2-94ef-4b285764b9a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2269408e3e74645bf7bc55ed4de4875'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:24.751881 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-aba17a2b-869b-4db2-94ef-4b285764b9a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2269408e3e74645bf7bc55ed4de4875'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:24.752863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-aba17a2b-869b-4db2-94ef-4b285764b9a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2269408e3e74645bf7bc55ed4de4875'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:24.827126 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1208/2448] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:24 2022] DELETE /identity/v3/users/c2269408e3e74645bf7bc55ed4de4875 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:25.299918 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:25.302147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:25.322417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318c04a-67eb-4ccf-9ab2-dd2bc3a016da admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:25.404833 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e8243-3e62-496a-abaa-c09f2a683eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:25.405535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e8243-3e62-496a-abaa-c09f2a683eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:25.405729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e8243-3e62-496a-abaa-c09f2a683eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:25.406007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e8243-3e62-496a-abaa-c09f2a683eec admin admin] PATH_INFO: `/v3/projects/aaec8b096b164f81a41dc867c3a1fba9` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:25.407166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e8243-3e62-496a-abaa-c09f2a683eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaec8b096b164f81a41dc867c3a1fba9)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:25.409132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e8243-3e62-496a-abaa-c09f2a683eec admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:25.569593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c41e8243-3e62-496a-abaa-c09f2a683eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaec8b096b164f81a41dc867c3a1fba9', 'request_id': 'req-c41e8243-3e62-496a-abaa-c09f2a683eec'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:25.576830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c41e8243-3e62-496a-abaa-c09f2a683eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaec8b096b164f81a41dc867c3a1fba9', 'request_id': 'req-c41e8243-3e62-496a-abaa-c09f2a683eec'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:25.663260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c41e8243-3e62-496a-abaa-c09f2a683eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaec8b096b164f81a41dc867c3a1fba9', 'request_id': 'req-c41e8243-3e62-496a-abaa-c09f2a683eec'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:25.672144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:25.677000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c41e8243-3e62-496a-abaa-c09f2a683eec admin admin] The token cache is being invalidate because project aaec8b096b164f81a41dc867c3a1fba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:25.677317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c41e8243-3e62-496a-abaa-c09f2a683eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:25.678004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c41e8243-3e62-496a-abaa-c09f2a683eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:25.679678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1241/2449] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:25 2022] DELETE /identity/v3/projects/aaec8b096b164f81a41dc867c3a1fba9 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:25.685229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810080a-d044-491b-83d2-3f0d2ab16051 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:25.685781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810080a-d044-491b-83d2-3f0d2ab16051 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:25.685781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810080a-d044-491b-83d2-3f0d2ab16051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:25.708049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e810080a-d044-491b-83d2-3f0d2ab16051 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:25.709290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e810080a-d044-491b-83d2-3f0d2ab16051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:25.781022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1209/2450] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:25.795911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a67b5-80c9-42f2-9a3e-b2ee2b0cefd0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:25.796201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a67b5-80c9-42f2-9a3e-b2ee2b0cefd0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:25.796486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a67b5-80c9-42f2-9a3e-b2ee2b0cefd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:25.825103 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ae8a67b5-80c9-42f2-9a3e-b2ee2b0cefd0 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:25.826238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ae8a67b5-80c9-42f2-9a3e-b2ee2b0cefd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:25.839124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1242/2451] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:25.844346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810080a-d044-491b-83d2-3f0d2ab16051 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:25.856998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810080a-d044-491b-83d2-3f0d2ab16051 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:25.863897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11874d84-7981-4955-975e-a227e88a842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:25.865104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11874d84-7981-4955-975e-a227e88a842f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:25.865571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11874d84-7981-4955-975e-a227e88a842f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:25.866000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11874d84-7981-4955-975e-a227e88a842f admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:25.867114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11874d84-7981-4955-975e-a227e88a842f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:52:25.867584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11874d84-7981-4955-975e-a227e88a842f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:25.870238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11874d84-7981-4955-975e-a227e88a842f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:25.883423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1210/2452] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:52:25.888352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a67b5-80c9-42f2-9a3e-b2ee2b0cefd0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:25.899899 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a67b5-80c9-42f2-9a3e-b2ee2b0cefd0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:25.907608 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2323e0-e68e-4728-8f0e-4cf737c73c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:25.908295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2323e0-e68e-4728-8f0e-4cf737c73c3c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:25.908576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2323e0-e68e-4728-8f0e-4cf737c73c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:25.908850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2323e0-e68e-4728-8f0e-4cf737c73c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:25.909513 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2323e0-e68e-4728-8f0e-4cf737c73c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:25.912279 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2323e0-e68e-4728-8f0e-4cf737c73c3c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:26.094807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1243/2453] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:25 2022] POST /identity/v3/projects => generated 369 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:26.099396 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11874d84-7981-4955-975e-a227e88a842f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:26.110573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11874d84-7981-4955-975e-a227e88a842f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:26.179217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8782fe3-e0a9-4acd-9faa-cfc3425d9d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:26.179917 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8782fe3-e0a9-4acd-9faa-cfc3425d9d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:26.180201 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8782fe3-e0a9-4acd-9faa-cfc3425d9d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:26.180518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8782fe3-e0a9-4acd-9faa-cfc3425d9d7c admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:26.181157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8782fe3-e0a9-4acd-9faa-cfc3425d9d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:26.183160 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8782fe3-e0a9-4acd-9faa-cfc3425d9d7c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:26.275873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1211/2454] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:26 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:26.280259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2323e0-e68e-4728-8f0e-4cf737c73c3c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:26.294369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2323e0-e68e-4728-8f0e-4cf737c73c3c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:26.299335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10877f4-c76d-45ee-908a-dcd30b82fbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:26.301510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10877f4-c76d-45ee-908a-dcd30b82fbff admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:26.302334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10877f4-c76d-45ee-908a-dcd30b82fbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:26.302595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10877f4-c76d-45ee-908a-dcd30b82fbff admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:26.303808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10877f4-c76d-45ee-908a-dcd30b82fbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:26.306704 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10877f4-c76d-45ee-908a-dcd30b82fbff admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:26.318486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1244/2455] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:52:26.323120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8782fe3-e0a9-4acd-9faa-cfc3425d9d7c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:26.334715 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8782fe3-e0a9-4acd-9faa-cfc3425d9d7c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:26.339431 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69415f6c-98d8-4793-b5bb-38a1081ae0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:26.340085 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69415f6c-98d8-4793-b5bb-38a1081ae0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:26.340365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69415f6c-98d8-4793-b5bb-38a1081ae0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:26.340636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69415f6c-98d8-4793-b5bb-38a1081ae0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:26.341321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69415f6c-98d8-4793-b5bb-38a1081ae0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:26.342943 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69415f6c-98d8-4793-b5bb-38a1081ae0c6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:26.355261 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1212/2456] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:26.361047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10877f4-c76d-45ee-908a-dcd30b82fbff admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:26.372035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10877f4-c76d-45ee-908a-dcd30b82fbff admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:26.376827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b542a-676f-4d69-95d6-0adc298ff1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:26.377486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b542a-676f-4d69-95d6-0adc298ff1af admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:26.377768 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b542a-676f-4d69-95d6-0adc298ff1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:26.378044 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b542a-676f-4d69-95d6-0adc298ff1af admin admin] PATH_INFO: `/v3/projects/a73ace06b4114bcfaae47b4c6ad0161c/users/ee501bdd231848228a99540e995855eb/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:26.395162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b542a-676f-4d69-95d6-0adc298ff1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73ace06b4114bcfaae47b4c6ad0161c, user_id=ee501bdd231848228a99540e995855eb, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:26.397921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b542a-676f-4d69-95d6-0adc298ff1af admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:26.509363 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1245/2457] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:26 2022] PUT /identity/v3/projects/a73ace06b4114bcfaae47b4c6ad0161c/users/ee501bdd231848228a99540e995855eb/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:26.525308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7254ab-1fc8-4c38-a0b1-37ac2709ea31 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:26.525599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7254ab-1fc8-4c38-a0b1-37ac2709ea31 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:26.525873 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7254ab-1fc8-4c38-a0b1-37ac2709ea31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:26.557211 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9a7254ab-1fc8-4c38-a0b1-37ac2709ea31 None None] MFA Rules not processed for user `ee501bdd231848228a99540e995855eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:26.558431 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9a7254ab-1fc8-4c38-a0b1-37ac2709ea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:26.567937 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:26.623136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1213/2458] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:26.627856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b542a-676f-4d69-95d6-0adc298ff1af admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:26.692172 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b542a-676f-4d69-95d6-0adc298ff1af admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:26.696897 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0f354-850f-41ea-be5c-11bc369b9804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:26.697503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0f354-850f-41ea-be5c-11bc369b9804 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:26.697784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0f354-850f-41ea-be5c-11bc369b9804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:26.698063 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0f354-850f-41ea-be5c-11bc369b9804 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:26.698717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0f354-850f-41ea-be5c-11bc369b9804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:26.700679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0f354-850f-41ea-be5c-11bc369b9804 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:26.838607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1246/2459] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:26 2022] POST /identity/v3/projects => generated 369 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:26.842930 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7254ab-1fc8-4c38-a0b1-37ac2709ea31 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:26.855472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7254ab-1fc8-4c38-a0b1-37ac2709ea31 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:26.929914 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ab2d4-7639-46be-b003-661c2531d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:26.930659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ab2d4-7639-46be-b003-661c2531d7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:26.930965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ab2d4-7639-46be-b003-661c2531d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:26.931332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ab2d4-7639-46be-b003-661c2531d7b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:26.932086 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ab2d4-7639-46be-b003-661c2531d7b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:26.934343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ab2d4-7639-46be-b003-661c2531d7b4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:27.077807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1214/2460] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:26 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:27.082123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0f354-850f-41ea-be5c-11bc369b9804 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:27.093065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0f354-850f-41ea-be5c-11bc369b9804 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:27.098028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2f323-03fb-4ca6-ac87-55acb62167ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:27.098687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2f323-03fb-4ca6-ac87-55acb62167ec admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:27.098963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2f323-03fb-4ca6-ac87-55acb62167ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:27.099236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2f323-03fb-4ca6-ac87-55acb62167ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:27.100045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2f323-03fb-4ca6-ac87-55acb62167ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:27.101792 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2f323-03fb-4ca6-ac87-55acb62167ec admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:27.116333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1247/2461] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:27.120697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ab2d4-7639-46be-b003-661c2531d7b4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:27.132913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ab2d4-7639-46be-b003-661c2531d7b4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:27.138107 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b46da-fa7e-4857-b158-0856d5217eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:27.138835 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b46da-fa7e-4857-b158-0856d5217eae admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:27.139114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b46da-fa7e-4857-b158-0856d5217eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:27.139420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b46da-fa7e-4857-b158-0856d5217eae admin admin] PATH_INFO: `/v3/projects/0d37449a93dc42b1a6ee282e6486bb15/users/035acccfaefe41a1bf09a48a2249a300/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:27.155901 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b46da-fa7e-4857-b158-0856d5217eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d37449a93dc42b1a6ee282e6486bb15, user_id=035acccfaefe41a1bf09a48a2249a300, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:27.158695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b46da-fa7e-4857-b158-0856d5217eae admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:27.227511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1215/2462] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:27 2022] PUT /identity/v3/projects/0d37449a93dc42b1a6ee282e6486bb15/users/035acccfaefe41a1bf09a48a2249a300/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:27.233686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2f323-03fb-4ca6-ac87-55acb62167ec admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:27.245273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2f323-03fb-4ca6-ac87-55acb62167ec admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:27.313250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd5d7b-4125-44c2-a679-5a211ba28c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:27.314256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd5d7b-4125-44c2-a679-5a211ba28c10 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:27.314618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd5d7b-4125-44c2-a679-5a211ba28c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:27.315053 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd5d7b-4125-44c2-a679-5a211ba28c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:27.316414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd5d7b-4125-44c2-a679-5a211ba28c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:27.318538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd5d7b-4125-44c2-a679-5a211ba28c10 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:27.329215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1248/2463] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:52:27.334716 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b46da-fa7e-4857-b158-0856d5217eae admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:27.354277 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b46da-fa7e-4857-b158-0856d5217eae admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:27.359357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0907c-3d9b-4ed6-8405-331977e9b63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:27.360119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0907c-3d9b-4ed6-8405-331977e9b63c admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:27.360415 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0907c-3d9b-4ed6-8405-331977e9b63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:27.360927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0907c-3d9b-4ed6-8405-331977e9b63c admin admin] PATH_INFO: `/v3/projects/0d37449a93dc42b1a6ee282e6486bb15/users/035acccfaefe41a1bf09a48a2249a300/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:27.367530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0907c-3d9b-4ed6-8405-331977e9b63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d37449a93dc42b1a6ee282e6486bb15, user_id=035acccfaefe41a1bf09a48a2249a300, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:27.368523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0907c-3d9b-4ed6-8405-331977e9b63c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:27.380525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1216/2464] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:27 2022] PUT /identity/v3/projects/0d37449a93dc42b1a6ee282e6486bb15/users/035acccfaefe41a1bf09a48a2249a300/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:27.394974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67261e3c-47a0-4f7e-a71c-6660ca1b2c61 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:27.395250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67261e3c-47a0-4f7e-a71c-6660ca1b2c61 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:27.395746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67261e3c-47a0-4f7e-a71c-6660ca1b2c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:27.411003 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:27.426305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-67261e3c-47a0-4f7e-a71c-6660ca1b2c61 None None] MFA Rules not processed for user `035acccfaefe41a1bf09a48a2249a300`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:27.428537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-67261e3c-47a0-4f7e-a71c-6660ca1b2c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:27.514128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1249/2465] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:27.525839 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0907c-3d9b-4ed6-8405-331977e9b63c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:27.527562 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-54b0907c-3d9b-4ed6-8405-331977e9b63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:27.589401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0907c-3d9b-4ed6-8405-331977e9b63c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:27.593117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007de57-cb83-4d2c-a1b2-886c2f3d5b9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:27.593720 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007de57-cb83-4d2c-a1b2-886c2f3d5b9a service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:27.593996 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007de57-cb83-4d2c-a1b2-886c2f3d5b9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:27.594272 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007de57-cb83-4d2c-a1b2-886c2f3d5b9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:27.604258 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007de57-cb83-4d2c-a1b2-886c2f3d5b9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:27.605680 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007de57-cb83-4d2c-a1b2-886c2f3d5b9a service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:27.622962 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1217/2466] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:31.769692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67261e3c-47a0-4f7e-a71c-6660ca1b2c61 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:31.848947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67261e3c-47a0-4f7e-a71c-6660ca1b2c61 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:31.853642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:31.854287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:31.854563 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:31.854839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] PATH_INFO: `/v3/users/ee501bdd231848228a99540e995855eb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:31.856068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee501bdd231848228a99540e995855eb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:31.858238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:32.081535 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee501bdd231848228a99540e995855eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:32.100325 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee501bdd231848228a99540e995855eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:32.182108 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee501bdd231848228a99540e995855eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:32.183597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee501bdd231848228a99540e995855eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:32.183837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee501bdd231848228a99540e995855eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:32.211361 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1250/2467] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:31 2022] DELETE /identity/v3/users/ee501bdd231848228a99540e995855eb => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:32.216016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec7460-55f1-4923-901a-c487cc2ea83c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:32.216555 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec7460-55f1-4923-901a-c487cc2ea83c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:32.216688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec7460-55f1-4923-901a-c487cc2ea83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:32.230858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:32.237328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-26ec7460-55f1-4923-901a-c487cc2ea83c None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:32.239269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-26ec7460-55f1-4923-901a-c487cc2ea83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:32.313494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1218/2468] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:32.323801 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:32.325426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:32.341465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:32.439955 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44798d-08a5-4ea9-afce-0a6df70e46e0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:32.444419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f9906-1d7f-40bd-a185-4a4aeff74659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:32.445046 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9906-1d7f-40bd-a185-4a4aeff74659 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:32.449749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9906-1d7f-40bd-a185-4a4aeff74659 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:32.449749 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9906-1d7f-40bd-a185-4a4aeff74659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:32.457897 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f9906-1d7f-40bd-a185-4a4aeff74659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:32.459328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f9906-1d7f-40bd-a185-4a4aeff74659 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:32.470041 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1251/2469] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:52:33.195331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec7460-55f1-4923-901a-c487cc2ea83c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:33.196924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-26ec7460-55f1-4923-901a-c487cc2ea83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:33.215283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec7460-55f1-4923-901a-c487cc2ea83c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:33.222270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:33.223634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:33.223860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:33.224154 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] PATH_INFO: `/v3/projects/a73ace06b4114bcfaae47b4c6ad0161c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:33.225719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73ace06b4114bcfaae47b4c6ad0161c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:33.227740 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:33.412716 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73ace06b4114bcfaae47b4c6ad0161c', 'request_id': 'req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:33.419197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73ace06b4114bcfaae47b4c6ad0161c', 'request_id': 'req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:33.548289 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73ace06b4114bcfaae47b4c6ad0161c', 'request_id': 'req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:33.561737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] The token cache is being invalidate because project a73ace06b4114bcfaae47b4c6ad0161c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:33.562141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:33.562893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:33.564489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1219/2470] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:33 2022] DELETE /identity/v3/projects/a73ace06b4114bcfaae47b4c6ad0161c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:33.569710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f9906-1d7f-40bd-a185-4a4aeff74659 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:33.580129 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f9906-1d7f-40bd-a185-4a4aeff74659 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:33.645864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c6518-7dda-460c-8f32-6443ca9d470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:33.646519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c6518-7dda-460c-8f32-6443ca9d470b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:33.646788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c6518-7dda-460c-8f32-6443ca9d470b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:33.647056 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c6518-7dda-460c-8f32-6443ca9d470b admin admin] PATH_INFO: `/v3/users/035acccfaefe41a1bf09a48a2249a300` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:33.648250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c6518-7dda-460c-8f32-6443ca9d470b admin admin] RBAC: Authorizing `identity:delete_user(user_id=035acccfaefe41a1bf09a48a2249a300)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:33.650232 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c6518-7dda-460c-8f32-6443ca9d470b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:33.869876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-755c6518-7dda-460c-8f32-6443ca9d470b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035acccfaefe41a1bf09a48a2249a300'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:33.886300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-755c6518-7dda-460c-8f32-6443ca9d470b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035acccfaefe41a1bf09a48a2249a300'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:33.992935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-755c6518-7dda-460c-8f32-6443ca9d470b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035acccfaefe41a1bf09a48a2249a300'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:33.993556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-755c6518-7dda-460c-8f32-6443ca9d470b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035acccfaefe41a1bf09a48a2249a300'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:33.994166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-755c6518-7dda-460c-8f32-6443ca9d470b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035acccfaefe41a1bf09a48a2249a300'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:34.014212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1252/2471] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:33 2022] DELETE /identity/v3/users/035acccfaefe41a1bf09a48a2249a300 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:34.656275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:34.658135 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:34.673892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fd5b4-20d3-46e2-8a65-d0ca47c43d89 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:34.756555 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8ede3-568b-43b4-a9e2-846c7092c1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:34.757212 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8ede3-568b-43b4-a9e2-846c7092c1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:34.757500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8ede3-568b-43b4-a9e2-846c7092c1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:34.757774 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8ede3-568b-43b4-a9e2-846c7092c1db admin admin] PATH_INFO: `/v3/projects/0d37449a93dc42b1a6ee282e6486bb15` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:34.758969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8ede3-568b-43b4-a9e2-846c7092c1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d37449a93dc42b1a6ee282e6486bb15)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:34.761132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8ede3-568b-43b4-a9e2-846c7092c1db admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:34.969460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:34.969460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-57d8ede3-568b-43b4-a9e2-846c7092c1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d37449a93dc42b1a6ee282e6486bb15', 'request_id': 'req-57d8ede3-568b-43b4-a9e2-846c7092c1db'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:34.975343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-57d8ede3-568b-43b4-a9e2-846c7092c1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d37449a93dc42b1a6ee282e6486bb15', 'request_id': 'req-57d8ede3-568b-43b4-a9e2-846c7092c1db'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:35.103049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-57d8ede3-568b-43b4-a9e2-846c7092c1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d37449a93dc42b1a6ee282e6486bb15', 'request_id': 'req-57d8ede3-568b-43b4-a9e2-846c7092c1db'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:35.115849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-57d8ede3-568b-43b4-a9e2-846c7092c1db admin admin] The token cache is being invalidate because project 0d37449a93dc42b1a6ee282e6486bb15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:35.116139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-57d8ede3-568b-43b4-a9e2-846c7092c1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:35.116801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-57d8ede3-568b-43b4-a9e2-846c7092c1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:35.118299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1220/2472] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:34 2022] DELETE /identity/v3/projects/0d37449a93dc42b1a6ee282e6486bb15 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:35.123383 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2f329-b7ad-4c76-8c65-3757e844fc3f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:35.123963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2f329-b7ad-4c76-8c65-3757e844fc3f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:35.123963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2f329-b7ad-4c76-8c65-3757e844fc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:35.154210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a5d2f329-b7ad-4c76-8c65-3757e844fc3f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:35.154210 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a5d2f329-b7ad-4c76-8c65-3757e844fc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:35.202821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:35.243942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1253/2473] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:35.251645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeca6d-6aa5-44e2-85fb-1f1e40392c86 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:35.252286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeca6d-6aa5-44e2-85fb-1f1e40392c86 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:35.252636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeca6d-6aa5-44e2-85fb-1f1e40392c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:35.274543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-eabeca6d-6aa5-44e2-85fb-1f1e40392c86 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:35.275911 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eabeca6d-6aa5-44e2-85fb-1f1e40392c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:35.292089 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1221/2474] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:35.296725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2f329-b7ad-4c76-8c65-3757e844fc3f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:35.310726 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2f329-b7ad-4c76-8c65-3757e844fc3f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:35.317218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7911850-bc7d-4092-8d1a-f5cc0507dd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:35.317840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7911850-bc7d-4092-8d1a-f5cc0507dd07 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:35.320695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7911850-bc7d-4092-8d1a-f5cc0507dd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:35.320695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7911850-bc7d-4092-8d1a-f5cc0507dd07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:35.320695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7911850-bc7d-4092-8d1a-f5cc0507dd07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:52:35.320695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7911850-bc7d-4092-8d1a-f5cc0507dd07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:35.322833 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7911850-bc7d-4092-8d1a-f5cc0507dd07 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:35.338403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1254/2475] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:52:35.343150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeca6d-6aa5-44e2-85fb-1f1e40392c86 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:35.354469 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeca6d-6aa5-44e2-85fb-1f1e40392c86 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:35.359910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c03fed-1b8f-4ec2-84e9-13553603ec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:35.360585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c03fed-1b8f-4ec2-84e9-13553603ec99 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:35.360862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c03fed-1b8f-4ec2-84e9-13553603ec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:35.361133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c03fed-1b8f-4ec2-84e9-13553603ec99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:35.361778 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c03fed-1b8f-4ec2-84e9-13553603ec99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:35.363755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c03fed-1b8f-4ec2-84e9-13553603ec99 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:35.497720 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1222/2476] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:35 2022] POST /identity/v3/projects => generated 369 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:35.502585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7911850-bc7d-4092-8d1a-f5cc0507dd07 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:35.516167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7911850-bc7d-4092-8d1a-f5cc0507dd07 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:35.589857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff09b9-28f2-4bd3-ad68-0262daceb1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:35.590615 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff09b9-28f2-4bd3-ad68-0262daceb1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:35.591107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff09b9-28f2-4bd3-ad68-0262daceb1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:35.592142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff09b9-28f2-4bd3-ad68-0262daceb1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:35.592862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff09b9-28f2-4bd3-ad68-0262daceb1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:35.594830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff09b9-28f2-4bd3-ad68-0262daceb1c7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:35.728372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1255/2477] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:35 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:35.729624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c03fed-1b8f-4ec2-84e9-13553603ec99 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:35.742794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c03fed-1b8f-4ec2-84e9-13553603ec99 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:35.747801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f1fa3-c957-48f3-8964-cb4c5bf2b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:35.748427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1fa3-c957-48f3-8964-cb4c5bf2b360 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:35.748707 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1fa3-c957-48f3-8964-cb4c5bf2b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:35.749179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1fa3-c957-48f3-8964-cb4c5bf2b360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:35.750032 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f1fa3-c957-48f3-8964-cb4c5bf2b360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:35.751691 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f1fa3-c957-48f3-8964-cb4c5bf2b360 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:35.764975 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1223/2478] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:35.769775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff09b9-28f2-4bd3-ad68-0262daceb1c7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:35.786580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff09b9-28f2-4bd3-ad68-0262daceb1c7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:35.793784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bb9fb-e3ab-41c8-9f2e-3b24ca0c90d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:35.794935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bb9fb-e3ab-41c8-9f2e-3b24ca0c90d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:35.795412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bb9fb-e3ab-41c8-9f2e-3b24ca0c90d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:35.795930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bb9fb-e3ab-41c8-9f2e-3b24ca0c90d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:35.797004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bb9fb-e3ab-41c8-9f2e-3b24ca0c90d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:35.799520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bb9fb-e3ab-41c8-9f2e-3b24ca0c90d0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:35.816320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1256/2479] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:35.825478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f1fa3-c957-48f3-8964-cb4c5bf2b360 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:35.839560 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f1fa3-c957-48f3-8964-cb4c5bf2b360 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:35.847836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10a194-61fc-4188-b41a-dc2941e6b11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:35.848159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10a194-61fc-4188-b41a-dc2941e6b11e admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:35.848447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10a194-61fc-4188-b41a-dc2941e6b11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:35.848728 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10a194-61fc-4188-b41a-dc2941e6b11e admin admin] PATH_INFO: `/v3/projects/50a49a9d906841c79f929d4738182b9d/users/77d2054f06024cb6b27467fa833f578d/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:35.867986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10a194-61fc-4188-b41a-dc2941e6b11e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a49a9d906841c79f929d4738182b9d, user_id=77d2054f06024cb6b27467fa833f578d, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:35.870706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10a194-61fc-4188-b41a-dc2941e6b11e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:35.965615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1224/2480] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:35 2022] PUT /identity/v3/projects/50a49a9d906841c79f929d4738182b9d/users/77d2054f06024cb6b27467fa833f578d/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:35.982106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4be21-dc8b-4901-b07f-84ee5d5dc599 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:35.982106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4be21-dc8b-4901-b07f-84ee5d5dc599 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:35.982106 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4be21-dc8b-4901-b07f-84ee5d5dc599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:36.015438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4ba4be21-dc8b-4901-b07f-84ee5d5dc599 None None] MFA Rules not processed for user `77d2054f06024cb6b27467fa833f578d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:36.016897 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4ba4be21-dc8b-4901-b07f-84ee5d5dc599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:36.103786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1257/2481] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:36.106892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10a194-61fc-4188-b41a-dc2941e6b11e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:36.188632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10a194-61fc-4188-b41a-dc2941e6b11e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:36.198258 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4f596-57c7-4424-81f2-434e089d8e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:36.199228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4f596-57c7-4424-81f2-434e089d8e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:36.199690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4f596-57c7-4424-81f2-434e089d8e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:36.200147 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4f596-57c7-4424-81f2-434e089d8e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:36.201189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4f596-57c7-4424-81f2-434e089d8e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:36.204760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4f596-57c7-4424-81f2-434e089d8e41 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:36.304857 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1225/2482] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:36 2022] POST /identity/v3/projects => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:36.309126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4be21-dc8b-4901-b07f-84ee5d5dc599 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:36.322996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4be21-dc8b-4901-b07f-84ee5d5dc599 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:36.358184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:36.398777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9bbbd-985f-4a18-a92f-8eb26ee3b94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:36.399816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9bbbd-985f-4a18-a92f-8eb26ee3b94a admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:36.400250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9bbbd-985f-4a18-a92f-8eb26ee3b94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:36.400640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9bbbd-985f-4a18-a92f-8eb26ee3b94a admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:36.401333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9bbbd-985f-4a18-a92f-8eb26ee3b94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:36.403390 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9bbbd-985f-4a18-a92f-8eb26ee3b94a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:36.522868 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1258/2483] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:36 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:36.527349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4f596-57c7-4424-81f2-434e089d8e41 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:36.540574 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4f596-57c7-4424-81f2-434e089d8e41 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:36.545799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f7e09-ccf3-4449-9116-59665009de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:36.546355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f7e09-ccf3-4449-9116-59665009de8d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:36.546638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f7e09-ccf3-4449-9116-59665009de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:36.546945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f7e09-ccf3-4449-9116-59665009de8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:36.547607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f7e09-ccf3-4449-9116-59665009de8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:36.549386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f7e09-ccf3-4449-9116-59665009de8d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:36.570948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1226/2484] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:36.573690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9bbbd-985f-4a18-a92f-8eb26ee3b94a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:36.590472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9bbbd-985f-4a18-a92f-8eb26ee3b94a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:36.598879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac10118-11a1-423e-8ee1-86a7cfa06262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:36.599013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10118-11a1-423e-8ee1-86a7cfa06262 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:36.599687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10118-11a1-423e-8ee1-86a7cfa06262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:36.600073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10118-11a1-423e-8ee1-86a7cfa06262 admin admin] PATH_INFO: `/v3/projects/6ab17bf01bdf4cd087d86c97733b9e5c/users/c6c1492bc5f04a969cce7ab3059a39ad/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:36.619111 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac10118-11a1-423e-8ee1-86a7cfa06262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab17bf01bdf4cd087d86c97733b9e5c, user_id=c6c1492bc5f04a969cce7ab3059a39ad, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:36.622162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac10118-11a1-423e-8ee1-86a7cfa06262 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:36.698184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1259/2485] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:36 2022] PUT /identity/v3/projects/6ab17bf01bdf4cd087d86c97733b9e5c/users/c6c1492bc5f04a969cce7ab3059a39ad/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:36.702120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f7e09-ccf3-4449-9116-59665009de8d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:36.713571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f7e09-ccf3-4449-9116-59665009de8d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:36.753676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:36.790229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecc395-ef7b-4948-aebc-f2d52ef4afc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:36.791807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecc395-ef7b-4948-aebc-f2d52ef4afc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:36.792169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecc395-ef7b-4948-aebc-f2d52ef4afc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:36.792440 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecc395-ef7b-4948-aebc-f2d52ef4afc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:36.793114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecc395-ef7b-4948-aebc-f2d52ef4afc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:36.794799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecc395-ef7b-4948-aebc-f2d52ef4afc5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:36.806494 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1227/2486] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:36.811273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac10118-11a1-423e-8ee1-86a7cfa06262 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:36.824228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac10118-11a1-423e-8ee1-86a7cfa06262 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:36.829392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455ce9b-1dac-4a08-9ed4-536f7fc1579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:36.830072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455ce9b-1dac-4a08-9ed4-536f7fc1579b admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:36.830352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455ce9b-1dac-4a08-9ed4-536f7fc1579b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:36.830625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455ce9b-1dac-4a08-9ed4-536f7fc1579b admin admin] PATH_INFO: `/v3/projects/6ab17bf01bdf4cd087d86c97733b9e5c/users/c6c1492bc5f04a969cce7ab3059a39ad/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:36.833451 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455ce9b-1dac-4a08-9ed4-536f7fc1579b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab17bf01bdf4cd087d86c97733b9e5c, user_id=c6c1492bc5f04a969cce7ab3059a39ad, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:36.836147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455ce9b-1dac-4a08-9ed4-536f7fc1579b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:36.848512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1260/2487] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:36 2022] PUT /identity/v3/projects/6ab17bf01bdf4cd087d86c97733b9e5c/users/c6c1492bc5f04a969cce7ab3059a39ad/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:36.858975 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241c9aa-4a31-4906-a166-a360336cc497 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:36.859580 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241c9aa-4a31-4906-a166-a360336cc497 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:36.859580 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241c9aa-4a31-4906-a166-a360336cc497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:36.892810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6241c9aa-4a31-4906-a166-a360336cc497 None None] MFA Rules not processed for user `c6c1492bc5f04a969cce7ab3059a39ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:36.894601 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6241c9aa-4a31-4906-a166-a360336cc497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:36.975993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1228/2488] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:36.988626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455ce9b-1dac-4a08-9ed4-536f7fc1579b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:36.990738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c455ce9b-1dac-4a08-9ed4-536f7fc1579b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:37.057001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455ce9b-1dac-4a08-9ed4-536f7fc1579b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:37.061107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bff90-0fe6-48ed-a9df-b36c73c815ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:37.061725 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bff90-0fe6-48ed-a9df-b36c73c815ab service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:37.061998 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bff90-0fe6-48ed-a9df-b36c73c815ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:37.062311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bff90-0fe6-48ed-a9df-b36c73c815ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:37.072371 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bff90-0fe6-48ed-a9df-b36c73c815ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:37.073816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bff90-0fe6-48ed-a9df-b36c73c815ab service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:37.084732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1261/2489] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:37.218973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241c9aa-4a31-4906-a166-a360336cc497 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:37.220422 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6241c9aa-4a31-4906-a166-a360336cc497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:37.235545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241c9aa-4a31-4906-a166-a360336cc497 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:37.240674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290c517-0cd6-4104-827b-87f56ec31917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:37.241388 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290c517-0cd6-4104-827b-87f56ec31917 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:37.241706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290c517-0cd6-4104-827b-87f56ec31917 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:37.242393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290c517-0cd6-4104-827b-87f56ec31917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:37.313408 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290c517-0cd6-4104-827b-87f56ec31917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:37.315269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290c517-0cd6-4104-827b-87f56ec31917 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:37.326372 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1229/2490] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:38.962698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bff90-0fe6-48ed-a9df-b36c73c815ab service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:38.964577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d69bff90-0fe6-48ed-a9df-b36c73c815ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:39.032213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bff90-0fe6-48ed-a9df-b36c73c815ab service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:39.036549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e8f51-c128-4c80-a7d6-65c0883b96eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:39.037341 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e8f51-c128-4c80-a7d6-65c0883b96eb service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:39.037623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e8f51-c128-4c80-a7d6-65c0883b96eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:39.037938 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e8f51-c128-4c80-a7d6-65c0883b96eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:39.040114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-654e8f51-c128-4c80-a7d6-65c0883b96eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:39.086598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:39.111843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e8f51-c128-4c80-a7d6-65c0883b96eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:39.114839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e8f51-c128-4c80-a7d6-65c0883b96eb service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:39.126967 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1262/2491] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:43.472484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290c517-0cd6-4104-827b-87f56ec31917 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:43.474102 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4290c517-0cd6-4104-827b-87f56ec31917 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:43.491139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290c517-0cd6-4104-827b-87f56ec31917 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:43.505721 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2d620-2c25-4b1c-ba4e-25ad12cebb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:43.506725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2d620-2c25-4b1c-ba4e-25ad12cebb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:43.506894 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2d620-2c25-4b1c-ba4e-25ad12cebb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:43.507194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2d620-2c25-4b1c-ba4e-25ad12cebb06 admin admin] PATH_INFO: `/v3/users/c1e0da5f2891468383a43fd3e1af3d53` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:43.508489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2d620-2c25-4b1c-ba4e-25ad12cebb06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e0da5f2891468383a43fd3e1af3d53)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:43.510519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2d620-2c25-4b1c-ba4e-25ad12cebb06 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:43.621900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e8f51-c128-4c80-a7d6-65c0883b96eb service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:43.632948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e8f51-c128-4c80-a7d6-65c0883b96eb service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:43.642429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:43.642429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:43.642429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:43.642429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] PATH_INFO: `/v3/users/77d2054f06024cb6b27467fa833f578d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:43.643135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d2054f06024cb6b27467fa833f578d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:43.643135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:43.784786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:43.787587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ccb2d620-2c25-4b1c-ba4e-25ad12cebb06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e0da5f2891468383a43fd3e1af3d53'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:43.788318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ccb2d620-2c25-4b1c-ba4e-25ad12cebb06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e0da5f2891468383a43fd3e1af3d53'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:43.801917 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ccb2d620-2c25-4b1c-ba4e-25ad12cebb06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e0da5f2891468383a43fd3e1af3d53'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:43.809006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ccb2d620-2c25-4b1c-ba4e-25ad12cebb06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e0da5f2891468383a43fd3e1af3d53'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:43.809759 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ccb2d620-2c25-4b1c-ba4e-25ad12cebb06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e0da5f2891468383a43fd3e1af3d53'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:43.906206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1230/2492] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:43 2022] DELETE /identity/v3/users/c1e0da5f2891468383a43fd3e1af3d53 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:43.917817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d2054f06024cb6b27467fa833f578d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:43.935043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d2054f06024cb6b27467fa833f578d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:44.048413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d2054f06024cb6b27467fa833f578d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:44.049214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d2054f06024cb6b27467fa833f578d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:44.050491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d2054f06024cb6b27467fa833f578d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:44.069850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1263/2493] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:43 2022] DELETE /identity/v3/users/77d2054f06024cb6b27467fa833f578d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:44.075306 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa6466-4680-4db7-b27c-3ff9b3a48535 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:44.075963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa6466-4680-4db7-b27c-3ff9b3a48535 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:44.076573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa6466-4680-4db7-b27c-3ff9b3a48535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:44.103695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-71aa6466-4680-4db7-b27c-3ff9b3a48535 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:44.104958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-71aa6466-4680-4db7-b27c-3ff9b3a48535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:44.175694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1231/2494] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:44.185758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:44.187285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:44.217792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa6466-4680-4db7-b27c-3ff9b3a48535 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:44.220113 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-71aa6466-4680-4db7-b27c-3ff9b3a48535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:44.237932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa6466-4680-4db7-b27c-3ff9b3a48535 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:44.246434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eeaf59-04c3-4864-88b7-1d00af211952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:44.247418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eeaf59-04c3-4864-88b7-1d00af211952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:44.247893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eeaf59-04c3-4864-88b7-1d00af211952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:44.248755 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eeaf59-04c3-4864-88b7-1d00af211952 admin admin] PATH_INFO: `/v3/projects/e7e05fab39724ad886c25fbd86062339` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:44.250366 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eeaf59-04c3-4864-88b7-1d00af211952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e05fab39724ad886c25fbd86062339)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:44.256304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eeaf59-04c3-4864-88b7-1d00af211952 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:44.286836 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50151a-66fc-402b-8831-efbf848510cd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:44.291472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af541276-8491-47d3-9af5-f1798684ff31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:44.292122 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af541276-8491-47d3-9af5-f1798684ff31 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:44.292447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af541276-8491-47d3-9af5-f1798684ff31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:44.292722 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af541276-8491-47d3-9af5-f1798684ff31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:44.305196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af541276-8491-47d3-9af5-f1798684ff31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:44.306850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af541276-8491-47d3-9af5-f1798684ff31 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:44.319029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1264/2495] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:44.435788 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a0eeaf59-04c3-4864-88b7-1d00af211952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e05fab39724ad886c25fbd86062339', 'request_id': 'req-a0eeaf59-04c3-4864-88b7-1d00af211952'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:44.445171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a0eeaf59-04c3-4864-88b7-1d00af211952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e05fab39724ad886c25fbd86062339', 'request_id': 'req-a0eeaf59-04c3-4864-88b7-1d00af211952'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:44.526106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a0eeaf59-04c3-4864-88b7-1d00af211952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e05fab39724ad886c25fbd86062339', 'request_id': 'req-a0eeaf59-04c3-4864-88b7-1d00af211952'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:44.549227 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a0eeaf59-04c3-4864-88b7-1d00af211952 admin admin] The token cache is being invalidate because project e7e05fab39724ad886c25fbd86062339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:44.550149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a0eeaf59-04c3-4864-88b7-1d00af211952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:44.551294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a0eeaf59-04c3-4864-88b7-1d00af211952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:44.554475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1232/2496] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:44 2022] DELETE /identity/v3/projects/e7e05fab39724ad886c25fbd86062339 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:44.561551 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1917c5-dbc3-4b4a-ad50-f4a9256ab73a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:44.562194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1917c5-dbc3-4b4a-ad50-f4a9256ab73a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:44.562664 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1917c5-dbc3-4b4a-ad50-f4a9256ab73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:44.587363 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ea1917c5-dbc3-4b4a-ad50-f4a9256ab73a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:44.589760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ea1917c5-dbc3-4b4a-ad50-f4a9256ab73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:44.687174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:44.711399 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1265/2497] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:44.721192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169a017-c2ad-4141-a624-9ec282086a86 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:44.722646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169a017-c2ad-4141-a624-9ec282086a86 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:44.722646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169a017-c2ad-4141-a624-9ec282086a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:44.746841 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a169a017-c2ad-4141-a624-9ec282086a86 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:44.750983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a169a017-c2ad-4141-a624-9ec282086a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:44.757958 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1233/2498] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:44.762646 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1917c5-dbc3-4b4a-ad50-f4a9256ab73a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:44.773047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1917c5-dbc3-4b4a-ad50-f4a9256ab73a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:44.778017 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a3e63-2ca2-446a-8846-ef66f1da8ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:44.778601 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a3e63-2ca2-446a-8846-ef66f1da8ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:44.779771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a3e63-2ca2-446a-8846-ef66f1da8ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:44.779771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a3e63-2ca2-446a-8846-ef66f1da8ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:44.779771 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a3e63-2ca2-446a-8846-ef66f1da8ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:52:44.780202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a3e63-2ca2-446a-8846-ef66f1da8ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:44.781669 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a3e63-2ca2-446a-8846-ef66f1da8ecc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:44.794159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1266/2499] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:52:44.798782 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169a017-c2ad-4141-a624-9ec282086a86 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:44.809498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169a017-c2ad-4141-a624-9ec282086a86 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:44.814475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62253166-e29f-42ef-b6f7-bf47d776f9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:44.815108 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62253166-e29f-42ef-b6f7-bf47d776f9ec admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:44.815508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62253166-e29f-42ef-b6f7-bf47d776f9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:44.816030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62253166-e29f-42ef-b6f7-bf47d776f9ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:44.816752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62253166-e29f-42ef-b6f7-bf47d776f9ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:44.818754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62253166-e29f-42ef-b6f7-bf47d776f9ec admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:44.847104 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a3e63-2ca2-446a-8846-ef66f1da8ecc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:44.850095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-992a3e63-2ca2-446a-8846-ef66f1da8ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:44.880969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a3e63-2ca2-446a-8846-ef66f1da8ecc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:44.887260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:44.887260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:44.887260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:44.887260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] PATH_INFO: `/v3/projects/50a49a9d906841c79f929d4738182b9d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:44.888360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a49a9d906841c79f929d4738182b9d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:44.890245 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:44.981183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1234/2500] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:44 2022] POST /identity/v3/projects => generated 403 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:44.985038 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62253166-e29f-42ef-b6f7-bf47d776f9ec admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:45.016557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:45.023986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a49a9d906841c79f929d4738182b9d', 'request_id': 'req-caa5923f-f69e-49bf-b300-0b704ca7b8c8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:45.031859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a49a9d906841c79f929d4738182b9d', 'request_id': 'req-caa5923f-f69e-49bf-b300-0b704ca7b8c8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:45.079963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62253166-e29f-42ef-b6f7-bf47d776f9ec admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:45.142537 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046f1b5-ba44-49dd-8cfa-2663b896e38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:45.143187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046f1b5-ba44-49dd-8cfa-2663b896e38c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:45.143849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046f1b5-ba44-49dd-8cfa-2663b896e38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:45.144127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046f1b5-ba44-49dd-8cfa-2663b896e38c admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:45.144767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046f1b5-ba44-49dd-8cfa-2663b896e38c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:45.146808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046f1b5-ba44-49dd-8cfa-2663b896e38c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:45.157885 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a49a9d906841c79f929d4738182b9d', 'request_id': 'req-caa5923f-f69e-49bf-b300-0b704ca7b8c8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:45.170995 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] The token cache is being invalidate because project 50a49a9d906841c79f929d4738182b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:45.171284 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:45.172046 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:45.173575 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1267/2501] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:44 2022] DELETE /identity/v3/projects/50a49a9d906841c79f929d4738182b9d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:45.188093 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:45.189693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:45.203797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5923f-f69e-49bf-b300-0b704ca7b8c8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:45.208978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:45.209599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:45.209879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:45.210167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] PATH_INFO: `/v3/users/c6c1492bc5f04a969cce7ab3059a39ad` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:45.211372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c1492bc5f04a969cce7ab3059a39ad)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:45.213481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:45.278599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1235/2502] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:44 2022] POST /identity/v3/users => generated 302 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:45.280285 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046f1b5-ba44-49dd-8cfa-2663b896e38c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:45.282679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c046f1b5-ba44-49dd-8cfa-2663b896e38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:45.297718 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046f1b5-ba44-49dd-8cfa-2663b896e38c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:45.303703 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898eda-5621-4c89-9fb8-d9cd783e706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:45.304355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898eda-5621-4c89-9fb8-d9cd783e706e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:45.304636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898eda-5621-4c89-9fb8-d9cd783e706e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:45.305299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898eda-5621-4c89-9fb8-d9cd783e706e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:45.305852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99898eda-5621-4c89-9fb8-d9cd783e706e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:45.307507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99898eda-5621-4c89-9fb8-d9cd783e706e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:45.325085 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1236/2503] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:45.326345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898eda-5621-4c89-9fb8-d9cd783e706e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:45.336979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898eda-5621-4c89-9fb8-d9cd783e706e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:45.342103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde04ea3-566c-4a03-b3f6-b026fa928005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:45.343057 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde04ea3-566c-4a03-b3f6-b026fa928005 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:45.343196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde04ea3-566c-4a03-b3f6-b026fa928005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:45.343384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde04ea3-566c-4a03-b3f6-b026fa928005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:45.344072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde04ea3-566c-4a03-b3f6-b026fa928005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:45.345712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde04ea3-566c-4a03-b3f6-b026fa928005 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:45.360612 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1237/2504] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:45.365704 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde04ea3-566c-4a03-b3f6-b026fa928005 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:45.375641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde04ea3-566c-4a03-b3f6-b026fa928005 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:45.381464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d309909-8a68-46cc-89f3-6a01d21ffa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:45.382117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d309909-8a68-46cc-89f3-6a01d21ffa89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:45.382571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d309909-8a68-46cc-89f3-6a01d21ffa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:45.382858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d309909-8a68-46cc-89f3-6a01d21ffa89 admin admin] PATH_INFO: `/v3/projects/5ccfc88dfe8e493b9656b991a9796836/users/1fa6ade5f5c04498a10f36d79c4413f6/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:45.399462 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d309909-8a68-46cc-89f3-6a01d21ffa89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccfc88dfe8e493b9656b991a9796836, user_id=1fa6ade5f5c04498a10f36d79c4413f6, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:45.402197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d309909-8a68-46cc-89f3-6a01d21ffa89 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:45.445591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c1492bc5f04a969cce7ab3059a39ad'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:45.461797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c1492bc5f04a969cce7ab3059a39ad'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:45.490047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1238/2505] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:45 2022] PUT /identity/v3/projects/5ccfc88dfe8e493b9656b991a9796836/users/1fa6ade5f5c04498a10f36d79c4413f6/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:45.495347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34386e69-02d3-4bad-9b93-43ce20c7d0f1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:45.495631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34386e69-02d3-4bad-9b93-43ce20c7d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:45.495929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34386e69-02d3-4bad-9b93-43ce20c7d0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:45.516568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-34386e69-02d3-4bad-9b93-43ce20c7d0f1 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:45.517773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-34386e69-02d3-4bad-9b93-43ce20c7d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:45.579678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1239/2506] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:45.589410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34386e69-02d3-4bad-9b93-43ce20c7d0f1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:45.590466 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c1492bc5f04a969cce7ab3059a39ad'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:45.590791 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-34386e69-02d3-4bad-9b93-43ce20c7d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:45.591084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c1492bc5f04a969cce7ab3059a39ad'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:45.591691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c1492bc5f04a969cce7ab3059a39ad'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:45.608043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1268/2507] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:45 2022] DELETE /identity/v3/users/c6c1492bc5f04a969cce7ab3059a39ad => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:45.654666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34386e69-02d3-4bad-9b93-43ce20c7d0f1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:45.717922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85d0b1-0020-4866-a74b-a1ea405d8f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:45.718693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85d0b1-0020-4866-a74b-a1ea405d8f30 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:45.719022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85d0b1-0020-4866-a74b-a1ea405d8f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:45.719316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85d0b1-0020-4866-a74b-a1ea405d8f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:45.721618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7e85d0b1-0020-4866-a74b-a1ea405d8f30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:45.794448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85d0b1-0020-4866-a74b-a1ea405d8f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:45.796280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85d0b1-0020-4866-a74b-a1ea405d8f30 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:45.807344 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1240/2508] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:52:46.203468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:46.212373 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:46.216199 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:46.231812 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca11d10-b8b9-4bb8-b2b6-8148607f8ad3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:46.240430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:46.241380 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:46.241813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:46.242250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd admin admin] PATH_INFO: `/v3/projects/6ab17bf01bdf4cd087d86c97733b9e5c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:46.243652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ab17bf01bdf4cd087d86c97733b9e5c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:46.246243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:46.426483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:46.432931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ab17bf01bdf4cd087d86c97733b9e5c', 'request_id': 'req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:46.440742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ab17bf01bdf4cd087d86c97733b9e5c', 'request_id': 'req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:46.545429 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ab17bf01bdf4cd087d86c97733b9e5c', 'request_id': 'req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:46.558806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd admin admin] The token cache is being invalidate because project 6ab17bf01bdf4cd087d86c97733b9e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:46.559090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:46.559777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d982ecd0-cbbe-4fcf-9a7c-2bfac75765bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:46.561335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1269/2509] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:46 2022] DELETE /identity/v3/projects/6ab17bf01bdf4cd087d86c97733b9e5c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:46.567162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dda26-ff84-44f5-bce9-412af4e35f0e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:46.567478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dda26-ff84-44f5-bce9-412af4e35f0e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:46.567781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dda26-ff84-44f5-bce9-412af4e35f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:46.716053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-416dda26-ff84-44f5-bce9-412af4e35f0e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:46.717590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-416dda26-ff84-44f5-bce9-412af4e35f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:46.800787 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1241/2510] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:46.808905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04fd93-8e0c-47a1-8c86-5f131e816dad None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:46.809184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04fd93-8e0c-47a1-8c86-5f131e816dad None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:46.809453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04fd93-8e0c-47a1-8c86-5f131e816dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:46.835401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3a04fd93-8e0c-47a1-8c86-5f131e816dad None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:46.837162 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3a04fd93-8e0c-47a1-8c86-5f131e816dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:46.851645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1270/2511] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:46.856254 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dda26-ff84-44f5-bce9-412af4e35f0e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:46.871968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dda26-ff84-44f5-bce9-412af4e35f0e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:46.877318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ced36-b340-4f19-9461-00393b855a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:46.878589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ced36-b340-4f19-9461-00393b855a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:46.878882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ced36-b340-4f19-9461-00393b855a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:46.879187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ced36-b340-4f19-9461-00393b855a46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:46.879962 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ced36-b340-4f19-9461-00393b855a46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:52:46.880332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ced36-b340-4f19-9461-00393b855a46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:46.887127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ced36-b340-4f19-9461-00393b855a46 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:46.895241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1242/2512] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:52:46.899935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04fd93-8e0c-47a1-8c86-5f131e816dad None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:46.910302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04fd93-8e0c-47a1-8c86-5f131e816dad None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:46.915562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610ba0b-78b0-49ce-9c58-6f7cadf1363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:46.916192 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610ba0b-78b0-49ce-9c58-6f7cadf1363b admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:46.916471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610ba0b-78b0-49ce-9c58-6f7cadf1363b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:46.916740 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610ba0b-78b0-49ce-9c58-6f7cadf1363b admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:46.917370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610ba0b-78b0-49ce-9c58-6f7cadf1363b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:46.919253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610ba0b-78b0-49ce-9c58-6f7cadf1363b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:47.094085 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1271/2513] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:46 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:47.098817 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ced36-b340-4f19-9461-00393b855a46 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:47.109161 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ced36-b340-4f19-9461-00393b855a46 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:47.183018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8151e-c8c8-46a1-96d6-3edeb46ce274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:47.183660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8151e-c8c8-46a1-96d6-3edeb46ce274 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:47.183968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8151e-c8c8-46a1-96d6-3edeb46ce274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:47.184239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8151e-c8c8-46a1-96d6-3edeb46ce274 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:47.184888 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8151e-c8c8-46a1-96d6-3edeb46ce274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:47.186862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8151e-c8c8-46a1-96d6-3edeb46ce274 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:47.313362 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1243/2514] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:47 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:47.319163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610ba0b-78b0-49ce-9c58-6f7cadf1363b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:47.335212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610ba0b-78b0-49ce-9c58-6f7cadf1363b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:47.340784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d009a-ecd3-4c96-8141-b24b2a930a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:47.341483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d009a-ecd3-4c96-8141-b24b2a930a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:47.341764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d009a-ecd3-4c96-8141-b24b2a930a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:47.342142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d009a-ecd3-4c96-8141-b24b2a930a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:47.343181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d009a-ecd3-4c96-8141-b24b2a930a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:47.344647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:47.350323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d009a-ecd3-4c96-8141-b24b2a930a5f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:47.367546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8151e-c8c8-46a1-96d6-3edeb46ce274 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:47.376088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1272/2515] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:47.379240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8151e-c8c8-46a1-96d6-3edeb46ce274 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:47.384625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89e7cc-5396-48d6-9685-2dbb1c35ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:47.386871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89e7cc-5396-48d6-9685-2dbb1c35ccbc admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:47.386871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89e7cc-5396-48d6-9685-2dbb1c35ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:47.386871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89e7cc-5396-48d6-9685-2dbb1c35ccbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:47.386871 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89e7cc-5396-48d6-9685-2dbb1c35ccbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:47.388021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89e7cc-5396-48d6-9685-2dbb1c35ccbc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:47.399473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1244/2516] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:47.403660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d009a-ecd3-4c96-8141-b24b2a930a5f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:47.417886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d009a-ecd3-4c96-8141-b24b2a930a5f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:47.425254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae80f-cfd3-438f-9dc1-fd8aa75f9398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:47.425254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae80f-cfd3-438f-9dc1-fd8aa75f9398 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:47.425254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae80f-cfd3-438f-9dc1-fd8aa75f9398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:47.425254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae80f-cfd3-438f-9dc1-fd8aa75f9398 admin admin] PATH_INFO: `/v3/projects/1b806d1b0a5d4f2faf2179381982438b/users/07b97d4bee9f4efab3eb012e7ed6af58/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:47.443457 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae80f-cfd3-438f-9dc1-fd8aa75f9398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b806d1b0a5d4f2faf2179381982438b, user_id=07b97d4bee9f4efab3eb012e7ed6af58, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:47.450861 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae80f-cfd3-438f-9dc1-fd8aa75f9398 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:47.585249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1273/2517] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:47 2022] PUT /identity/v3/projects/1b806d1b0a5d4f2faf2179381982438b/users/07b97d4bee9f4efab3eb012e7ed6af58/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:47.598245 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bfe18-879e-474d-9326-acc6f6db5c0c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:47.599073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bfe18-879e-474d-9326-acc6f6db5c0c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:47.599073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bfe18-879e-474d-9326-acc6f6db5c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:47.636821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0e2bfe18-879e-474d-9326-acc6f6db5c0c None None] MFA Rules not processed for user `07b97d4bee9f4efab3eb012e7ed6af58`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:47.639356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0e2bfe18-879e-474d-9326-acc6f6db5c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:47.705238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1abde0-b6e1-4c28-9c79-e10e941c4ead None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:47.706125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1abde0-b6e1-4c28-9c79-e10e941c4ead None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:47.706475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1abde0-b6e1-4c28-9c79-e10e941c4ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:47.724077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1245/2518] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:47.729004 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bfe18-879e-474d-9326-acc6f6db5c0c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:47.746454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-df1abde0-b6e1-4c28-9c79-e10e941c4ead None None] MFA Rules not processed for user `1fa6ade5f5c04498a10f36d79c4413f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:47.747752 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-df1abde0-b6e1-4c28-9c79-e10e941c4ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:47.819231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bfe18-879e-474d-9326-acc6f6db5c0c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:47.824847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb8959-d2e4-41a6-8550-57de9a502598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:47.825472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8959-d2e4-41a6-8550-57de9a502598 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:47.825747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8959-d2e4-41a6-8550-57de9a502598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:47.826022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8959-d2e4-41a6-8550-57de9a502598 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:47.826657 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb8959-d2e4-41a6-8550-57de9a502598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:47.828826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb8959-d2e4-41a6-8550-57de9a502598 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:47.861009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:47.883795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1274/2519] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:47.890058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1abde0-b6e1-4c28-9c79-e10e941c4ead None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:47.891610 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-df1abde0-b6e1-4c28-9c79-e10e941c4ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:47.913693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1abde0-b6e1-4c28-9c79-e10e941c4ead None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:47.920883 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299b78d-e748-4fcb-ace7-a4c37f97f990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:47.921880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299b78d-e748-4fcb-ace7-a4c37f97f990 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:47.922343 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299b78d-e748-4fcb-ace7-a4c37f97f990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:47.923107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299b78d-e748-4fcb-ace7-a4c37f97f990 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:47.924512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299b78d-e748-4fcb-ace7-a4c37f97f990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:47.928810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299b78d-e748-4fcb-ace7-a4c37f97f990 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:47.985509 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1246/2520] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:47 2022] POST /identity/v3/projects => generated 387 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:47.991928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb8959-d2e4-41a6-8550-57de9a502598 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:48.072507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb8959-d2e4-41a6-8550-57de9a502598 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:48.077673 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd4bc3-ca48-4a61-a1a4-0095d9057859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:48.078526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd4bc3-ca48-4a61-a1a4-0095d9057859 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:48.078853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd4bc3-ca48-4a61-a1a4-0095d9057859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:48.079120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd4bc3-ca48-4a61-a1a4-0095d9057859 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:48.079770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd4bc3-ca48-4a61-a1a4-0095d9057859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:48.082765 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd4bc3-ca48-4a61-a1a4-0095d9057859 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:48.144986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1275/2521] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:47 2022] POST /identity/v3/projects => generated 403 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:48.150296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299b78d-e748-4fcb-ace7-a4c37f97f990 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:48.184790 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:48.211393 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1247/2522] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:47 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:48.216842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd4bc3-ca48-4a61-a1a4-0095d9057859 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:48.229534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd4bc3-ca48-4a61-a1a4-0095d9057859 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:48.288231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299b78d-e748-4fcb-ace7-a4c37f97f990 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:48.297952 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83314fa-be51-43b3-b0a0-988999137bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:48.298845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83314fa-be51-43b3-b0a0-988999137bac admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:48.298999 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83314fa-be51-43b3-b0a0-988999137bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:48.303072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83314fa-be51-43b3-b0a0-988999137bac admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:48.303072 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83314fa-be51-43b3-b0a0-988999137bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:48.305329 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83314fa-be51-43b3-b0a0-988999137bac admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:48.336511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dee46-422d-46da-bbfe-18196835e43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:48.337575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dee46-422d-46da-bbfe-18196835e43b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:48.338197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dee46-422d-46da-bbfe-18196835e43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:48.338702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dee46-422d-46da-bbfe-18196835e43b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:48.339443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dee46-422d-46da-bbfe-18196835e43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:48.341634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dee46-422d-46da-bbfe-18196835e43b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:48.360715 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1248/2523] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:48.364189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dee46-422d-46da-bbfe-18196835e43b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:48.381694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dee46-422d-46da-bbfe-18196835e43b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:48.390491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93556de-3c1f-4959-b214-8c8992bcd386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:48.395310 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93556de-3c1f-4959-b214-8c8992bcd386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:48.395310 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93556de-3c1f-4959-b214-8c8992bcd386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:48.395310 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93556de-3c1f-4959-b214-8c8992bcd386 admin admin] PATH_INFO: `/v3/projects/0c30c7cedf15457d977f231a0850e400/users/4abe08fd78414dc5b6333f8dd77ed924/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:48.419544 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93556de-3c1f-4959-b214-8c8992bcd386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c30c7cedf15457d977f231a0850e400, user_id=4abe08fd78414dc5b6333f8dd77ed924, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:48.424056 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1276/2524] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:48 2022] POST /identity/v3/users => generated 308 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:48.425031 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93556de-3c1f-4959-b214-8c8992bcd386 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:48.428105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83314fa-be51-43b3-b0a0-988999137bac admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:48.439794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83314fa-be51-43b3-b0a0-988999137bac admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:48.445387 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba37d0f-3b0e-4c82-8557-4f77603c1ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:48.446016 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba37d0f-3b0e-4c82-8557-4f77603c1ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:48.446357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba37d0f-3b0e-4c82-8557-4f77603c1ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:48.446573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba37d0f-3b0e-4c82-8557-4f77603c1ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:48.447227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba37d0f-3b0e-4c82-8557-4f77603c1ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:48.449066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba37d0f-3b0e-4c82-8557-4f77603c1ae0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:48.462686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1277/2525] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:52:48.475851 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba37d0f-3b0e-4c82-8557-4f77603c1ae0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:48.496062 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba37d0f-3b0e-4c82-8557-4f77603c1ae0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:48.502135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10bb85-cf43-4f76-8ac1-3dc19385c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:48.504651 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10bb85-cf43-4f76-8ac1-3dc19385c07f admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:48.504651 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10bb85-cf43-4f76-8ac1-3dc19385c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:48.504651 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10bb85-cf43-4f76-8ac1-3dc19385c07f admin admin] PATH_INFO: `/v3/projects/0eda3359901149e58615dd2ea883d577/users/00ae0abac48a47e5ba3f618e323bc3e3/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:48.523062 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10bb85-cf43-4f76-8ac1-3dc19385c07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eda3359901149e58615dd2ea883d577, user_id=00ae0abac48a47e5ba3f618e323bc3e3, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:48.525809 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10bb85-cf43-4f76-8ac1-3dc19385c07f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:48.616183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1249/2526] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:48 2022] PUT /identity/v3/projects/0c30c7cedf15457d977f231a0850e400/users/4abe08fd78414dc5b6333f8dd77ed924/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:48.620226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93556de-3c1f-4959-b214-8c8992bcd386 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:48.678357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1278/2527] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:48 2022] PUT /identity/v3/projects/0eda3359901149e58615dd2ea883d577/users/00ae0abac48a47e5ba3f618e323bc3e3/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:48.682500 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10bb85-cf43-4f76-8ac1-3dc19385c07f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:48.697524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:48.705832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93556de-3c1f-4959-b214-8c8992bcd386 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:48.761460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10bb85-cf43-4f76-8ac1-3dc19385c07f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:48.766650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed364be4-b1af-41b6-af77-6b5c6271b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:48.767266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed364be4-b1af-41b6-af77-6b5c6271b237 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:48.767539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed364be4-b1af-41b6-af77-6b5c6271b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:48.767840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed364be4-b1af-41b6-af77-6b5c6271b237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:48.768572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed364be4-b1af-41b6-af77-6b5c6271b237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:48.770759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed364be4-b1af-41b6-af77-6b5c6271b237 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:48.782445 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1279/2528] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:52:48.787048 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed364be4-b1af-41b6-af77-6b5c6271b237 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:48.801507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf52b5-e69c-4b8e-9ff1-d8bdf80d194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:48.803500 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed364be4-b1af-41b6-af77-6b5c6271b237 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:48.804512 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf52b5-e69c-4b8e-9ff1-d8bdf80d194f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:48.805717 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf52b5-e69c-4b8e-9ff1-d8bdf80d194f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:48.806702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf52b5-e69c-4b8e-9ff1-d8bdf80d194f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:48.807575 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf52b5-e69c-4b8e-9ff1-d8bdf80d194f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:48.809889 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf52b5-e69c-4b8e-9ff1-d8bdf80d194f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:48.811573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b15d3-575d-4394-8dd0-d2291474f728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:48.817476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b15d3-575d-4394-8dd0-d2291474f728 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:48.817476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b15d3-575d-4394-8dd0-d2291474f728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:48.817476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b15d3-575d-4394-8dd0-d2291474f728 admin admin] PATH_INFO: `/v3/projects/0eda3359901149e58615dd2ea883d577/users/00ae0abac48a47e5ba3f618e323bc3e3/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:48.819343 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b15d3-575d-4394-8dd0-d2291474f728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eda3359901149e58615dd2ea883d577, user_id=00ae0abac48a47e5ba3f618e323bc3e3, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:48.822086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b15d3-575d-4394-8dd0-d2291474f728 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:48.822437 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1250/2529] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:52:48.827187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf52b5-e69c-4b8e-9ff1-d8bdf80d194f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:48.838898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1280/2530] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:48 2022] PUT /identity/v3/projects/0eda3359901149e58615dd2ea883d577/users/00ae0abac48a47e5ba3f618e323bc3e3/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:48.840587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf52b5-e69c-4b8e-9ff1-d8bdf80d194f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:48.914250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b9d92-280f-4c7f-9c61-3b2a645f05cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:48.914830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b9d92-280f-4c7f-9c61-3b2a645f05cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:48.915103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b9d92-280f-4c7f-9c61-3b2a645f05cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:48.915371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b9d92-280f-4c7f-9c61-3b2a645f05cf admin admin] PATH_INFO: `/v3/projects/0c30c7cedf15457d977f231a0850e400/users/4abe08fd78414dc5b6333f8dd77ed924/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:48.917333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b9d92-280f-4c7f-9c61-3b2a645f05cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c30c7cedf15457d977f231a0850e400, user_id=4abe08fd78414dc5b6333f8dd77ed924, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:48.920296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b9d92-280f-4c7f-9c61-3b2a645f05cf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:48.931138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1251/2531] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:48 2022] PUT /identity/v3/projects/0c30c7cedf15457d977f231a0850e400/users/4abe08fd78414dc5b6333f8dd77ed924/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:48.942229 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb962826-971a-443f-8752-812fe155e231 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:48.942583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb962826-971a-443f-8752-812fe155e231 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:48.943328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb962826-971a-443f-8752-812fe155e231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:48.979531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-eb962826-971a-443f-8752-812fe155e231 None None] MFA Rules not processed for user `4abe08fd78414dc5b6333f8dd77ed924`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:48.980839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-eb962826-971a-443f-8752-812fe155e231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:49.038105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:49.063430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1281/2532] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:49.076102 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b9d92-280f-4c7f-9c61-3b2a645f05cf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:49.077965 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-be3b9d92-280f-4c7f-9c61-3b2a645f05cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:49.154511 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b9d92-280f-4c7f-9c61-3b2a645f05cf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:49.160065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e573980-6df1-4c08-98b3-31857f151197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:49.160734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e573980-6df1-4c08-98b3-31857f151197 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:49.160734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e573980-6df1-4c08-98b3-31857f151197 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:49.161312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e573980-6df1-4c08-98b3-31857f151197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:49.177719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e573980-6df1-4c08-98b3-31857f151197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:49.180379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e573980-6df1-4c08-98b3-31857f151197 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:49.196024 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1252/2533] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:49.272857 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb962826-971a-443f-8752-812fe155e231 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:49.357886 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb962826-971a-443f-8752-812fe155e231 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:49.363075 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:49.363699 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:49.364005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:49.364532 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] PATH_INFO: `/v3/users/07b97d4bee9f4efab3eb012e7ed6af58` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:49.365643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b97d4bee9f4efab3eb012e7ed6af58)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:49.367637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:49.635528 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b97d4bee9f4efab3eb012e7ed6af58'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:49.671681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b97d4bee9f4efab3eb012e7ed6af58'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:49.859185 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b97d4bee9f4efab3eb012e7ed6af58'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:49.860443 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b97d4bee9f4efab3eb012e7ed6af58'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:49.861137 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b97d4bee9f4efab3eb012e7ed6af58'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:49.885870 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1282/2534] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:49 2022] DELETE /identity/v3/users/07b97d4bee9f4efab3eb012e7ed6af58 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:49.891153 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f6224-d296-4f0e-b32b-9843a5781a7e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:49.891754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f6224-d296-4f0e-b32b-9843a5781a7e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:49.892858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f6224-d296-4f0e-b32b-9843a5781a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:49.916813 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1a2f6224-d296-4f0e-b32b-9843a5781a7e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:49.918227 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1a2f6224-d296-4f0e-b32b-9843a5781a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:49.970941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:50.017556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1253/2535] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:50.032623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:50.035194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:50.131864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e20289-e07d-44fc-8313-17512a802f98 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:50.144168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e29c6-d51e-4b7d-ac07-def5f8176165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:50.144807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e29c6-d51e-4b7d-ac07-def5f8176165 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:50.145082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e29c6-d51e-4b7d-ac07-def5f8176165 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:50.145349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e29c6-d51e-4b7d-ac07-def5f8176165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:50.155686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e29c6-d51e-4b7d-ac07-def5f8176165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:50.157357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e29c6-d51e-4b7d-ac07-def5f8176165 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:50.171254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1283/2536] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:50.798682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f6224-d296-4f0e-b32b-9843a5781a7e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:50.802146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1a2f6224-d296-4f0e-b32b-9843a5781a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:50.825815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f6224-d296-4f0e-b32b-9843a5781a7e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:50.834314 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:50.848308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:50.848850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:50.849277 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] PATH_INFO: `/v3/projects/1b806d1b0a5d4f2faf2179381982438b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:50.850758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b806d1b0a5d4f2faf2179381982438b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:50.854053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:50.856425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cabb8-519b-443e-81ac-de162660ee0c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:50.872932 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cabb8-519b-443e-81ac-de162660ee0c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:50.874522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cabb8-519b-443e-81ac-de162660ee0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:50.908152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:50.967496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-723cabb8-519b-443e-81ac-de162660ee0c None None] MFA Rules not processed for user `00ae0abac48a47e5ba3f618e323bc3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:50.977120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-723cabb8-519b-443e-81ac-de162660ee0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:51.087555 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b806d1b0a5d4f2faf2179381982438b', 'request_id': 'req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:51.095831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b806d1b0a5d4f2faf2179381982438b', 'request_id': 'req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:51.106444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1284/2537] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:50 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:51.238474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b806d1b0a5d4f2faf2179381982438b', 'request_id': 'req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:51.265333 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] The token cache is being invalidate because project 1b806d1b0a5d4f2faf2179381982438b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:51.265882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:51.267198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:51.270978 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1254/2538] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:50 2022] DELETE /identity/v3/projects/1b806d1b0a5d4f2faf2179381982438b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:51.276382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cabb8-519b-443e-81ac-de162660ee0c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:51.297584 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cabb8-519b-443e-81ac-de162660ee0c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:51.409566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:51.410554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:51.410960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:51.411289 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] PATH_INFO: `/v3/users/4abe08fd78414dc5b6333f8dd77ed924` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:51.413201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abe08fd78414dc5b6333f8dd77ed924)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:51.416320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:51.732619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abe08fd78414dc5b6333f8dd77ed924'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:51.747340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abe08fd78414dc5b6333f8dd77ed924'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:51.852214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abe08fd78414dc5b6333f8dd77ed924'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:51.853019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abe08fd78414dc5b6333f8dd77ed924'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:51.853755 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abe08fd78414dc5b6333f8dd77ed924'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:51.881428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1285/2539] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:51 2022] DELETE /identity/v3/users/4abe08fd78414dc5b6333f8dd77ed924 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:52.737864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:52.740358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:52.758132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf19aa-e0d8-47bb-91b0-b2212e8da7a0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:52.832304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:52.833148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:52.833661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:52.834164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86 admin admin] PATH_INFO: `/v3/projects/0c30c7cedf15457d977f231a0850e400` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:52.835903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c30c7cedf15457d977f231a0850e400)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:52.837851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:52.953063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c30c7cedf15457d977f231a0850e400', 'request_id': 'req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:52.960819 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c30c7cedf15457d977f231a0850e400', 'request_id': 'req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:53.041188 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:53.043739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:53.059115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c30c7cedf15457d977f231a0850e400', 'request_id': 'req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:53.068882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:53.072251 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eee668-da54-49c2-b51c-808b25a59fbd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:53.079258 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86 admin admin] The token cache is being invalidate because project 0c30c7cedf15457d977f231a0850e400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:53.079258 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:53.079863 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4d8d4981-651a-40f7-b42f-4a1a34ad9c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:53.082018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1255/2540] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:52 2022] DELETE /identity/v3/projects/0c30c7cedf15457d977f231a0850e400 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:53.087349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba5504-fee2-41c7-b529-99d909e2c5db None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:53.087625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba5504-fee2-41c7-b529-99d909e2c5db None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:53.087928 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba5504-fee2-41c7-b529-99d909e2c5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:53.109414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-37ba5504-fee2-41c7-b529-99d909e2c5db None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:53.111697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-37ba5504-fee2-41c7-b529-99d909e2c5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:53.154724 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:53.155368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:53.155650 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:53.156038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] PATH_INFO: `/v3/users/1fa6ade5f5c04498a10f36d79c4413f6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:53.157322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa6ade5f5c04498a10f36d79c4413f6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:53.159413 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:53.196948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1256/2541] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:53.205169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3bc6e-7bf4-454a-bb8f-d41cce64bd26 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:53.205560 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3bc6e-7bf4-454a-bb8f-d41cce64bd26 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:53.207607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3bc6e-7bf4-454a-bb8f-d41cce64bd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:53.233156 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b7b3bc6e-7bf4-454a-bb8f-d41cce64bd26 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:53.234850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b7b3bc6e-7bf4-454a-bb8f-d41cce64bd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:53.245279 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1257/2542] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:53.250542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3bc6e-7bf4-454a-bb8f-d41cce64bd26 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:53.261166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3bc6e-7bf4-454a-bb8f-d41cce64bd26 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:53.267074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e94d9-eeef-421a-8244-7952d7f6dd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:53.267707 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e94d9-eeef-421a-8244-7952d7f6dd32 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:53.268010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e94d9-eeef-421a-8244-7952d7f6dd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:53.269201 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e94d9-eeef-421a-8244-7952d7f6dd32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:53.270043 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e94d9-eeef-421a-8244-7952d7f6dd32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:52:53.270347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e94d9-eeef-421a-8244-7952d7f6dd32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:53.271974 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e94d9-eeef-421a-8244-7952d7f6dd32 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:53.285431 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1258/2543] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:52:53.289921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e94d9-eeef-421a-8244-7952d7f6dd32 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:53.301533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e94d9-eeef-421a-8244-7952d7f6dd32 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:53.307003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b625a-f26a-4c19-8cf1-25cbc8306600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:53.307600 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b625a-f26a-4c19-8cf1-25cbc8306600 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:53.307913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b625a-f26a-4c19-8cf1-25cbc8306600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:53.312578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b625a-f26a-4c19-8cf1-25cbc8306600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:53.312578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b625a-f26a-4c19-8cf1-25cbc8306600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:53.314381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b625a-f26a-4c19-8cf1-25cbc8306600 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:53.420645 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa6ade5f5c04498a10f36d79c4413f6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:53.433777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:53.444711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1259/2544] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:53 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:53.446605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa6ade5f5c04498a10f36d79c4413f6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:53.455409 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b625a-f26a-4c19-8cf1-25cbc8306600 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:53.544202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b625a-f26a-4c19-8cf1-25cbc8306600 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:53.551801 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9927-c7aa-416c-9417-dbc103b3a977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:53.552458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9927-c7aa-416c-9417-dbc103b3a977 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:53.552737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9927-c7aa-416c-9417-dbc103b3a977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:53.553009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9927-c7aa-416c-9417-dbc103b3a977 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:53.553679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d9927-c7aa-416c-9417-dbc103b3a977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:53.556288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d9927-c7aa-416c-9417-dbc103b3a977 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:53.562745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa6ade5f5c04498a10f36d79c4413f6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:53.567031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa6ade5f5c04498a10f36d79c4413f6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:53.567031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa6ade5f5c04498a10f36d79c4413f6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:53.586338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1286/2545] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:53 2022] DELETE /identity/v3/users/1fa6ade5f5c04498a10f36d79c4413f6 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:53.661597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1260/2546] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:53 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:53.667973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:53.670511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:53.788382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dc481-9c8c-4ee9-8a50-203236e72fce admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:53.796129 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b028ee3-19d2-4adb-bf82-01568a6eb56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:53.797163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b028ee3-19d2-4adb-bf82-01568a6eb56c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:53.797642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b028ee3-19d2-4adb-bf82-01568a6eb56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:53.798044 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b028ee3-19d2-4adb-bf82-01568a6eb56c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:53.798722 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b028ee3-19d2-4adb-bf82-01568a6eb56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:53.801158 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b028ee3-19d2-4adb-bf82-01568a6eb56c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:53.815784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1287/2547] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:53.820298 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9927-c7aa-416c-9417-dbc103b3a977 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:53.835693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9927-c7aa-416c-9417-dbc103b3a977 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:53.844715 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8001b5-fe79-4897-b305-78b210ff54f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:53.845676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8001b5-fe79-4897-b305-78b210ff54f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:53.847886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8001b5-fe79-4897-b305-78b210ff54f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:53.848723 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8001b5-fe79-4897-b305-78b210ff54f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:53.849810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8001b5-fe79-4897-b305-78b210ff54f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:53.852103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8001b5-fe79-4897-b305-78b210ff54f0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:53.870381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1261/2548] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:53.875552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b028ee3-19d2-4adb-bf82-01568a6eb56c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:53.896254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b028ee3-19d2-4adb-bf82-01568a6eb56c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:53.903041 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f211fb-4a67-4844-8e9b-f7aa5dc8e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:53.904854 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f211fb-4a67-4844-8e9b-f7aa5dc8e774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:53.905653 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f211fb-4a67-4844-8e9b-f7aa5dc8e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:53.906304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f211fb-4a67-4844-8e9b-f7aa5dc8e774 admin admin] PATH_INFO: `/v3/projects/0c2cb666feef429bbd16d2907156819c/users/12e863e6a49a4d3dbd50c0b56d822ce3/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:53.942114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f211fb-4a67-4844-8e9b-f7aa5dc8e774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2cb666feef429bbd16d2907156819c, user_id=12e863e6a49a4d3dbd50c0b56d822ce3, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:53.945236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f211fb-4a67-4844-8e9b-f7aa5dc8e774 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:54.024592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8001b5-fe79-4897-b305-78b210ff54f0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:54.026464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3c8001b5-fe79-4897-b305-78b210ff54f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:54.068043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1288/2549] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:53 2022] PUT /identity/v3/projects/0c2cb666feef429bbd16d2907156819c/users/12e863e6a49a4d3dbd50c0b56d822ce3/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:54.075971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8001b5-fe79-4897-b305-78b210ff54f0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:54.080335 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc596d-8157-4d6a-9997-2339110b595d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:54.080873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc596d-8157-4d6a-9997-2339110b595d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:54.081285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc596d-8157-4d6a-9997-2339110b595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:54.135455 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e2cc596d-8157-4d6a-9997-2339110b595d None None] MFA Rules not processed for user `12e863e6a49a4d3dbd50c0b56d822ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:54.137088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e2cc596d-8157-4d6a-9997-2339110b595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:54.184505 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:54.185433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:54.185840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:54.185840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] PATH_INFO: `/v3/projects/5ccfc88dfe8e493b9656b991a9796836` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:54.187037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ccfc88dfe8e493b9656b991a9796836)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:54.189012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:54.245625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1289/2550] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:54.250787 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc596d-8157-4d6a-9997-2339110b595d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:54.263245 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc596d-8157-4d6a-9997-2339110b595d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:54.270082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1476-2476-4a6d-828e-9463191f0268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:54.270709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1476-2476-4a6d-828e-9463191f0268 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:54.270981 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1476-2476-4a6d-828e-9463191f0268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:54.271260 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1476-2476-4a6d-828e-9463191f0268 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:54.273051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f1476-2476-4a6d-828e-9463191f0268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:54.274285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f1476-2476-4a6d-828e-9463191f0268 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:54.351652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ccfc88dfe8e493b9656b991a9796836', 'request_id': 'req-b37ff57e-b949-452a-958e-675e66f3ebb4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:54.361186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ccfc88dfe8e493b9656b991a9796836', 'request_id': 'req-b37ff57e-b949-452a-958e-675e66f3ebb4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:54.424985 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1290/2551] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:54 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:54.429241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1476-2476-4a6d-828e-9463191f0268 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:54.444394 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ccfc88dfe8e493b9656b991a9796836', 'request_id': 'req-b37ff57e-b949-452a-958e-675e66f3ebb4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:54.464439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] The token cache is being invalidate because project 5ccfc88dfe8e493b9656b991a9796836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:54.464439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:54.465541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:54.468015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1262/2552] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:54 2022] DELETE /identity/v3/projects/5ccfc88dfe8e493b9656b991a9796836 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:54.476385 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:54.477924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:54.532166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1476-2476-4a6d-828e-9463191f0268 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:54.541592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160893d0-1f27-4f59-929f-6700919757eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:54.545070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160893d0-1f27-4f59-929f-6700919757eb admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:54.545729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160893d0-1f27-4f59-929f-6700919757eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:54.547705 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160893d0-1f27-4f59-929f-6700919757eb admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:54.549101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160893d0-1f27-4f59-929f-6700919757eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:54.553463 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160893d0-1f27-4f59-929f-6700919757eb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:54.578792 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ff57e-b949-452a-958e-675e66f3ebb4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:54.584929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:54.585929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:54.585929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:54.586563 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] PATH_INFO: `/v3/users/00ae0abac48a47e5ba3f618e323bc3e3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:54.588436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00ae0abac48a47e5ba3f618e323bc3e3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:54.590961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:54.652905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1291/2553] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:54 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:54.660591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160893d0-1f27-4f59-929f-6700919757eb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:54.663758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-160893d0-1f27-4f59-929f-6700919757eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:54.682580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160893d0-1f27-4f59-929f-6700919757eb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:54.689052 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f9aa8-66f9-457f-bb20-6e28f318f3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:54.689744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f9aa8-66f9-457f-bb20-6e28f318f3ee admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:54.690261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f9aa8-66f9-457f-bb20-6e28f318f3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:54.690844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f9aa8-66f9-457f-bb20-6e28f318f3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:54.691494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f9aa8-66f9-457f-bb20-6e28f318f3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:54.693369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f9aa8-66f9-457f-bb20-6e28f318f3ee admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:54.709264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1292/2554] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:52:54.713241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f9aa8-66f9-457f-bb20-6e28f318f3ee admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:54.728067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f9aa8-66f9-457f-bb20-6e28f318f3ee admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:54.735346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dcdac-0223-46dd-9e10-0a881fca04f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:54.735995 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dcdac-0223-46dd-9e10-0a881fca04f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:54.736314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dcdac-0223-46dd-9e10-0a881fca04f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:54.736589 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dcdac-0223-46dd-9e10-0a881fca04f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:54.738086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dcdac-0223-46dd-9e10-0a881fca04f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:54.740080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dcdac-0223-46dd-9e10-0a881fca04f9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:54.755972 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1293/2555] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:52:54.760287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dcdac-0223-46dd-9e10-0a881fca04f9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:54.770789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dcdac-0223-46dd-9e10-0a881fca04f9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:54.776611 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e1276-8f77-4f1c-bd4b-b377cddc66eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:54.777844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1276-8f77-4f1c-bd4b-b377cddc66eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:54.781427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1276-8f77-4f1c-bd4b-b377cddc66eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:54.781736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1276-8f77-4f1c-bd4b-b377cddc66eb admin admin] PATH_INFO: `/v3/projects/93cd2fd5a92e414fa5f1d6002c4c9318/users/7c1c21a53f6f4cdb819678d0ee966380/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:54.801067 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e1276-8f77-4f1c-bd4b-b377cddc66eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=93cd2fd5a92e414fa5f1d6002c4c9318, user_id=7c1c21a53f6f4cdb819678d0ee966380, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:54.806143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e1276-8f77-4f1c-bd4b-b377cddc66eb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:54.813783 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:54.820583 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ae0abac48a47e5ba3f618e323bc3e3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:54.821533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ae0abac48a47e5ba3f618e323bc3e3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:54.837033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ae0abac48a47e5ba3f618e323bc3e3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:54.845977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ae0abac48a47e5ba3f618e323bc3e3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:54.847656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ae0abac48a47e5ba3f618e323bc3e3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:54.894186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1294/2556] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:54 2022] PUT /identity/v3/projects/93cd2fd5a92e414fa5f1d6002c4c9318/users/7c1c21a53f6f4cdb819678d0ee966380/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:54.905699 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54a3bf-f087-4d35-9b4e-109f33e19d5c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:54.905986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54a3bf-f087-4d35-9b4e-109f33e19d5c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:54.906265 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54a3bf-f087-4d35-9b4e-109f33e19d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:54.927295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:54.933468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1263/2557] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:54 2022] DELETE /identity/v3/users/00ae0abac48a47e5ba3f618e323bc3e3 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:54.943028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5b54a3bf-f087-4d35-9b4e-109f33e19d5c None None] MFA Rules not processed for user `7c1c21a53f6f4cdb819678d0ee966380`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:54.944583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5b54a3bf-f087-4d35-9b4e-109f33e19d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:55.059346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1295/2558] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:55.064413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:55.066291 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:55.196400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfc3c0-60a7-4722-95c3-20c23c41d436 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:55.205101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c668-e0a1-492c-bcce-20f6bf3cfa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:55.206337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c668-e0a1-492c-bcce-20f6bf3cfa56 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:55.206612 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c668-e0a1-492c-bcce-20f6bf3cfa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:55.206874 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c668-e0a1-492c-bcce-20f6bf3cfa56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:55.207520 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5c668-e0a1-492c-bcce-20f6bf3cfa56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:55.209640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5c668-e0a1-492c-bcce-20f6bf3cfa56 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:55.305618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54a3bf-f087-4d35-9b4e-109f33e19d5c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:55.308446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5b54a3bf-f087-4d35-9b4e-109f33e19d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:55.312662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1264/2559] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:55 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:55.322353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c668-e0a1-492c-bcce-20f6bf3cfa56 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:55.332051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54a3bf-f087-4d35-9b4e-109f33e19d5c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:55.434697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c668-e0a1-492c-bcce-20f6bf3cfa56 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:55.446110 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd243b8-e2da-4c6d-aa8b-e1a4f37c9053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:55.449288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd243b8-e2da-4c6d-aa8b-e1a4f37c9053 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:55.449288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd243b8-e2da-4c6d-aa8b-e1a4f37c9053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:55.449288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd243b8-e2da-4c6d-aa8b-e1a4f37c9053 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:55.449288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd243b8-e2da-4c6d-aa8b-e1a4f37c9053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:55.450139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd243b8-e2da-4c6d-aa8b-e1a4f37c9053 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:55.459901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a287ab4-f365-492e-b840-6474dd08fe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:55.468076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a287ab4-f365-492e-b840-6474dd08fe6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:55.468076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a287ab4-f365-492e-b840-6474dd08fe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:55.468076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a287ab4-f365-492e-b840-6474dd08fe6e admin admin] PATH_INFO: `/v3/projects/0eda3359901149e58615dd2ea883d577` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:55.468076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a287ab4-f365-492e-b840-6474dd08fe6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eda3359901149e58615dd2ea883d577)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:55.468076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a287ab4-f365-492e-b840-6474dd08fe6e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:55.544858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1265/2560] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:55 2022] POST /identity/v3/users => generated 295 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:55.550202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd243b8-e2da-4c6d-aa8b-e1a4f37c9053 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:55.560946 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd243b8-e2da-4c6d-aa8b-e1a4f37c9053 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:55.570664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d792c-889f-410c-8413-01b489c52810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:55.571457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d792c-889f-410c-8413-01b489c52810 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:55.572115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d792c-889f-410c-8413-01b489c52810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:55.572430 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d792c-889f-410c-8413-01b489c52810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:55.577134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d792c-889f-410c-8413-01b489c52810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:55.577134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d792c-889f-410c-8413-01b489c52810 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:55.588968 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1266/2561] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:52:55.594197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a287ab4-f365-492e-b840-6474dd08fe6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eda3359901149e58615dd2ea883d577', 'request_id': 'req-4a287ab4-f365-492e-b840-6474dd08fe6e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:55.604082 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a287ab4-f365-492e-b840-6474dd08fe6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eda3359901149e58615dd2ea883d577', 'request_id': 'req-4a287ab4-f365-492e-b840-6474dd08fe6e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:55.605728 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d792c-889f-410c-8413-01b489c52810 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:55.617503 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d792c-889f-410c-8413-01b489c52810 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:55.697875 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b1aba-0c14-47b1-ae29-b553d71b1623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:55.698546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b1aba-0c14-47b1-ae29-b553d71b1623 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:55.700179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b1aba-0c14-47b1-ae29-b553d71b1623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:55.700179 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b1aba-0c14-47b1-ae29-b553d71b1623 admin admin] PATH_INFO: `/v3/projects/8b16032f3b2a4d5b9ee292c5854d20e4/users/f2f77357db0943318aab606ee6942e34/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:55.716529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b1aba-0c14-47b1-ae29-b553d71b1623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b16032f3b2a4d5b9ee292c5854d20e4, user_id=f2f77357db0943318aab606ee6942e34, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:55.719344 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b1aba-0c14-47b1-ae29-b553d71b1623 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:55.719644 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a287ab4-f365-492e-b840-6474dd08fe6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eda3359901149e58615dd2ea883d577', 'request_id': 'req-4a287ab4-f365-492e-b840-6474dd08fe6e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:55.731543 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a287ab4-f365-492e-b840-6474dd08fe6e admin admin] The token cache is being invalidate because project 0eda3359901149e58615dd2ea883d577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:55.731858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a287ab4-f365-492e-b840-6474dd08fe6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:55.732511 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a287ab4-f365-492e-b840-6474dd08fe6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:55.734011 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1296/2562] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:55 2022] DELETE /identity/v3/projects/0eda3359901149e58615dd2ea883d577 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:55.739969 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e337d-cbd2-4401-9e67-533f30d995f0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:55.740274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e337d-cbd2-4401-9e67-533f30d995f0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:55.740562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e337d-cbd2-4401-9e67-533f30d995f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:55.761224 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-088e337d-cbd2-4401-9e67-533f30d995f0 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:55.762446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-088e337d-cbd2-4401-9e67-533f30d995f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:55.771693 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1297/2563] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:55.785375 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fc6be-720c-47c8-98c4-4a297bb5a5ff None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:55.785739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fc6be-720c-47c8-98c4-4a297bb5a5ff None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:55.786937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fc6be-720c-47c8-98c4-4a297bb5a5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:55.809694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1267/2564] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:55 2022] PUT /identity/v3/projects/8b16032f3b2a4d5b9ee292c5854d20e4/users/f2f77357db0943318aab606ee6942e34/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:55.817547 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b1aba-0c14-47b1-ae29-b553d71b1623 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:55.820594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-491b1aba-0c14-47b1-ae29-b553d71b1623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:55.831585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f31fc6be-720c-47c8-98c4-4a297bb5a5ff None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:55.835101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f31fc6be-720c-47c8-98c4-4a297bb5a5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:55.901194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b1aba-0c14-47b1-ae29-b553d71b1623 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:55.906585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e277028-ff27-47f9-bddd-b5576bc69446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:55.907089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1298/2565] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:55.907356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e277028-ff27-47f9-bddd-b5576bc69446 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:55.907524 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e277028-ff27-47f9-bddd-b5576bc69446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:55.908735 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e277028-ff27-47f9-bddd-b5576bc69446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:55.908735 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e277028-ff27-47f9-bddd-b5576bc69446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:55.911526 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fc6be-720c-47c8-98c4-4a297bb5a5ff None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:55.911785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e277028-ff27-47f9-bddd-b5576bc69446 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:55.921147 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fc6be-720c-47c8-98c4-4a297bb5a5ff None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:55.923318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1268/2566] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:55.929278 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554d91-92ff-46d8-ad58-227b48875b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:55.930249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554d91-92ff-46d8-ad58-227b48875b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:55.930425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e277028-ff27-47f9-bddd-b5576bc69446 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:55.930706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554d91-92ff-46d8-ad58-227b48875b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:55.931069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554d91-92ff-46d8-ad58-227b48875b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:55.932405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f554d91-92ff-46d8-ad58-227b48875b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:52:55.932954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f554d91-92ff-46d8-ad58-227b48875b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:55.937415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f554d91-92ff-46d8-ad58-227b48875b43 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:55.952057 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e277028-ff27-47f9-bddd-b5576bc69446 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:55.958598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1299/2567] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:52:55.960323 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5b220-7a49-48cb-b20a-5e703024a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:55.961403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5b220-7a49-48cb-b20a-5e703024a10c admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:55.961841 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5b220-7a49-48cb-b20a-5e703024a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:55.962322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5b220-7a49-48cb-b20a-5e703024a10c admin admin] PATH_INFO: `/v3/projects/8b16032f3b2a4d5b9ee292c5854d20e4/users/f2f77357db0943318aab606ee6942e34/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:55.963697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554d91-92ff-46d8-ad58-227b48875b43 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:55.964967 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5b220-7a49-48cb-b20a-5e703024a10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b16032f3b2a4d5b9ee292c5854d20e4, user_id=f2f77357db0943318aab606ee6942e34, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:55.968395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5b220-7a49-48cb-b20a-5e703024a10c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:55.979488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554d91-92ff-46d8-ad58-227b48875b43 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:55.987910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1269/2568] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:55 2022] PUT /identity/v3/projects/8b16032f3b2a4d5b9ee292c5854d20e4/users/f2f77357db0943318aab606ee6942e34/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:56.005523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227648d4-6565-42af-925a-4ac8aeea7ea5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:56.005870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227648d4-6565-42af-925a-4ac8aeea7ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:56.006299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227648d4-6565-42af-925a-4ac8aeea7ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:56.041336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-227648d4-6565-42af-925a-4ac8aeea7ea5 None None] MFA Rules not processed for user `f2f77357db0943318aab606ee6942e34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:56.042557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-227648d4-6565-42af-925a-4ac8aeea7ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:56.075458 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7569e-6b60-4276-ba0a-1f0256815d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:56.076415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7569e-6b60-4276-ba0a-1f0256815d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:56.076807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7569e-6b60-4276-ba0a-1f0256815d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:56.077088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7569e-6b60-4276-ba0a-1f0256815d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:56.077775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7569e-6b60-4276-ba0a-1f0256815d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:56.079729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7569e-6b60-4276-ba0a-1f0256815d83 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:56.093946 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:56.153151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1270/2569] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:56.168954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227648d4-6565-42af-925a-4ac8aeea7ea5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:56.170999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-227648d4-6565-42af-925a-4ac8aeea7ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:56.204662 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1300/2570] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:55 2022] POST /identity/v3/projects => generated 363 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:56.209942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7569e-6b60-4276-ba0a-1f0256815d83 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:56.230355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:56.276880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227648d4-6565-42af-925a-4ac8aeea7ea5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:56.314999 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7569e-6b60-4276-ba0a-1f0256815d83 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:56.324833 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa64f0-6b45-4db2-a36c-7daf3fe03e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:56.325748 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa64f0-6b45-4db2-a36c-7daf3fe03e4e admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:56.326022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa64f0-6b45-4db2-a36c-7daf3fe03e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:56.326301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa64f0-6b45-4db2-a36c-7daf3fe03e4e admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:56.327287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa64f0-6b45-4db2-a36c-7daf3fe03e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:56.329465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa64f0-6b45-4db2-a36c-7daf3fe03e4e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:56.353234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618da26a-7e00-462d-b0b3-6a2e820e7be3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:56.354382 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618da26a-7e00-462d-b0b3-6a2e820e7be3 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:56.354910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618da26a-7e00-462d-b0b3-6a2e820e7be3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:56.355343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618da26a-7e00-462d-b0b3-6a2e820e7be3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:56.434301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1301/2571] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:56 2022] POST /identity/v3/users => generated 282 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:56.441005 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa64f0-6b45-4db2-a36c-7daf3fe03e4e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:56.442198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618da26a-7e00-462d-b0b3-6a2e820e7be3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:56.443960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618da26a-7e00-462d-b0b3-6a2e820e7be3 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:56.456180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1271/2572] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:52:56.463033 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa64f0-6b45-4db2-a36c-7daf3fe03e4e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:56.477580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713cd77-6163-40e0-b374-4c09f1a3c232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:56.478965 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713cd77-6163-40e0-b374-4c09f1a3c232 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:56.479498 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713cd77-6163-40e0-b374-4c09f1a3c232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:56.479908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713cd77-6163-40e0-b374-4c09f1a3c232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:56.481859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713cd77-6163-40e0-b374-4c09f1a3c232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:56.483528 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713cd77-6163-40e0-b374-4c09f1a3c232 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:56.499759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1302/2573] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:52:56.504041 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618da26a-7e00-462d-b0b3-6a2e820e7be3 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:56.516000 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618da26a-7e00-462d-b0b3-6a2e820e7be3 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:56.522117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bba81-d6e9-41fd-aaa2-6bc402aeace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:56.522745 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bba81-d6e9-41fd-aaa2-6bc402aeace1 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:56.522997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bba81-d6e9-41fd-aaa2-6bc402aeace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:56.523282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bba81-d6e9-41fd-aaa2-6bc402aeace1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:56.523924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bba81-d6e9-41fd-aaa2-6bc402aeace1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:56.525521 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bba81-d6e9-41fd-aaa2-6bc402aeace1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:56.536484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1272/2574] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:56.541365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713cd77-6163-40e0-b374-4c09f1a3c232 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:56.552657 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:56.560297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713cd77-6163-40e0-b374-4c09f1a3c232 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:56.567176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0728306-01c9-446d-b666-ceb38e8c8602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:56.569110 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0728306-01c9-446d-b666-ceb38e8c8602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:56.569110 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0728306-01c9-446d-b666-ceb38e8c8602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:56.569110 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0728306-01c9-446d-b666-ceb38e8c8602 admin admin] PATH_INFO: `/v3/projects/0a25ccfad0004f7c99fffdf8f543fffc/users/564d05665987427f9f9363261b92bfcd/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:56.614728 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bba81-d6e9-41fd-aaa2-6bc402aeace1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:56.619139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:56.621758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0728306-01c9-446d-b666-ceb38e8c8602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a25ccfad0004f7c99fffdf8f543fffc, user_id=564d05665987427f9f9363261b92bfcd, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:56.623806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-559bba81-d6e9-41fd-aaa2-6bc402aeace1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:56.627694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0728306-01c9-446d-b666-ceb38e8c8602 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:56.646151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bba81-d6e9-41fd-aaa2-6bc402aeace1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:56.650677 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0780ae1-22c4-4897-bdef-62a4bbd89b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:56.651413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0780ae1-22c4-4897-bdef-62a4bbd89b50 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:56.651696 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0780ae1-22c4-4897-bdef-62a4bbd89b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:56.652010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0780ae1-22c4-4897-bdef-62a4bbd89b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:56.654478 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d0780ae1-22c4-4897-bdef-62a4bbd89b50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:56.738855 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0780ae1-22c4-4897-bdef-62a4bbd89b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:56.739449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1303/2575] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:56 2022] PUT /identity/v3/projects/0a25ccfad0004f7c99fffdf8f543fffc/users/564d05665987427f9f9363261b92bfcd/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:56.740820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0780ae1-22c4-4897-bdef-62a4bbd89b50 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:56.752497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1273/2576] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:52:56.767145 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004e74c-11e7-493a-82fe-ed5c9a4d561f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:56.767145 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004e74c-11e7-493a-82fe-ed5c9a4d561f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:56.767145 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004e74c-11e7-493a-82fe-ed5c9a4d561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:56.812790 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0004e74c-11e7-493a-82fe-ed5c9a4d561f None None] MFA Rules not processed for user `564d05665987427f9f9363261b92bfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:56.814114 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0004e74c-11e7-493a-82fe-ed5c9a4d561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:56.934541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:56.956670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1304/2577] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:56.962622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0780ae1-22c4-4897-bdef-62a4bbd89b50 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:56.978275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0780ae1-22c4-4897-bdef-62a4bbd89b50 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:57.052423 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:57.077525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708ba45-011c-45fc-a7b5-5bdc8c43ca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:57.078510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708ba45-011c-45fc-a7b5-5bdc8c43ca0f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:57.078870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708ba45-011c-45fc-a7b5-5bdc8c43ca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:57.081189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708ba45-011c-45fc-a7b5-5bdc8c43ca0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:57.081189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708ba45-011c-45fc-a7b5-5bdc8c43ca0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:57.083533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708ba45-011c-45fc-a7b5-5bdc8c43ca0f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:57.329243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1274/2578] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:56 2022] POST /identity/v3/projects => generated 365 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:57.334515 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004e74c-11e7-493a-82fe-ed5c9a4d561f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:57.348975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004e74c-11e7-493a-82fe-ed5c9a4d561f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:57.436831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708ba45-011c-45fc-a7b5-5bdc8c43ca0f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:57.438743 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8708ba45-011c-45fc-a7b5-5bdc8c43ca0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:57.441716 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21d7d-707b-453f-9de3-bc016ce5f7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:57.442763 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21d7d-707b-453f-9de3-bc016ce5f7ae admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:57.442940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21d7d-707b-453f-9de3-bc016ce5f7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:57.443133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21d7d-707b-453f-9de3-bc016ce5f7ae admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:57.443753 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c21d7d-707b-453f-9de3-bc016ce5f7ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:57.446040 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c21d7d-707b-453f-9de3-bc016ce5f7ae admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:57.457732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708ba45-011c-45fc-a7b5-5bdc8c43ca0f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:57.464433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:57.464689 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:57.464969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:57.465216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] PATH_INFO: `/v3/users/5ccf8ad84e9141d69df712cd5a8d14eb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:57.466621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ccf8ad84e9141d69df712cd5a8d14eb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:57.468589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:57.522558 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:57.564454 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1305/2579] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:57 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:57.566401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21d7d-707b-453f-9de3-bc016ce5f7ae admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:57.579877 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21d7d-707b-453f-9de3-bc016ce5f7ae admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:57.586858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc22f5-1d37-42d9-ad05-c56186a28a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:57.587470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc22f5-1d37-42d9-ad05-c56186a28a1b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:57.587773 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc22f5-1d37-42d9-ad05-c56186a28a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:57.588048 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc22f5-1d37-42d9-ad05-c56186a28a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:57.588701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc22f5-1d37-42d9-ad05-c56186a28a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:57.590394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc22f5-1d37-42d9-ad05-c56186a28a1b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:57.603944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1306/2580] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:57.608316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc22f5-1d37-42d9-ad05-c56186a28a1b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:57.620448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc22f5-1d37-42d9-ad05-c56186a28a1b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:57.625773 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceba518-5f58-4b79-9d24-5659083301a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:57.626434 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba518-5f58-4b79-9d24-5659083301a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:57.626710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba518-5f58-4b79-9d24-5659083301a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:57.634458 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba518-5f58-4b79-9d24-5659083301a1 admin admin] PATH_INFO: `/v3/projects/1224c3f235134e6199517fa63e8246f9/users/df1dab06eba044c18a1aab2fa320ddfb/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:57.646659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceba518-5f58-4b79-9d24-5659083301a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1224c3f235134e6199517fa63e8246f9, user_id=df1dab06eba044c18a1aab2fa320ddfb, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:57.651502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceba518-5f58-4b79-9d24-5659083301a1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:57.751356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ccf8ad84e9141d69df712cd5a8d14eb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:57.752040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ccf8ad84e9141d69df712cd5a8d14eb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:57.764789 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ccf8ad84e9141d69df712cd5a8d14eb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:57.772182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ccf8ad84e9141d69df712cd5a8d14eb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:57.777447 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ccf8ad84e9141d69df712cd5a8d14eb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:57.828987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1307/2581] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:57 2022] PUT /identity/v3/projects/1224c3f235134e6199517fa63e8246f9/users/df1dab06eba044c18a1aab2fa320ddfb/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:57.833950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceba518-5f58-4b79-9d24-5659083301a1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:57.835823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dceba518-5f58-4b79-9d24-5659083301a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:57.876021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1275/2582] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:52:57 2022] DELETE /identity/v3/users/5ccf8ad84e9141d69df712cd5a8d14eb => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:57.896973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:58.026841 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceba518-5f58-4b79-9d24-5659083301a1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:58.103536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e3e9-26a6-4081-8317-38baacb4f9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:58.104257 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e3e9-26a6-4081-8317-38baacb4f9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:58.104538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e3e9-26a6-4081-8317-38baacb4f9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:58.104801 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e3e9-26a6-4081-8317-38baacb4f9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:58.105450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e3e9-26a6-4081-8317-38baacb4f9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:58.107116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e3e9-26a6-4081-8317-38baacb4f9d7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:58.119820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1308/2583] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:52:58.124984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:58.213372 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5b88b-1f7f-4808-9f4c-4d28eeb406f2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:58.214947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e3e9-26a6-4081-8317-38baacb4f9d7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:58.223507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5583e3e9-26a6-4081-8317-38baacb4f9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:58.229026 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b594d-55c3-445f-a5d5-aae656787e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:58.231192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b594d-55c3-445f-a5d5-aae656787e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:58.231959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b594d-55c3-445f-a5d5-aae656787e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:58.232639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b594d-55c3-445f-a5d5-aae656787e48 admin admin] PATH_INFO: `/v3/projects/1224c3f235134e6199517fa63e8246f9/users/df1dab06eba044c18a1aab2fa320ddfb/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:58.236514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b594d-55c3-445f-a5d5-aae656787e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1224c3f235134e6199517fa63e8246f9, user_id=df1dab06eba044c18a1aab2fa320ddfb, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:58.242370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b594d-55c3-445f-a5d5-aae656787e48 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:58.247385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e3e9-26a6-4081-8317-38baacb4f9d7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:58.255962 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d42ad-eb9d-4472-b7d1-63b0a968beff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:58.257018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d42ad-eb9d-4472-b7d1-63b0a968beff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:58.257829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d42ad-eb9d-4472-b7d1-63b0a968beff admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:58.258764 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d42ad-eb9d-4472-b7d1-63b0a968beff admin admin] PATH_INFO: `/v3/projects/e961ee9404de4464b721d31c607cae20` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:58.265392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d42ad-eb9d-4472-b7d1-63b0a968beff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e961ee9404de4464b721d31c607cae20)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:58.266098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1276/2584] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:58 2022] PUT /identity/v3/projects/1224c3f235134e6199517fa63e8246f9/users/df1dab06eba044c18a1aab2fa320ddfb/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:52:58.267815 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d42ad-eb9d-4472-b7d1-63b0a968beff admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:58.280669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc11eb-f34d-45a5-b095-2d3311819774 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:58.280957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc11eb-f34d-45a5-b095-2d3311819774 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:58.281115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc11eb-f34d-45a5-b095-2d3311819774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:58.318350 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f1dc11eb-f34d-45a5-b095-2d3311819774 None None] MFA Rules not processed for user `df1dab06eba044c18a1aab2fa320ddfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:58.319629 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f1dc11eb-f34d-45a5-b095-2d3311819774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:58.368140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:58.422541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1277/2585] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:52:58.439328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc11eb-f34d-45a5-b095-2d3311819774 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:58.441978 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f1dc11eb-f34d-45a5-b095-2d3311819774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:58.448554 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-836d42ad-eb9d-4472-b7d1-63b0a968beff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e961ee9404de4464b721d31c607cae20', 'request_id': 'req-836d42ad-eb9d-4472-b7d1-63b0a968beff'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:58.459614 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-836d42ad-eb9d-4472-b7d1-63b0a968beff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e961ee9404de4464b721d31c607cae20', 'request_id': 'req-836d42ad-eb9d-4472-b7d1-63b0a968beff'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:58.538232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc11eb-f34d-45a5-b095-2d3311819774 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:58.551830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-836d42ad-eb9d-4472-b7d1-63b0a968beff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e961ee9404de4464b721d31c607cae20', 'request_id': 'req-836d42ad-eb9d-4472-b7d1-63b0a968beff'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:58.561057 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:58.579875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-836d42ad-eb9d-4472-b7d1-63b0a968beff admin admin] The token cache is being invalidate because project e961ee9404de4464b721d31c607cae20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:52:58.580897 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-836d42ad-eb9d-4472-b7d1-63b0a968beff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:58.582365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-836d42ad-eb9d-4472-b7d1-63b0a968beff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:52:58.584353 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1309/2586] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:52:58 2022] DELETE /identity/v3/projects/e961ee9404de4464b721d31c607cae20 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:58.590032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8404b1-1b2c-40de-b53d-fbe8c998a46e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:58.590315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8404b1-1b2c-40de-b53d-fbe8c998a46e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:58.590595 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8404b1-1b2c-40de-b53d-fbe8c998a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:58.616978 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25af472-7009-42cf-a0a7-1b2f28bed804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:58.618151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25af472-7009-42cf-a0a7-1b2f28bed804 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:58.618708 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25af472-7009-42cf-a0a7-1b2f28bed804 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:58.619137 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25af472-7009-42cf-a0a7-1b2f28bed804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:58.621342 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d25af472-7009-42cf-a0a7-1b2f28bed804 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:58.685965 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-fb8404b1-1b2c-40de-b53d-fbe8c998a46e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:58.688337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fb8404b1-1b2c-40de-b53d-fbe8c998a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:58.746136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25af472-7009-42cf-a0a7-1b2f28bed804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:58.748119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25af472-7009-42cf-a0a7-1b2f28bed804 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:58.762139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1278/2587] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:52:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:52:58.803850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1310/2588] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:58.815790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73fa3-fc7c-4849-b0d6-6882be854664 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:58.816074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73fa3-fc7c-4849-b0d6-6882be854664 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:58.816351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73fa3-fc7c-4849-b0d6-6882be854664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:58.839286 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e1b73fa3-fc7c-4849-b0d6-6882be854664 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:58.840853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e1b73fa3-fc7c-4849-b0d6-6882be854664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:58.852012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1279/2589] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:58.857178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8404b1-1b2c-40de-b53d-fbe8c998a46e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:58.869680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8404b1-1b2c-40de-b53d-fbe8c998a46e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:58.875397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb55efb-31f5-498b-b96e-5735b5d7c69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:58.876233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb55efb-31f5-498b-b96e-5735b5d7c69f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:58.876694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb55efb-31f5-498b-b96e-5735b5d7c69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:58.877211 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb55efb-31f5-498b-b96e-5735b5d7c69f admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:58.878018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb55efb-31f5-498b-b96e-5735b5d7c69f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:52:58.878431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb55efb-31f5-498b-b96e-5735b5d7c69f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:58.880495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb55efb-31f5-498b-b96e-5735b5d7c69f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:58.903151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1311/2590] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:52:58.904823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b73fa3-fc7c-4849-b0d6-6882be854664 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:58.923542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b73fa3-fc7c-4849-b0d6-6882be854664 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:58.930791 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9795a-d156-43e2-a4bc-00ef9bfb01d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:58.931771 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9795a-d156-43e2-a4bc-00ef9bfb01d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:58.932058 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9795a-d156-43e2-a4bc-00ef9bfb01d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:58.932504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9795a-d156-43e2-a4bc-00ef9bfb01d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:58.933202 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9795a-d156-43e2-a4bc-00ef9bfb01d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:58.935302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9795a-d156-43e2-a4bc-00ef9bfb01d0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:58.942595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:59.051001 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1280/2591] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:52:58 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:52:59.055534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb55efb-31f5-498b-b96e-5735b5d7c69f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:59.069661 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb55efb-31f5-498b-b96e-5735b5d7c69f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:59.173782 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad037a7-ca34-4bd7-85f0-431a40e542ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:59.176692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad037a7-ca34-4bd7-85f0-431a40e542ef admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:59.176692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad037a7-ca34-4bd7-85f0-431a40e542ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:59.176692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad037a7-ca34-4bd7-85f0-431a40e542ef admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:59.176692 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad037a7-ca34-4bd7-85f0-431a40e542ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:59.178827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad037a7-ca34-4bd7-85f0-431a40e542ef admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:59.355171 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1312/2592] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:52:59 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:52:59.360532 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9795a-d156-43e2-a4bc-00ef9bfb01d0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:59.373467 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9795a-d156-43e2-a4bc-00ef9bfb01d0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:59.383221 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9dd80-73bc-4504-8e0b-c7172754f655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:59.384609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9dd80-73bc-4504-8e0b-c7172754f655 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:59.385240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9dd80-73bc-4504-8e0b-c7172754f655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:59.385900 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9dd80-73bc-4504-8e0b-c7172754f655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:59.387093 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9dd80-73bc-4504-8e0b-c7172754f655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:59.401064 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9dd80-73bc-4504-8e0b-c7172754f655 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:59.458381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1281/2593] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:52:59.462822 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad037a7-ca34-4bd7-85f0-431a40e542ef admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:59.483459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad037a7-ca34-4bd7-85f0-431a40e542ef admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:59.493288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2ed72-a5af-4d1d-be04-557f49e4e83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:59.494349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2ed72-a5af-4d1d-be04-557f49e4e83b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:59.494864 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2ed72-a5af-4d1d-be04-557f49e4e83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:59.495357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2ed72-a5af-4d1d-be04-557f49e4e83b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:59.496842 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2ed72-a5af-4d1d-be04-557f49e4e83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:59.499987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2ed72-a5af-4d1d-be04-557f49e4e83b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:59.527219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1313/2594] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:52:59.529263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9dd80-73bc-4504-8e0b-c7172754f655 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:59.553101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9dd80-73bc-4504-8e0b-c7172754f655 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:59.561359 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e3017-0be1-477a-b1f8-5ec8cedcacde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:59.562425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3017-0be1-477a-b1f8-5ec8cedcacde admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:59.563303 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3017-0be1-477a-b1f8-5ec8cedcacde admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:59.563303 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3017-0be1-477a-b1f8-5ec8cedcacde admin admin] PATH_INFO: `/v3/projects/4930556c77524d18bdcfbafb47732832/users/bc818edc509d423b99476981532f02a9/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:59.588610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e3017-0be1-477a-b1f8-5ec8cedcacde admin admin] RBAC: Authorizing `identity:create_grant(project_id=4930556c77524d18bdcfbafb47732832, user_id=bc818edc509d423b99476981532f02a9, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:59.591439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e3017-0be1-477a-b1f8-5ec8cedcacde admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:59.730818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1282/2595] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:52:59 2022] PUT /identity/v3/projects/4930556c77524d18bdcfbafb47732832/users/bc818edc509d423b99476981532f02a9/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:52:59.734199 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d40a-b6f7-49d5-84bd-6d5c79dee36f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:59.735928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d40a-b6f7-49d5-84bd-6d5c79dee36f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:59.736346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d40a-b6f7-49d5-84bd-6d5c79dee36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:59.812505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0211d40a-b6f7-49d5-84bd-6d5c79dee36f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:59.814613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0211d40a-b6f7-49d5-84bd-6d5c79dee36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:59.910264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:00.000734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1314/2596] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:00.012849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e3017-0be1-477a-b1f8-5ec8cedcacde admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:00.015640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2e0e3017-0be1-477a-b1f8-5ec8cedcacde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:00.116125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e3017-0be1-477a-b1f8-5ec8cedcacde admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:00.120809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d575c-c3f3-4979-a069-5fcdb2784b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:00.121541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d575c-c3f3-4979-a069-5fcdb2784b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:00.121820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d575c-c3f3-4979-a069-5fcdb2784b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:00.122091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d575c-c3f3-4979-a069-5fcdb2784b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:00.140146 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d575c-c3f3-4979-a069-5fcdb2784b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:00.145337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d575c-c3f3-4979-a069-5fcdb2784b10 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:00.154360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1283/2597] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:00.344974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211d40a-b6f7-49d5-84bd-6d5c79dee36f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:00.348233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0211d40a-b6f7-49d5-84bd-6d5c79dee36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:00.377892 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211d40a-b6f7-49d5-84bd-6d5c79dee36f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:00.403516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:00.404779 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:00.405194 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:00.405580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] PATH_INFO: `/v3/users/564d05665987427f9f9363261b92bfcd` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:00.408269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=564d05665987427f9f9363261b92bfcd)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:00.412059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:00.671582 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564d05665987427f9f9363261b92bfcd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:00.714916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564d05665987427f9f9363261b92bfcd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:00.850630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564d05665987427f9f9363261b92bfcd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:00.851360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564d05665987427f9f9363261b92bfcd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:00.853219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564d05665987427f9f9363261b92bfcd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:00.878652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1315/2598] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:00 2022] DELETE /identity/v3/users/564d05665987427f9f9363261b92bfcd => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:00.884682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575f504-2dd5-422c-9985-016414df9f68 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:00.885301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575f504-2dd5-422c-9985-016414df9f68 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:00.885301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575f504-2dd5-422c-9985-016414df9f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:00.909999 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2575f504-2dd5-422c-9985-016414df9f68 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:00.912079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2575f504-2dd5-422c-9985-016414df9f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:01.061665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1284/2599] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:01.076830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:01.078593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:01.163483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269f435-e997-4896-af68-efd9f45fecaa admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:01.175394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3d992-8f05-4ee8-b55d-d62c3c825eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:01.175394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d992-8f05-4ee8-b55d-d62c3c825eda service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:01.175394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d992-8f05-4ee8-b55d-d62c3c825eda service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:01.175394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d992-8f05-4ee8-b55d-d62c3c825eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:01.184581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3d992-8f05-4ee8-b55d-d62c3c825eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:01.188562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3d992-8f05-4ee8-b55d-d62c3c825eda service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:01.201109 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1316/2600] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:01.885371 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575f504-2dd5-422c-9985-016414df9f68 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:01.886984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2575f504-2dd5-422c-9985-016414df9f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:01.933893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575f504-2dd5-422c-9985-016414df9f68 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:01.940403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:01.941702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:01.941974 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:01.942468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] PATH_INFO: `/v3/projects/0a25ccfad0004f7c99fffdf8f543fffc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:01.944169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a25ccfad0004f7c99fffdf8f543fffc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:01.946068 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:02.074659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3d992-8f05-4ee8-b55d-d62c3c825eda service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:02.078471 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-77c3d992-8f05-4ee8-b55d-d62c3c825eda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:02.102477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3d992-8f05-4ee8-b55d-d62c3c825eda service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:02.112284 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da455709-6075-4859-961d-b01843c34c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:02.114964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da455709-6075-4859-961d-b01843c34c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:02.116172 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da455709-6075-4859-961d-b01843c34c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:02.116793 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da455709-6075-4859-961d-b01843c34c77 admin admin] PATH_INFO: `/v3/users/12e863e6a49a4d3dbd50c0b56d822ce3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:02.119817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da455709-6075-4859-961d-b01843c34c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e863e6a49a4d3dbd50c0b56d822ce3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:02.126852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da455709-6075-4859-961d-b01843c34c77 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:02.153340 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:02.155442 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a25ccfad0004f7c99fffdf8f543fffc', 'request_id': 'req-cafd8040-7db3-431f-a3ad-42fc2c1b2712'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.164077 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a25ccfad0004f7c99fffdf8f543fffc', 'request_id': 'req-cafd8040-7db3-431f-a3ad-42fc2c1b2712'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.256719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a25ccfad0004f7c99fffdf8f543fffc', 'request_id': 'req-cafd8040-7db3-431f-a3ad-42fc2c1b2712'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.272870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] The token cache is being invalidate because project 0a25ccfad0004f7c99fffdf8f543fffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:02.272870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.275049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.279687 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1285/2601] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:01 2022] DELETE /identity/v3/projects/0a25ccfad0004f7c99fffdf8f543fffc => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:02.281187 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:02.288292 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:02.414599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:02.421378 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da455709-6075-4859-961d-b01843c34c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e863e6a49a4d3dbd50c0b56d822ce3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.459059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da455709-6075-4859-961d-b01843c34c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e863e6a49a4d3dbd50c0b56d822ce3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.473418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd8040-7db3-431f-a3ad-42fc2c1b2712 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:02.482971 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:02.484082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:02.484768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:02.485335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] PATH_INFO: `/v3/users/df1dab06eba044c18a1aab2fa320ddfb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:02.486977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=df1dab06eba044c18a1aab2fa320ddfb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:02.491215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:02.617623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da455709-6075-4859-961d-b01843c34c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e863e6a49a4d3dbd50c0b56d822ce3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.618482 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da455709-6075-4859-961d-b01843c34c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e863e6a49a4d3dbd50c0b56d822ce3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.619459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da455709-6075-4859-961d-b01843c34c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e863e6a49a4d3dbd50c0b56d822ce3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.642321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1317/2602] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:02 2022] DELETE /identity/v3/users/12e863e6a49a4d3dbd50c0b56d822ce3 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:53:02.648797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94eeb6-b0ef-4a31-9c36-fb58b7bb0c6a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:02.649337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94eeb6-b0ef-4a31-9c36-fb58b7bb0c6a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:02.649688 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94eeb6-b0ef-4a31-9c36-fb58b7bb0c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:02.679355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-af94eeb6-b0ef-4a31-9c36-fb58b7bb0c6a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:02.680827 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-af94eeb6-b0ef-4a31-9c36-fb58b7bb0c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:02.782521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1318/2603] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:53:02.789719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df1dab06eba044c18a1aab2fa320ddfb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.790822 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df1dab06eba044c18a1aab2fa320ddfb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.797201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94eeb6-b0ef-4a31-9c36-fb58b7bb0c6a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:02.800671 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-af94eeb6-b0ef-4a31-9c36-fb58b7bb0c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:02.811795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df1dab06eba044c18a1aab2fa320ddfb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.823667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df1dab06eba044c18a1aab2fa320ddfb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.824591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df1dab06eba044c18a1aab2fa320ddfb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:02.890369 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94eeb6-b0ef-4a31-9c36-fb58b7bb0c6a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:02.902254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ec47a-8a0e-4108-88c0-03840991c492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:02.906233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ec47a-8a0e-4108-88c0-03840991c492 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:02.906795 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ec47a-8a0e-4108-88c0-03840991c492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:02.907441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ec47a-8a0e-4108-88c0-03840991c492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:02.913663 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2c2ec47a-8a0e-4108-88c0-03840991c492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:02.942414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ec47a-8a0e-4108-88c0-03840991c492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:02.946672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ec47a-8a0e-4108-88c0-03840991c492 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:02.971532 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1319/2604] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:53:02.995397 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1286/2605] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:02 2022] DELETE /identity/v3/users/df1dab06eba044c18a1aab2fa320ddfb => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:03.301661 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ec47a-8a0e-4108-88c0-03840991c492 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:03.304368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2c2ec47a-8a0e-4108-88c0-03840991c492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:03.368956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ec47a-8a0e-4108-88c0-03840991c492 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:03.554995 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fa302-9eee-402b-b9e1-5d9933422277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:03.556386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fa302-9eee-402b-b9e1-5d9933422277 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:03.556758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fa302-9eee-402b-b9e1-5d9933422277 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:03.557307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fa302-9eee-402b-b9e1-5d9933422277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:03.560405 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c70fa302-9eee-402b-b9e1-5d9933422277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:03.589121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:03.724001 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fa302-9eee-402b-b9e1-5d9933422277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:03.725496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fa302-9eee-402b-b9e1-5d9933422277 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:03.769395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1320/2606] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:03.923993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:03.923993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:04.036253 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:04.045164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d633e-a517-4b4c-bb93-c99fd8130f6e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:04.063139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:04.063423 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fa302-9eee-402b-b9e1-5d9933422277 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:04.065626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:04.066430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c70fa302-9eee-402b-b9e1-5d9933422277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:04.067071 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:04.067508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823 admin admin] PATH_INFO: `/v3/projects/1224c3f235134e6199517fa63e8246f9` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:04.069878 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1224c3f235134e6199517fa63e8246f9)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:04.072465 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:04.087819 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fa302-9eee-402b-b9e1-5d9933422277 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:04.114916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:04.115879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:04.116254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:04.116709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] PATH_INFO: `/v3/projects/0c2cb666feef429bbd16d2907156819c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:04.119853 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2cb666feef429bbd16d2907156819c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:04.124723 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:04.300094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1224c3f235134e6199517fa63e8246f9', 'request_id': 'req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:04.318652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1224c3f235134e6199517fa63e8246f9', 'request_id': 'req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:04.330988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2cb666feef429bbd16d2907156819c', 'request_id': 'req-34f9a294-49dd-421b-8b1b-0e0777be4d59'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:04.347756 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2cb666feef429bbd16d2907156819c', 'request_id': 'req-34f9a294-49dd-421b-8b1b-0e0777be4d59'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:04.471073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1224c3f235134e6199517fa63e8246f9', 'request_id': 'req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:04.496318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823 admin admin] The token cache is being invalidate because project 1224c3f235134e6199517fa63e8246f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:04.497197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:04.498407 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2763ae5-c8e8-4609-bbfb-83adbcfb4823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:04.501627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1287/2607] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:03 2022] DELETE /identity/v3/projects/1224c3f235134e6199517fa63e8246f9 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:04.508629 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f257c6-ff0a-426b-a411-70563cbc22d4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:04.509054 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f257c6-ff0a-426b-a411-70563cbc22d4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:04.509484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f257c6-ff0a-426b-a411-70563cbc22d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:04.543314 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-00f257c6-ff0a-426b-a411-70563cbc22d4 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:04.545244 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-00f257c6-ff0a-426b-a411-70563cbc22d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:04.600819 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2cb666feef429bbd16d2907156819c', 'request_id': 'req-34f9a294-49dd-421b-8b1b-0e0777be4d59'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:04.618962 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] The token cache is being invalidate because project 0c2cb666feef429bbd16d2907156819c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:04.619776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:04.620729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:04.623088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1321/2608] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:04 2022] DELETE /identity/v3/projects/0c2cb666feef429bbd16d2907156819c => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:53:04.634811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:04.637004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:04.664377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1288/2609] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:53:04.677305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e7d1-d703-4205-bc3c-be01a50da560 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:04.677642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e7d1-d703-4205-bc3c-be01a50da560 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:04.677922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e7d1-d703-4205-bc3c-be01a50da560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:04.703474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7946e7d1-d703-4205-bc3c-be01a50da560 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:04.705049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7946e7d1-d703-4205-bc3c-be01a50da560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:04.720613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1289/2610] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:04.728777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946e7d1-d703-4205-bc3c-be01a50da560 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:04.754753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946e7d1-d703-4205-bc3c-be01a50da560 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:04.767618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f606164-8091-4346-b0b6-14e5cbd7e16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:04.769172 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f606164-8091-4346-b0b6-14e5cbd7e16d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:04.769768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f606164-8091-4346-b0b6-14e5cbd7e16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:04.770206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f606164-8091-4346-b0b6-14e5cbd7e16d admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:04.772078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f606164-8091-4346-b0b6-14e5cbd7e16d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:53:04.773702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f606164-8091-4346-b0b6-14e5cbd7e16d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:04.775549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f606164-8091-4346-b0b6-14e5cbd7e16d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:04.798156 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9a294-49dd-421b-8b1b-0e0777be4d59 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:04.806794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1290/2611] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:53:04.810834 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:04.812656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:04.812981 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:04.813225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] PATH_INFO: `/v3/users/7c1c21a53f6f4cdb819678d0ee966380` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:04.814069 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f606164-8091-4346-b0b6-14e5cbd7e16d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:04.815794 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1c21a53f6f4cdb819678d0ee966380)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:04.820058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:04.829643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f606164-8091-4346-b0b6-14e5cbd7e16d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:04.837180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec0c95-3e73-4086-8b40-5d848120c491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:04.838550 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec0c95-3e73-4086-8b40-5d848120c491 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:04.839297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec0c95-3e73-4086-8b40-5d848120c491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:04.839843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec0c95-3e73-4086-8b40-5d848120c491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:04.841125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec0c95-3e73-4086-8b40-5d848120c491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:04.843679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec0c95-3e73-4086-8b40-5d848120c491 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:05.068167 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1291/2612] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:53:04 2022] POST /identity/v3/projects => generated 379 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:05.070653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec0c95-3e73-4086-8b40-5d848120c491 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:05.192933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1c21a53f6f4cdb819678d0ee966380'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:05.226940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1c21a53f6f4cdb819678d0ee966380'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:05.249269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec0c95-3e73-4086-8b40-5d848120c491 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:05.263909 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a4349-c0b6-411c-9f38-cafbf512acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:05.272443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a4349-c0b6-411c-9f38-cafbf512acac admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:05.272443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a4349-c0b6-411c-9f38-cafbf512acac admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:05.272443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a4349-c0b6-411c-9f38-cafbf512acac admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:05.272443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a4349-c0b6-411c-9f38-cafbf512acac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:05.272443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a4349-c0b6-411c-9f38-cafbf512acac admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:05.433447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1c21a53f6f4cdb819678d0ee966380'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:05.436014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1c21a53f6f4cdb819678d0ee966380'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:05.439183 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1c21a53f6f4cdb819678d0ee966380'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:05.441649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1292/2613] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:53:05 2022] POST /identity/v3/users => generated 290 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:05.445464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a4349-c0b6-411c-9f38-cafbf512acac admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:05.448015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a90a4349-c0b6-411c-9f38-cafbf512acac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:05.464887 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a4349-c0b6-411c-9f38-cafbf512acac admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:05.474997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddd52c-e4d4-4610-b08b-e0baabdb3cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:05.475784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddd52c-e4d4-4610-b08b-e0baabdb3cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:05.476175 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddd52c-e4d4-4610-b08b-e0baabdb3cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:05.476565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddd52c-e4d4-4610-b08b-e0baabdb3cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:05.478016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ddd52c-e4d4-4610-b08b-e0baabdb3cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:05.479916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ddd52c-e4d4-4610-b08b-e0baabdb3cc9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:05.487300 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1322/2614] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:04 2022] DELETE /identity/v3/users/7c1c21a53f6f4cdb819678d0ee966380 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:53:05.495811 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1293/2615] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:53:05.500949 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:05.604484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddd52c-e4d4-4610-b08b-e0baabdb3cc9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:05.606530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-03ddd52c-e4d4-4610-b08b-e0baabdb3cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:05.619078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e6dc0-7041-4e08-9d28-064f9f01e73e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:05.626084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90d7cd-1a61-426b-8bef-094f62098ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:05.627226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90d7cd-1a61-426b-8bef-094f62098ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:05.628583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90d7cd-1a61-426b-8bef-094f62098ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:05.629092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90d7cd-1a61-426b-8bef-094f62098ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:05.630065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90d7cd-1a61-426b-8bef-094f62098ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:05.632713 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90d7cd-1a61-426b-8bef-094f62098ba4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:05.650086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1323/2616] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:05.655488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90d7cd-1a61-426b-8bef-094f62098ba4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:05.691377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90d7cd-1a61-426b-8bef-094f62098ba4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:05.741549 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42eecf-dd3e-4216-88a9-b3beb4d1f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:05.744134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42eecf-dd3e-4216-88a9-b3beb4d1f9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:05.746324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42eecf-dd3e-4216-88a9-b3beb4d1f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:05.748227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42eecf-dd3e-4216-88a9-b3beb4d1f9e8 admin admin] PATH_INFO: `/v3/projects/619446167087496680496b90c4bb9da7/users/b6fa1d4a4e254a6ebaa32e33ab7cc853/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:05.803629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42eecf-dd3e-4216-88a9-b3beb4d1f9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619446167087496680496b90c4bb9da7, user_id=b6fa1d4a4e254a6ebaa32e33ab7cc853, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:05.812655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42eecf-dd3e-4216-88a9-b3beb4d1f9e8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:05.833992 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:05.892759 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddd52c-e4d4-4610-b08b-e0baabdb3cc9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:05.975830 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1324/2617] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:05 2022] PUT /identity/v3/projects/619446167087496680496b90c4bb9da7/users/b6fa1d4a4e254a6ebaa32e33ab7cc853/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:05.978904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a018c2-c84b-43b7-a74f-b892afcafb7f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:05.979204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a018c2-c84b-43b7-a74f-b892afcafb7f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:05.979459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a018c2-c84b-43b7-a74f-b892afcafb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:06.047838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b4a018c2-c84b-43b7-a74f-b892afcafb7f None None] MFA Rules not processed for user `b6fa1d4a4e254a6ebaa32e33ab7cc853`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:06.050503 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b4a018c2-c84b-43b7-a74f-b892afcafb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:06.058538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3ebad-513a-49a5-86a8-08db1ed5e603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae21e13a4414168bd1741dfd642274a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:06.059170 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3ebad-513a-49a5-86a8-08db1ed5e603 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:06.059450 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3ebad-513a-49a5-86a8-08db1ed5e603 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:06.059753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3ebad-513a-49a5-86a8-08db1ed5e603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:06.065732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-42c3ebad-513a-49a5-86a8-08db1ed5e603 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:06.086344 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3ebad-513a-49a5-86a8-08db1ed5e603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:06.092482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3ebad-513a-49a5-86a8-08db1ed5e603 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:06.113555 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1294/2618] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:53:06.259296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1325/2619] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:06.259479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3ebad-513a-49a5-86a8-08db1ed5e603 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:06.291546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3ebad-513a-49a5-86a8-08db1ed5e603 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:06.342002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:06.444308 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d42d9-d211-4700-8a3a-31bafdb19022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:06.444864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d42d9-d211-4700-8a3a-31bafdb19022 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:06.445470 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d42d9-d211-4700-8a3a-31bafdb19022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:06.446131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d42d9-d211-4700-8a3a-31bafdb19022 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:06.448541 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d42d9-d211-4700-8a3a-31bafdb19022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:06.452793 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d42d9-d211-4700-8a3a-31bafdb19022 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:06.620402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1295/2620] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:53:06 2022] POST /identity/v3/projects => generated 381 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:06.621359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a018c2-c84b-43b7-a74f-b892afcafb7f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:06.636244 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a018c2-c84b-43b7-a74f-b892afcafb7f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:06.743268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d42d9-d211-4700-8a3a-31bafdb19022 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:06.748735 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-350d42d9-d211-4700-8a3a-31bafdb19022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:06.857665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b07972-83d2-476f-8536-91e3c5c1a200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:06.863038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b07972-83d2-476f-8536-91e3c5c1a200 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:06.866929 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b07972-83d2-476f-8536-91e3c5c1a200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:06.867681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b07972-83d2-476f-8536-91e3c5c1a200 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:06.869538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b07972-83d2-476f-8536-91e3c5c1a200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:06.884417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b07972-83d2-476f-8536-91e3c5c1a200 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:07.009600 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d42d9-d211-4700-8a3a-31bafdb19022 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:07.025954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:07.027557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:07.035045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:07.035045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] PATH_INFO: `/v3/projects/93cd2fd5a92e414fa5f1d6002c4c9318` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:07.035045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93cd2fd5a92e414fa5f1d6002c4c9318)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:07.040224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:07.073873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1326/2621] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:53:06 2022] POST /identity/v3/users => generated 297 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:53:07.084989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b07972-83d2-476f-8536-91e3c5c1a200 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:07.123342 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b07972-83d2-476f-8536-91e3c5c1a200 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:07.138377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b84e2-0be1-4490-b450-c3d15a4a39fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:07.139658 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b84e2-0be1-4490-b450-c3d15a4a39fc admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:07.140314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b84e2-0be1-4490-b450-c3d15a4a39fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:07.140966 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b84e2-0be1-4490-b450-c3d15a4a39fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:07.143275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b84e2-0be1-4490-b450-c3d15a4a39fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:07.159105 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b84e2-0be1-4490-b450-c3d15a4a39fc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:07.201661 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1327/2622] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:07.213828 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b84e2-0be1-4490-b450-c3d15a4a39fc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:07.237351 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b84e2-0be1-4490-b450-c3d15a4a39fc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:07.254824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a4d5b-6a9e-47ce-9208-fadb94c95efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:07.260600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a4d5b-6a9e-47ce-9208-fadb94c95efe admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:07.260600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a4d5b-6a9e-47ce-9208-fadb94c95efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:07.260600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a4d5b-6a9e-47ce-9208-fadb94c95efe admin admin] PATH_INFO: `/v3/projects/c841d2228bb84e43ac385392c5d13464/users/a438fd8727f64355a403d2f6e50e285b/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:07.293615 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93cd2fd5a92e414fa5f1d6002c4c9318', 'request_id': 'req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:07.294778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a4d5b-6a9e-47ce-9208-fadb94c95efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c841d2228bb84e43ac385392c5d13464, user_id=a438fd8727f64355a403d2f6e50e285b, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:07.297441 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a4d5b-6a9e-47ce-9208-fadb94c95efe admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:07.317008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93cd2fd5a92e414fa5f1d6002c4c9318', 'request_id': 'req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:07.410379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1328/2623] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:07 2022] PUT /identity/v3/projects/c841d2228bb84e43ac385392c5d13464/users/a438fd8727f64355a403d2f6e50e285b/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:07.421022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a4d5b-6a9e-47ce-9208-fadb94c95efe admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:07.424497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93cd2fd5a92e414fa5f1d6002c4c9318', 'request_id': 'req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:07.451785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] The token cache is being invalidate because project 93cd2fd5a92e414fa5f1d6002c4c9318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:07.452557 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:07.455090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:07.462404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1296/2624] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:06 2022] DELETE /identity/v3/projects/93cd2fd5a92e414fa5f1d6002c4c9318 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:53:07.470848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:07.470848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:07.613475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a4d5b-6a9e-47ce-9208-fadb94c95efe admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:07.624126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb73c0-470f-4b1b-bc5d-8840b2691781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:07.625583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb73c0-470f-4b1b-bc5d-8840b2691781 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:07.626602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb73c0-470f-4b1b-bc5d-8840b2691781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:07.626602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb73c0-470f-4b1b-bc5d-8840b2691781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:07.627541 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb73c0-470f-4b1b-bc5d-8840b2691781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:07.631980 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb73c0-470f-4b1b-bc5d-8840b2691781 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:07.663507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dfffc-6e16-48e0-9b8e-837f9fd02e57 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:07.668138 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1329/2625] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:07.672832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb73c0-470f-4b1b-bc5d-8840b2691781 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:07.674507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:07.677124 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:07.678120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:07.679157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] PATH_INFO: `/v3/users/f2f77357db0943318aab606ee6942e34` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:07.679510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6eeb73c0-470f-4b1b-bc5d-8840b2691781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:07.681562 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f77357db0943318aab606ee6942e34)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:07.685265 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:07.701911 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb73c0-470f-4b1b-bc5d-8840b2691781 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:07.710396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca419e-4ff8-440b-905c-131318edc9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:07.711941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca419e-4ff8-440b-905c-131318edc9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:07.711941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca419e-4ff8-440b-905c-131318edc9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:07.712527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca419e-4ff8-440b-905c-131318edc9bf admin admin] PATH_INFO: `/v3/projects/c841d2228bb84e43ac385392c5d13464/users/a438fd8727f64355a403d2f6e50e285b/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:07.715236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca419e-4ff8-440b-905c-131318edc9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c841d2228bb84e43ac385392c5d13464, user_id=a438fd8727f64355a403d2f6e50e285b, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:07.721394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca419e-4ff8-440b-905c-131318edc9bf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:07.729531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:07.746064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1330/2626] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:07 2022] PUT /identity/v3/projects/c841d2228bb84e43ac385392c5d13464/users/a438fd8727f64355a403d2f6e50e285b/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:07.759412 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060bc61-97e4-4c9b-8e6f-52817986e859 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:07.759792 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060bc61-97e4-4c9b-8e6f-52817986e859 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:07.760239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060bc61-97e4-4c9b-8e6f-52817986e859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:07.803879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6060bc61-97e4-4c9b-8e6f-52817986e859 None None] MFA Rules not processed for user `a438fd8727f64355a403d2f6e50e285b`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:07.805310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6060bc61-97e4-4c9b-8e6f-52817986e859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:07.982734 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1331/2627] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:07.997617 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060bc61-97e4-4c9b-8e6f-52817986e859 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:07.999365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f77357db0943318aab606ee6942e34'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:07.999971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6060bc61-97e4-4c9b-8e6f-52817986e859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:08.000133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f77357db0943318aab606ee6942e34'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:08.048906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f77357db0943318aab606ee6942e34'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:08.068189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f77357db0943318aab606ee6942e34'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:08.069167 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f77357db0943318aab606ee6942e34'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:08.129341 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060bc61-97e4-4c9b-8e6f-52817986e859 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:08.142902 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b28bef-b69b-4175-aa3a-7fb955f38654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:08.143925 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b28bef-b69b-4175-aa3a-7fb955f38654 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:08.144583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b28bef-b69b-4175-aa3a-7fb955f38654 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:08.145080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b28bef-b69b-4175-aa3a-7fb955f38654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:08.149718 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-04b28bef-b69b-4175-aa3a-7fb955f38654 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:08.182068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b28bef-b69b-4175-aa3a-7fb955f38654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:08.182068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b28bef-b69b-4175-aa3a-7fb955f38654 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:08.200906 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1332/2628] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:08.224914 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1297/2629] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:07 2022] DELETE /identity/v3/users/f2f77357db0943318aab606ee6942e34 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:08.359985 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:08.389589 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b28bef-b69b-4175-aa3a-7fb955f38654 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:08.391630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-04b28bef-b69b-4175-aa3a-7fb955f38654 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:08.411440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b28bef-b69b-4175-aa3a-7fb955f38654 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:08.502860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf352343-d5a4-4ff8-a685-3ccb57cee30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:08.505037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf352343-d5a4-4ff8-a685-3ccb57cee30b service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:08.505037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf352343-d5a4-4ff8-a685-3ccb57cee30b service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:08.505400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf352343-d5a4-4ff8-a685-3ccb57cee30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:08.510070 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cf352343-d5a4-4ff8-a685-3ccb57cee30b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:08.648448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf352343-d5a4-4ff8-a685-3ccb57cee30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:08.650376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf352343-d5a4-4ff8-a685-3ccb57cee30b service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:08.671576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1333/2630] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:09.212436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:09.325431 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:09.328795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:09.344756 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:09.483638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f1fd7-6a7f-47c9-b111-3c114bd49c66 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:09.486065 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18265b-a4c2-4c1e-b448-f8f8ee927641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:09.487687 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18265b-a4c2-4c1e-b448-f8f8ee927641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:09.488222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18265b-a4c2-4c1e-b448-f8f8ee927641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:09.488651 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18265b-a4c2-4c1e-b448-f8f8ee927641 admin admin] PATH_INFO: `/v3/projects/8b16032f3b2a4d5b9ee292c5854d20e4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:09.490366 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18265b-a4c2-4c1e-b448-f8f8ee927641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b16032f3b2a4d5b9ee292c5854d20e4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:09.492353 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18265b-a4c2-4c1e-b448-f8f8ee927641 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:09.657957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ea18265b-a4c2-4c1e-b448-f8f8ee927641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b16032f3b2a4d5b9ee292c5854d20e4', 'request_id': 'req-ea18265b-a4c2-4c1e-b448-f8f8ee927641'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:09.663485 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ea18265b-a4c2-4c1e-b448-f8f8ee927641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b16032f3b2a4d5b9ee292c5854d20e4', 'request_id': 'req-ea18265b-a4c2-4c1e-b448-f8f8ee927641'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:09.761162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ea18265b-a4c2-4c1e-b448-f8f8ee927641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b16032f3b2a4d5b9ee292c5854d20e4', 'request_id': 'req-ea18265b-a4c2-4c1e-b448-f8f8ee927641'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:09.774427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ea18265b-a4c2-4c1e-b448-f8f8ee927641 admin admin] The token cache is being invalidate because project 8b16032f3b2a4d5b9ee292c5854d20e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:09.774795 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ea18265b-a4c2-4c1e-b448-f8f8ee927641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:09.775561 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ea18265b-a4c2-4c1e-b448-f8f8ee927641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:09.777957 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1298/2631] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:09 2022] DELETE /identity/v3/projects/8b16032f3b2a4d5b9ee292c5854d20e4 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:09.788250 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356401e0-2001-4d8f-8450-d4b124e82fb2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:09.789733 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356401e0-2001-4d8f-8450-d4b124e82fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:09.790502 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356401e0-2001-4d8f-8450-d4b124e82fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:09.846754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-356401e0-2001-4d8f-8450-d4b124e82fb2 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:09.847843 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-356401e0-2001-4d8f-8450-d4b124e82fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:09.939002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1334/2632] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:09.941109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84f02-4a21-422d-96cd-ca463f9c6490 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:09.941398 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84f02-4a21-422d-96cd-ca463f9c6490 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:09.941669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84f02-4a21-422d-96cd-ca463f9c6490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:09.980059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9dd84f02-4a21-422d-96cd-ca463f9c6490 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:09.986129 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9dd84f02-4a21-422d-96cd-ca463f9c6490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:10.022716 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1299/2633] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:10.030901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356401e0-2001-4d8f-8450-d4b124e82fb2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:10.056177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356401e0-2001-4d8f-8450-d4b124e82fb2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:10.064146 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4389eca-6b1f-4550-a99d-bc7aa9f91ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:10.066897 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4389eca-6b1f-4550-a99d-bc7aa9f91ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:10.067430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4389eca-6b1f-4550-a99d-bc7aa9f91ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:10.070389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4389eca-6b1f-4550-a99d-bc7aa9f91ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:10.070389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4389eca-6b1f-4550-a99d-bc7aa9f91ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:53:10.070389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4389eca-6b1f-4550-a99d-bc7aa9f91ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:10.071773 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4389eca-6b1f-4550-a99d-bc7aa9f91ecd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:10.090253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1335/2634] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:53:10.109812 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd84f02-4a21-422d-96cd-ca463f9c6490 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:10.116974 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd84f02-4a21-422d-96cd-ca463f9c6490 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:10.150815 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a5c1b-5b37-4509-bf98-0f55c84b1726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:10.151548 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a5c1b-5b37-4509-bf98-0f55c84b1726 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:10.152471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a5c1b-5b37-4509-bf98-0f55c84b1726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:10.152773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a5c1b-5b37-4509-bf98-0f55c84b1726 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:10.153886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a5c1b-5b37-4509-bf98-0f55c84b1726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:10.156247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a5c1b-5b37-4509-bf98-0f55c84b1726 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:10.689124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9ae68-1fc4-4cb9-981a-e8647d6a2a52 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:10.690274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9ae68-1fc4-4cb9-981a-e8647d6a2a52 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:10.691047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9ae68-1fc4-4cb9-981a-e8647d6a2a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:10.742045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bef9ae68-1fc4-4cb9-981a-e8647d6a2a52 None None] MFA Rules not processed for user `bc818edc509d423b99476981532f02a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:10.743748 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bef9ae68-1fc4-4cb9-981a-e8647d6a2a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:10.746660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1300/2635] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:53:10 2022] POST /identity/v3/projects => generated 367 bytes in 650 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:10.750876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a5c1b-5b37-4509-bf98-0f55c84b1726 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:10.844331 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a5c1b-5b37-4509-bf98-0f55c84b1726 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:10.850784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28453c-37f7-4148-9792-9f431d8e8d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:10.855005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28453c-37f7-4148-9792-9f431d8e8d11 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:10.855005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28453c-37f7-4148-9792-9f431d8e8d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:10.855005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28453c-37f7-4148-9792-9f431d8e8d11 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:10.855005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28453c-37f7-4148-9792-9f431d8e8d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:10.855626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1336/2636] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:10.856421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28453c-37f7-4148-9792-9f431d8e8d11 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:10.860435 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9ae68-1fc4-4cb9-981a-e8647d6a2a52 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:10.864044 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bef9ae68-1fc4-4cb9-981a-e8647d6a2a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:10.899095 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9ae68-1fc4-4cb9-981a-e8647d6a2a52 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:10.907304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cde5b-a9ad-4db8-b299-0c9a09c09845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:10.908600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cde5b-a9ad-4db8-b299-0c9a09c09845 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:10.909111 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cde5b-a9ad-4db8-b299-0c9a09c09845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:10.909690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cde5b-a9ad-4db8-b299-0c9a09c09845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:10.910904 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cde5b-a9ad-4db8-b299-0c9a09c09845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:10.915113 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cde5b-a9ad-4db8-b299-0c9a09c09845 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:10.983351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1301/2637] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:53:10 2022] POST /identity/v3/users => generated 284 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:10.985709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9646c-02f9-4c93-9c86-09f9f5ab986e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:10.986060 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9646c-02f9-4c93-9c86-09f9f5ab986e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:10.987099 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9646c-02f9-4c93-9c86-09f9f5ab986e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:11.009420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f6b9646c-02f9-4c93-9c86-09f9f5ab986e None None] MFA Rules not processed for user `bb2ab51f75f84727831566a44db3d9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:11.010227 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f6b9646c-02f9-4c93-9c86-09f9f5ab986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:11.082174 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1302/2638] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:11.082402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9646c-02f9-4c93-9c86-09f9f5ab986e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:11.099890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9646c-02f9-4c93-9c86-09f9f5ab986e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:11.104516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e9445-683d-4136-b147-452df3242a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:11.104751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e9445-683d-4136-b147-452df3242a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:11.105155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1337/2639] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:53:10 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:11.108319 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e9445-683d-4136-b147-452df3242a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:11.108638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e9445-683d-4136-b147-452df3242a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:11.109606 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cde5b-a9ad-4db8-b299-0c9a09c09845 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:11.109763 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e9445-683d-4136-b147-452df3242a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:11.114527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e9445-683d-4136-b147-452df3242a6d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:11.127352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1303/2640] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:11.140514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e9445-683d-4136-b147-452df3242a6d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:11.157030 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e9445-683d-4136-b147-452df3242a6d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:11.211607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cde5b-a9ad-4db8-b299-0c9a09c09845 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:11.217657 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc01b75-20b6-43f8-8772-235f783e6e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:11.218601 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc01b75-20b6-43f8-8772-235f783e6e9c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:11.219256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc01b75-20b6-43f8-8772-235f783e6e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:11.219700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc01b75-20b6-43f8-8772-235f783e6e9c admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:11.220582 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc01b75-20b6-43f8-8772-235f783e6e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:11.226282 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc01b75-20b6-43f8-8772-235f783e6e9c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:11.256268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c89e46-1644-4a6f-afd0-3ad276be9112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:11.256934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c89e46-1644-4a6f-afd0-3ad276be9112 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:11.257307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c89e46-1644-4a6f-afd0-3ad276be9112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:11.257577 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c89e46-1644-4a6f-afd0-3ad276be9112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:11.258235 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c89e46-1644-4a6f-afd0-3ad276be9112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:11.260067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c89e46-1644-4a6f-afd0-3ad276be9112 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:11.273288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1304/2641] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:11.276544 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c89e46-1644-4a6f-afd0-3ad276be9112 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:11.287984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c89e46-1644-4a6f-afd0-3ad276be9112 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:11.295779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481dfa6-90b2-4f3d-8884-520c138dae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:11.295779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481dfa6-90b2-4f3d-8884-520c138dae09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:11.295779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481dfa6-90b2-4f3d-8884-520c138dae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:11.295779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481dfa6-90b2-4f3d-8884-520c138dae09 admin admin] PATH_INFO: `/v3/projects/f5a4e6a5e18f431bb8a41df476a2807f/users/d976bf0c7fcd45278eaaa7bfd81bc572/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:11.321136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481dfa6-90b2-4f3d-8884-520c138dae09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a4e6a5e18f431bb8a41df476a2807f, user_id=d976bf0c7fcd45278eaaa7bfd81bc572, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:11.324233 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481dfa6-90b2-4f3d-8884-520c138dae09 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:11.399189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1338/2642] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:53:11 2022] POST /identity/v3/users => generated 299 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:53:11.402948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc01b75-20b6-43f8-8772-235f783e6e9c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:11.433060 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc01b75-20b6-43f8-8772-235f783e6e9c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:11.433455 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1305/2643] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:11 2022] PUT /identity/v3/projects/f5a4e6a5e18f431bb8a41df476a2807f/users/d976bf0c7fcd45278eaaa7bfd81bc572/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:53:11.445454 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7b72c-e213-4d7a-a612-2664f3d24286 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:11.446297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7b72c-e213-4d7a-a612-2664f3d24286 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:11.446638 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7b72c-e213-4d7a-a612-2664f3d24286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:11.455311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:11.525954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7cc7b72c-e213-4d7a-a612-2664f3d24286 None None] MFA Rules not processed for user `d976bf0c7fcd45278eaaa7bfd81bc572`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:11.527756 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7cc7b72c-e213-4d7a-a612-2664f3d24286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:11.588564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c9dea-d9fc-4f16-bb5b-b391f11f2358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:11.589523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c9dea-d9fc-4f16-bb5b-b391f11f2358 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:11.590036 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c9dea-d9fc-4f16-bb5b-b391f11f2358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:11.590470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c9dea-d9fc-4f16-bb5b-b391f11f2358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:11.591616 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c9dea-d9fc-4f16-bb5b-b391f11f2358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:11.595547 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c9dea-d9fc-4f16-bb5b-b391f11f2358 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:11.617003 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1339/2644] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:53:11.619097 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c9dea-d9fc-4f16-bb5b-b391f11f2358 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:11.636010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c9dea-d9fc-4f16-bb5b-b391f11f2358 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:11.643191 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adbfca-d8e9-47c6-8054-ae71bc6c22bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:11.644401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adbfca-d8e9-47c6-8054-ae71bc6c22bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:11.645058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adbfca-d8e9-47c6-8054-ae71bc6c22bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:11.645536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adbfca-d8e9-47c6-8054-ae71bc6c22bd admin admin] PATH_INFO: `/v3/projects/e1e11d671bcd4e32b43174ae5d67ecd7/users/c8522caa9bb74295b0b414c13a60e591/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:11.685752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1306/2645] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:53:11.691420 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7b72c-e213-4d7a-a612-2664f3d24286 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:11.694730 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adbfca-d8e9-47c6-8054-ae71bc6c22bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e11d671bcd4e32b43174ae5d67ecd7, user_id=c8522caa9bb74295b0b414c13a60e591, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:11.699448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adbfca-d8e9-47c6-8054-ae71bc6c22bd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:11.713618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7b72c-e213-4d7a-a612-2664f3d24286 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:11.728580 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027bff-1dc7-4e26-90b1-565183364559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:11.729310 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027bff-1dc7-4e26-90b1-565183364559 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:11.729676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027bff-1dc7-4e26-90b1-565183364559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:11.729860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027bff-1dc7-4e26-90b1-565183364559 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:11.730485 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14027bff-1dc7-4e26-90b1-565183364559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:11.739053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14027bff-1dc7-4e26-90b1-565183364559 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:11.837018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1340/2646] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:11 2022] PUT /identity/v3/projects/e1e11d671bcd4e32b43174ae5d67ecd7/users/c8522caa9bb74295b0b414c13a60e591/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:11.837018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adbfca-d8e9-47c6-8054-ae71bc6c22bd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:11.838024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a2adbfca-d8e9-47c6-8054-ae71bc6c22bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:11.883053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1307/2647] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:53:11 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:11.884847 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027bff-1dc7-4e26-90b1-565183364559 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:11.971536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adbfca-d8e9-47c6-8054-ae71bc6c22bd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:11.988236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027bff-1dc7-4e26-90b1-565183364559 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:11.996031 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f249d-d1b8-42d6-84e8-c3c01cbe7042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:11.996589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f249d-d1b8-42d6-84e8-c3c01cbe7042 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:11.997231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f249d-d1b8-42d6-84e8-c3c01cbe7042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:11.997567 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f249d-d1b8-42d6-84e8-c3c01cbe7042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:11.998282 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f249d-d1b8-42d6-84e8-c3c01cbe7042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:11.999996 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f249d-d1b8-42d6-84e8-c3c01cbe7042 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:12.013629 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1308/2648] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:12.014464 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f249d-d1b8-42d6-84e8-c3c01cbe7042 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:12.040247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f249d-d1b8-42d6-84e8-c3c01cbe7042 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:12.063388 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18291f3a-7b62-485a-9d60-00e9a761421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:12.064619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18291f3a-7b62-485a-9d60-00e9a761421d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:12.065591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e99b4-3aa1-4e2d-a9c3-1fe61637e6df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebfb233b2504463a4ee9202b5a3ab50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:12.066536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e99b4-3aa1-4e2d-a9c3-1fe61637e6df service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:12.066782 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e99b4-3aa1-4e2d-a9c3-1fe61637e6df service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:12.067074 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e99b4-3aa1-4e2d-a9c3-1fe61637e6df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:12.068095 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18291f3a-7b62-485a-9d60-00e9a761421d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:12.068376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18291f3a-7b62-485a-9d60-00e9a761421d admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:12.069611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18291f3a-7b62-485a-9d60-00e9a761421d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:12.072215 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-964e99b4-3aa1-4e2d-a9c3-1fe61637e6df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:12.076468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18291f3a-7b62-485a-9d60-00e9a761421d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:12.106256 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e99b4-3aa1-4e2d-a9c3-1fe61637e6df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:12.115944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e99b4-3aa1-4e2d-a9c3-1fe61637e6df service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:12.143249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1341/2649] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:12.150577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e99b4-3aa1-4e2d-a9c3-1fe61637e6df service placement] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:12.180290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e99b4-3aa1-4e2d-a9c3-1fe61637e6df service placement] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:12.188588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:12.196602 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa85f01-220e-4667-88df-b988990383b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:12.198201 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa85f01-220e-4667-88df-b988990383b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:12.199177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa85f01-220e-4667-88df-b988990383b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:12.199561 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa85f01-220e-4667-88df-b988990383b9 admin admin] PATH_INFO: `/v3/projects/e1e11d671bcd4e32b43174ae5d67ecd7/users/c8522caa9bb74295b0b414c13a60e591/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:12.201714 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1309/2650] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:53:12 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:12.202512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa85f01-220e-4667-88df-b988990383b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e11d671bcd4e32b43174ae5d67ecd7, user_id=c8522caa9bb74295b0b414c13a60e591, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:12.203685 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18291f3a-7b62-485a-9d60-00e9a761421d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:12.208264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa85f01-220e-4667-88df-b988990383b9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:12.223936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18291f3a-7b62-485a-9d60-00e9a761421d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:12.238476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1342/2651] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:12 2022] PUT /identity/v3/projects/e1e11d671bcd4e32b43174ae5d67ecd7/users/c8522caa9bb74295b0b414c13a60e591/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:12.326492 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71651052-6cd3-4a4d-b153-322771e16922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:12.327283 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71651052-6cd3-4a4d-b153-322771e16922 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:12.327565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71651052-6cd3-4a4d-b153-322771e16922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:12.327879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71651052-6cd3-4a4d-b153-322771e16922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:12.328526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71651052-6cd3-4a4d-b153-322771e16922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:12.330785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71651052-6cd3-4a4d-b153-322771e16922 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:12.347490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1310/2652] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:12.348867 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa85f01-220e-4667-88df-b988990383b9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:12.361036 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa85f01-220e-4667-88df-b988990383b9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:12.368362 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cebedf-0cd5-449f-8390-c7dabcbda322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:12.368817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cebedf-0cd5-449f-8390-c7dabcbda322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:12.369327 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cebedf-0cd5-449f-8390-c7dabcbda322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:12.369573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cebedf-0cd5-449f-8390-c7dabcbda322 admin admin] PATH_INFO: `/v3/projects/7e06d74964a94d27bfca1cacc189db28/users/cc5c93fb15604e43816acc36500f7258/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:12.398767 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cebedf-0cd5-449f-8390-c7dabcbda322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e06d74964a94d27bfca1cacc189db28, user_id=cc5c93fb15604e43816acc36500f7258, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:12.401920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cebedf-0cd5-449f-8390-c7dabcbda322 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:12.517273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:12.534496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1343/2653] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:12 2022] PUT /identity/v3/projects/7e06d74964a94d27bfca1cacc189db28/users/cc5c93fb15604e43816acc36500f7258/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:53:12.540927 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71651052-6cd3-4a4d-b153-322771e16922 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:12.552969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71651052-6cd3-4a4d-b153-322771e16922 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:12.658514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b2f6f-0cd7-47c2-bcc4-8b8cc2bc763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:12.658514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b2f6f-0cd7-47c2-bcc4-8b8cc2bc763c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:12.659190 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b2f6f-0cd7-47c2-bcc4-8b8cc2bc763c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:12.661491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b2f6f-0cd7-47c2-bcc4-8b8cc2bc763c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:12.672090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b2f6f-0cd7-47c2-bcc4-8b8cc2bc763c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:12.676008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b2f6f-0cd7-47c2-bcc4-8b8cc2bc763c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:12.708955 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1311/2654] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:12.710297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cebedf-0cd5-449f-8390-c7dabcbda322 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:12.733489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cebedf-0cd5-449f-8390-c7dabcbda322 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:12.754769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67476d98-5496-4684-a562-70c0c71fa610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:12.756119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67476d98-5496-4684-a562-70c0c71fa610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:12.757054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67476d98-5496-4684-a562-70c0c71fa610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:12.757054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67476d98-5496-4684-a562-70c0c71fa610 admin admin] PATH_INFO: `/v3/projects/7e06d74964a94d27bfca1cacc189db28/users/cc5c93fb15604e43816acc36500f7258/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:12.762948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67476d98-5496-4684-a562-70c0c71fa610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e06d74964a94d27bfca1cacc189db28, user_id=cc5c93fb15604e43816acc36500f7258, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:12.766544 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67476d98-5496-4684-a562-70c0c71fa610 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:12.803484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1344/2655] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:12 2022] PUT /identity/v3/projects/7e06d74964a94d27bfca1cacc189db28/users/cc5c93fb15604e43816acc36500f7258/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:12.805564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33786b3-8938-4155-999e-25cdfdb47129 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:12.805848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33786b3-8938-4155-999e-25cdfdb47129 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:12.806132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33786b3-8938-4155-999e-25cdfdb47129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:12.861123 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c33786b3-8938-4155-999e-25cdfdb47129 None None] MFA Rules not processed for user `cc5c93fb15604e43816acc36500f7258`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:12.862550 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c33786b3-8938-4155-999e-25cdfdb47129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:12.962617 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1312/2656] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:12.975209 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67476d98-5496-4684-a562-70c0c71fa610 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:12.977038 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-67476d98-5496-4684-a562-70c0c71fa610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:13.050978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67476d98-5496-4684-a562-70c0c71fa610 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:13.056567 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad5c83-4af3-43ee-b576-2c8106176488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:13.057389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad5c83-4af3-43ee-b576-2c8106176488 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:13.057675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad5c83-4af3-43ee-b576-2c8106176488 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:13.057951 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad5c83-4af3-43ee-b576-2c8106176488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:13.077474 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad5c83-4af3-43ee-b576-2c8106176488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:13.082698 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad5c83-4af3-43ee-b576-2c8106176488 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:13.115408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1345/2657] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:13.511376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33786b3-8938-4155-999e-25cdfdb47129 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:13.523618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33786b3-8938-4155-999e-25cdfdb47129 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:13.534698 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a261f1-617b-446a-9386-2ea2fe05d6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:13.535403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a261f1-617b-446a-9386-2ea2fe05d6da service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:13.536114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a261f1-617b-446a-9386-2ea2fe05d6da service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:13.536401 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a261f1-617b-446a-9386-2ea2fe05d6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:13.682484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a261f1-617b-446a-9386-2ea2fe05d6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:13.683682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a261f1-617b-446a-9386-2ea2fe05d6da service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:13.685605 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad5c83-4af3-43ee-b576-2c8106176488 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:13.687121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1bad5c83-4af3-43ee-b576-2c8106176488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:13.717981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1313/2658] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:13.864900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad5c83-4af3-43ee-b576-2c8106176488 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:13.872473 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:13.873196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:13.873418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:13.873948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] PATH_INFO: `/v3/users/b6fa1d4a4e254a6ebaa32e33ab7cc853` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:13.875319 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fa1d4a4e254a6ebaa32e33ab7cc853)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:13.878290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:14.225990 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fa1d4a4e254a6ebaa32e33ab7cc853'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:14.250202 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fa1d4a4e254a6ebaa32e33ab7cc853'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:14.411651 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fa1d4a4e254a6ebaa32e33ab7cc853'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:14.412467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fa1d4a4e254a6ebaa32e33ab7cc853'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:14.413187 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fa1d4a4e254a6ebaa32e33ab7cc853'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:14.453153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1346/2659] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:13 2022] DELETE /identity/v3/users/b6fa1d4a4e254a6ebaa32e33ab7cc853 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:14.459206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f56d64-9aae-40ee-bb0b-8a919cfae31a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:14.459824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f56d64-9aae-40ee-bb0b-8a919cfae31a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:14.460028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f56d64-9aae-40ee-bb0b-8a919cfae31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:14.485013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c2f56d64-9aae-40ee-bb0b-8a919cfae31a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:14.486802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c2f56d64-9aae-40ee-bb0b-8a919cfae31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:14.571034 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1314/2660] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:14.581731 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:14.583638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:14.590414 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f56d64-9aae-40ee-bb0b-8a919cfae31a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:14.598025 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c2f56d64-9aae-40ee-bb0b-8a919cfae31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:14.701045 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c07501-19bb-48ba-b437-05c2fdada4dd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:14.706603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76738f-154a-4b54-90b6-9090b1955644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:14.707274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76738f-154a-4b54-90b6-9090b1955644 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:14.707577 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76738f-154a-4b54-90b6-9090b1955644 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:14.707998 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76738f-154a-4b54-90b6-9090b1955644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:14.721480 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f56d64-9aae-40ee-bb0b-8a919cfae31a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:14.722604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76738f-154a-4b54-90b6-9090b1955644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:14.724742 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76738f-154a-4b54-90b6-9090b1955644 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:14.726335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bbc92-baa0-47d4-834c-dd403777270e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:14.726960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bbc92-baa0-47d4-834c-dd403777270e service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:14.727238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bbc92-baa0-47d4-834c-dd403777270e service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:14.727512 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bbc92-baa0-47d4-834c-dd403777270e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:14.730162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-de0bbc92-baa0-47d4-834c-dd403777270e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:14.744449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1347/2661] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:14.752460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bbc92-baa0-47d4-834c-dd403777270e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:14.753006 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bbc92-baa0-47d4-834c-dd403777270e service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:14.778264 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1315/2662] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:15.217979 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:15.757268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:16.006257 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76738f-154a-4b54-90b6-9090b1955644 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:16.008879 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3d76738f-154a-4b54-90b6-9090b1955644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:16.101418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76738f-154a-4b54-90b6-9090b1955644 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:16.129018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:16.132954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:16.132954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:16.132954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] PATH_INFO: `/v3/projects/619446167087496680496b90c4bb9da7` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:16.132954 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619446167087496680496b90c4bb9da7)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:16.135166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:16.363477 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619446167087496680496b90c4bb9da7', 'request_id': 'req-2d5bfcb6-bdda-4899-9588-870e649081b1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:16.373883 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619446167087496680496b90c4bb9da7', 'request_id': 'req-2d5bfcb6-bdda-4899-9588-870e649081b1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:16.477168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619446167087496680496b90c4bb9da7', 'request_id': 'req-2d5bfcb6-bdda-4899-9588-870e649081b1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:16.494740 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] The token cache is being invalidate because project 619446167087496680496b90c4bb9da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:16.495032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:16.495701 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:16.497231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1348/2663] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:16 2022] DELETE /identity/v3/projects/619446167087496680496b90c4bb9da7 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:53:16.501457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bbc92-baa0-47d4-834c-dd403777270e service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:16.521347 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bbc92-baa0-47d4-834c-dd403777270e service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:16.626337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd4679-d8d1-40a3-ab32-bf79c71f68a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:16.627608 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd4679-d8d1-40a3-ab32-bf79c71f68a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:16.629427 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd4679-d8d1-40a3-ab32-bf79c71f68a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:16.629724 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd4679-d8d1-40a3-ab32-bf79c71f68a7 admin admin] PATH_INFO: `/v3/users/a438fd8727f64355a403d2f6e50e285b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:16.632071 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd4679-d8d1-40a3-ab32-bf79c71f68a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a438fd8727f64355a403d2f6e50e285b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:16.634061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd4679-d8d1-40a3-ab32-bf79c71f68a7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:16.846576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:16.942754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7abd4679-d8d1-40a3-ab32-bf79c71f68a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a438fd8727f64355a403d2f6e50e285b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:16.943676 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7abd4679-d8d1-40a3-ab32-bf79c71f68a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a438fd8727f64355a403d2f6e50e285b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:16.981962 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7abd4679-d8d1-40a3-ab32-bf79c71f68a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a438fd8727f64355a403d2f6e50e285b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:16.995607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7abd4679-d8d1-40a3-ab32-bf79c71f68a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a438fd8727f64355a403d2f6e50e285b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:16.996731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7abd4679-d8d1-40a3-ab32-bf79c71f68a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a438fd8727f64355a403d2f6e50e285b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:17.129359 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1316/2664] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:16 2022] DELETE /identity/v3/users/a438fd8727f64355a403d2f6e50e285b => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:18.173258 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:18.176030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:18.203573 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bfcb6-bdda-4899-9588-870e649081b1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:18.333000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:18.334522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:18.335243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:18.335761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15 admin admin] PATH_INFO: `/v3/projects/c841d2228bb84e43ac385392c5d13464` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:18.337840 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c841d2228bb84e43ac385392c5d13464)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:18.349591 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:18.587935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c841d2228bb84e43ac385392c5d13464', 'request_id': 'req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:18.597700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c841d2228bb84e43ac385392c5d13464', 'request_id': 'req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:18.705751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c841d2228bb84e43ac385392c5d13464', 'request_id': 'req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:18.731345 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15 admin admin] The token cache is being invalidate because project c841d2228bb84e43ac385392c5d13464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:18.732263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:18.734702 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fe26fdf5-20e0-4efd-b4ca-fc8828214e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:18.739151 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1349/2665] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:18 2022] DELETE /identity/v3/projects/c841d2228bb84e43ac385392c5d13464 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:18.743988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df7482-dffc-4f98-9525-65bd65018ff6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:18.744498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df7482-dffc-4f98-9525-65bd65018ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:18.744766 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df7482-dffc-4f98-9525-65bd65018ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:18.786665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-66df7482-dffc-4f98-9525-65bd65018ff6 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:18.791100 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:18.794171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-66df7482-dffc-4f98-9525-65bd65018ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:18.972177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1317/2666] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:18.974743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1337cb-4d77-47b0-bf32-56c1b39225ee None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:18.975283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1337cb-4d77-47b0-bf32-56c1b39225ee None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:18.975674 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1337cb-4d77-47b0-bf32-56c1b39225ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:19.009810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3a1337cb-4d77-47b0-bf32-56c1b39225ee None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:19.013254 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3a1337cb-4d77-47b0-bf32-56c1b39225ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:19.027804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1350/2667] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:19.029307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df7482-dffc-4f98-9525-65bd65018ff6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:19.049474 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df7482-dffc-4f98-9525-65bd65018ff6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:19.063632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963698a-7a62-4a5a-bdab-637e1a705abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:19.064456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963698a-7a62-4a5a-bdab-637e1a705abd admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:19.064739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963698a-7a62-4a5a-bdab-637e1a705abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:19.065018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963698a-7a62-4a5a-bdab-637e1a705abd admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:19.065681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963698a-7a62-4a5a-bdab-637e1a705abd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:53:19.065984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963698a-7a62-4a5a-bdab-637e1a705abd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:19.067688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963698a-7a62-4a5a-bdab-637e1a705abd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:19.105592 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1318/2668] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:53:19.106745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1337cb-4d77-47b0-bf32-56c1b39225ee None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:19.121488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1337cb-4d77-47b0-bf32-56c1b39225ee None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:19.138520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3de784-afd4-4ea7-906b-807660830171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:19.139158 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3de784-afd4-4ea7-906b-807660830171 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:19.139438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3de784-afd4-4ea7-906b-807660830171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:19.139710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3de784-afd4-4ea7-906b-807660830171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:19.140385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3de784-afd4-4ea7-906b-807660830171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:19.142999 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3de784-afd4-4ea7-906b-807660830171 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:19.302111 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1351/2669] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:53:19 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:19.307446 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963698a-7a62-4a5a-bdab-637e1a705abd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:19.322970 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963698a-7a62-4a5a-bdab-637e1a705abd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:19.508861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f7dc8-4048-4bc6-856c-1e1e4842988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:19.509647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f7dc8-4048-4bc6-856c-1e1e4842988b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:19.509991 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f7dc8-4048-4bc6-856c-1e1e4842988b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:19.510338 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f7dc8-4048-4bc6-856c-1e1e4842988b admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:19.511209 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f7dc8-4048-4bc6-856c-1e1e4842988b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:19.526913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f7dc8-4048-4bc6-856c-1e1e4842988b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:19.687626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1319/2670] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:53:19 2022] POST /identity/v3/users => generated 294 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:53:19.694957 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3de784-afd4-4ea7-906b-807660830171 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:19.715272 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3de784-afd4-4ea7-906b-807660830171 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:19.727483 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93f227-ee5f-45cd-8615-49d6722c13e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:19.728396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93f227-ee5f-45cd-8615-49d6722c13e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:19.728762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93f227-ee5f-45cd-8615-49d6722c13e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:19.729135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93f227-ee5f-45cd-8615-49d6722c13e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:19.729906 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93f227-ee5f-45cd-8615-49d6722c13e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:19.731996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93f227-ee5f-45cd-8615-49d6722c13e1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:19.741986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:19.763201 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f7dc8-4048-4bc6-856c-1e1e4842988b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:19.763775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1352/2671] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:19.782509 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f7dc8-4048-4bc6-856c-1e1e4842988b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:19.796063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b34b1-969b-4fdd-9168-b1d746deeb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:19.799037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b34b1-969b-4fdd-9168-b1d746deeb87 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:19.799037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b34b1-969b-4fdd-9168-b1d746deeb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:19.799037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b34b1-969b-4fdd-9168-b1d746deeb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:19.799751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b34b1-969b-4fdd-9168-b1d746deeb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:19.802067 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b34b1-969b-4fdd-9168-b1d746deeb87 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:19.822384 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1320/2672] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:19.823489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93f227-ee5f-45cd-8615-49d6722c13e1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:19.842446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93f227-ee5f-45cd-8615-49d6722c13e1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:19.861222 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e59e78-41da-4e35-b988-4f34712874e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:19.861567 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59e78-41da-4e35-b988-4f34712874e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:19.862024 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59e78-41da-4e35-b988-4f34712874e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:19.862313 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59e78-41da-4e35-b988-4f34712874e4 admin admin] PATH_INFO: `/v3/projects/072b431de1624b29b22dea75239e6848/users/e8a5b4766c684520a02b8425dd8a828a/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:19.905034 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e59e78-41da-4e35-b988-4f34712874e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072b431de1624b29b22dea75239e6848, user_id=e8a5b4766c684520a02b8425dd8a828a, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:19.908584 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e59e78-41da-4e35-b988-4f34712874e4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:20.018312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1353/2673] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:19 2022] PUT /identity/v3/projects/072b431de1624b29b22dea75239e6848/users/e8a5b4766c684520a02b8425dd8a828a/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:53:20.032346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cba086-1cd2-4ce2-ab7e-f536ebae21dd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:20.033055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cba086-1cd2-4ce2-ab7e-f536ebae21dd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:20.033614 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cba086-1cd2-4ce2-ab7e-f536ebae21dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:20.131505 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-93cba086-1cd2-4ce2-ab7e-f536ebae21dd None None] MFA Rules not processed for user `e8a5b4766c684520a02b8425dd8a828a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:20.133090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-93cba086-1cd2-4ce2-ab7e-f536ebae21dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:20.324307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e59e78-41da-4e35-b988-4f34712874e4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:20.325057 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1321/2674] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:20.458681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e59e78-41da-4e35-b988-4f34712874e4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:20.468153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329edaf5-834c-45e8-899d-7ac7fd753f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:20.472240 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329edaf5-834c-45e8-899d-7ac7fd753f8f admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:20.472971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329edaf5-834c-45e8-899d-7ac7fd753f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:20.474600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329edaf5-834c-45e8-899d-7ac7fd753f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:20.475393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329edaf5-834c-45e8-899d-7ac7fd753f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:20.488961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329edaf5-834c-45e8-899d-7ac7fd753f8f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:20.648500 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:20.659932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cba086-1cd2-4ce2-ab7e-f536ebae21dd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:20.660613 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1354/2675] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:53:20 2022] POST /identity/v3/projects => generated 387 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:20.679504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cba086-1cd2-4ce2-ab7e-f536ebae21dd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:20.805662 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219e7cf-794c-4451-b5ee-76303b958f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:20.807029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219e7cf-794c-4451-b5ee-76303b958f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:20.807472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219e7cf-794c-4451-b5ee-76303b958f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:20.807983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219e7cf-794c-4451-b5ee-76303b958f18 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:20.808783 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219e7cf-794c-4451-b5ee-76303b958f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:20.811773 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219e7cf-794c-4451-b5ee-76303b958f18 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:20.965672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1322/2676] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:53:20 2022] POST /identity/v3/users => generated 300 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:20.969632 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329edaf5-834c-45e8-899d-7ac7fd753f8f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:20.980485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329edaf5-834c-45e8-899d-7ac7fd753f8f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:20.986633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9be89b-6c09-45ae-b928-f0636567a7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:20.987758 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9be89b-6c09-45ae-b928-f0636567a7da admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:20.988228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9be89b-6c09-45ae-b928-f0636567a7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:20.988917 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9be89b-6c09-45ae-b928-f0636567a7da admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:20.989732 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9be89b-6c09-45ae-b928-f0636567a7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:20.991516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9be89b-6c09-45ae-b928-f0636567a7da admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:21.010170 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1355/2677] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:21.018961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219e7cf-794c-4451-b5ee-76303b958f18 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:21.030141 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219e7cf-794c-4451-b5ee-76303b958f18 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:21.035373 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee80d1-d3c8-4d9c-a18a-9cca1b3968a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:21.039425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee80d1-d3c8-4d9c-a18a-9cca1b3968a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:21.039425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee80d1-d3c8-4d9c-a18a-9cca1b3968a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:21.039425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee80d1-d3c8-4d9c-a18a-9cca1b3968a6 admin admin] PATH_INFO: `/v3/projects/21ecebc95bbf42a4b27eadf3a85445bb/users/5e7e0852ca694cbb9e15a8352a9eeff5/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:21.096366 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee80d1-d3c8-4d9c-a18a-9cca1b3968a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ecebc95bbf42a4b27eadf3a85445bb, user_id=5e7e0852ca694cbb9e15a8352a9eeff5, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:21.100345 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee80d1-d3c8-4d9c-a18a-9cca1b3968a6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:21.316394 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1323/2678] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:21 2022] PUT /identity/v3/projects/21ecebc95bbf42a4b27eadf3a85445bb/users/5e7e0852ca694cbb9e15a8352a9eeff5/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:21.318107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9be89b-6c09-45ae-b928-f0636567a7da admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:21.335051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9be89b-6c09-45ae-b928-f0636567a7da admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:21.531927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd48dac-81c1-4c91-b35b-f9e0e55dc2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:21.531927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd48dac-81c1-4c91-b35b-f9e0e55dc2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:21.531927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd48dac-81c1-4c91-b35b-f9e0e55dc2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:21.531927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd48dac-81c1-4c91-b35b-f9e0e55dc2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:21.533423 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd48dac-81c1-4c91-b35b-f9e0e55dc2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:21.533423 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd48dac-81c1-4c91-b35b-f9e0e55dc2e5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:21.566290 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1356/2679] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:21.572465 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee80d1-d3c8-4d9c-a18a-9cca1b3968a6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:21.603641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee80d1-d3c8-4d9c-a18a-9cca1b3968a6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:21.656722 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d492713-57e3-45bd-9afb-7be55ae5aaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:21.664094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d492713-57e3-45bd-9afb-7be55ae5aaf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:21.664094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d492713-57e3-45bd-9afb-7be55ae5aaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:21.664094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d492713-57e3-45bd-9afb-7be55ae5aaf2 admin admin] PATH_INFO: `/v3/projects/21ecebc95bbf42a4b27eadf3a85445bb/users/5e7e0852ca694cbb9e15a8352a9eeff5/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:21.664094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d492713-57e3-45bd-9afb-7be55ae5aaf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ecebc95bbf42a4b27eadf3a85445bb, user_id=5e7e0852ca694cbb9e15a8352a9eeff5, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:21.665048 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d492713-57e3-45bd-9afb-7be55ae5aaf2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:21.709162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1324/2680] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:21 2022] PUT /identity/v3/projects/21ecebc95bbf42a4b27eadf3a85445bb/users/5e7e0852ca694cbb9e15a8352a9eeff5/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:21.725694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c7c0c-9743-4b25-84d7-8a58529ae73b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:21.725694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c7c0c-9743-4b25-84d7-8a58529ae73b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:21.725694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c7c0c-9743-4b25-84d7-8a58529ae73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:21.752182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:21.801831 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-608c7c0c-9743-4b25-84d7-8a58529ae73b None None] MFA Rules not processed for user `5e7e0852ca694cbb9e15a8352a9eeff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:21.804078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-608c7c0c-9743-4b25-84d7-8a58529ae73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:21.944395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d492713-57e3-45bd-9afb-7be55ae5aaf2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:21.944955 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1357/2681] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:21.947133 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1d492713-57e3-45bd-9afb-7be55ae5aaf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:22.068236 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d492713-57e3-45bd-9afb-7be55ae5aaf2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:22.076195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b728e-3e66-44b1-a23d-85eca5cfe914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:22.076973 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b728e-3e66-44b1-a23d-85eca5cfe914 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:22.077578 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b728e-3e66-44b1-a23d-85eca5cfe914 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:22.078460 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b728e-3e66-44b1-a23d-85eca5cfe914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:22.096713 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b728e-3e66-44b1-a23d-85eca5cfe914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:22.099348 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b728e-3e66-44b1-a23d-85eca5cfe914 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:22.112439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1325/2682] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:53:22.829823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:22.922424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c7c0c-9743-4b25-84d7-8a58529ae73b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:22.924700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-608c7c0c-9743-4b25-84d7-8a58529ae73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:23.013816 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:23.110176 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c7c0c-9743-4b25-84d7-8a58529ae73b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:23.126581 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347a328-6537-4a37-976a-8555aa0a53e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:23.127891 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347a328-6537-4a37-976a-8555aa0a53e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:23.128296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347a328-6537-4a37-976a-8555aa0a53e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:23.129356 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347a328-6537-4a37-976a-8555aa0a53e0 admin admin] PATH_INFO: `/v3/users/d976bf0c7fcd45278eaaa7bfd81bc572` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:23.132560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347a328-6537-4a37-976a-8555aa0a53e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d976bf0c7fcd45278eaaa7bfd81bc572)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:23.142743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347a328-6537-4a37-976a-8555aa0a53e0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:23.336312 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67fd6d-594a-4e56-8b72-ceb9c16178b0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:23.337158 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67fd6d-594a-4e56-8b72-ceb9c16178b0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:23.337158 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67fd6d-594a-4e56-8b72-ceb9c16178b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:23.428375 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6c67fd6d-594a-4e56-8b72-ceb9c16178b0 None None] MFA Rules not processed for user `c8522caa9bb74295b0b414c13a60e591`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:23.429501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6c67fd6d-594a-4e56-8b72-ceb9c16178b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:23.482604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c347a328-6537-4a37-976a-8555aa0a53e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd976bf0c7fcd45278eaaa7bfd81bc572'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:23.522592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c347a328-6537-4a37-976a-8555aa0a53e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd976bf0c7fcd45278eaaa7bfd81bc572'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:23.609754 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1326/2683] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:53:23.643292 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67fd6d-594a-4e56-8b72-ceb9c16178b0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:23.648030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c347a328-6537-4a37-976a-8555aa0a53e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd976bf0c7fcd45278eaaa7bfd81bc572'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:23.648671 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c347a328-6537-4a37-976a-8555aa0a53e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd976bf0c7fcd45278eaaa7bfd81bc572'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:23.649370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c347a328-6537-4a37-976a-8555aa0a53e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd976bf0c7fcd45278eaaa7bfd81bc572'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:23.652173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6c67fd6d-594a-4e56-8b72-ceb9c16178b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:23.679905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1358/2684] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:22 2022] DELETE /identity/v3/users/d976bf0c7fcd45278eaaa7bfd81bc572 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:23.687923 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae63b5-46b3-4682-8aa2-2b531356ac04 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:23.689057 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae63b5-46b3-4682-8aa2-2b531356ac04 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:23.692586 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae63b5-46b3-4682-8aa2-2b531356ac04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:23.804959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67fd6d-594a-4e56-8b72-ceb9c16178b0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:23.919507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4eefc-d502-4100-9140-da4783d6c65d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75138f08ea2b4813b095635d920599d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:23.919880 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4eefc-d502-4100-9140-da4783d6c65d service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:23.920613 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4eefc-d502-4100-9140-da4783d6c65d service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:23.921131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8cae63b5-46b3-4682-8aa2-2b531356ac04 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:23.921316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4eefc-d502-4100-9140-da4783d6c65d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:23.922359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8cae63b5-46b3-4682-8aa2-2b531356ac04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:23.933475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3ea4eefc-d502-4100-9140-da4783d6c65d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:24.006480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1359/2685] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:24.020680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae63b5-46b3-4682-8aa2-2b531356ac04 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:24.034943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8cae63b5-46b3-4682-8aa2-2b531356ac04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:24.083852 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4eefc-d502-4100-9140-da4783d6c65d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:24.085984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4eefc-d502-4100-9140-da4783d6c65d service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:24.113227 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1327/2686] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:24.194003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4eefc-d502-4100-9140-da4783d6c65d service glance] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:24.197386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3ea4eefc-d502-4100-9140-da4783d6c65d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:24.228299 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4eefc-d502-4100-9140-da4783d6c65d service glance] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:24.228438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae63b5-46b3-4682-8aa2-2b531356ac04 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:24.230675 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:24.231694 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:24.232171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:24.233155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] PATH_INFO: `/v3/users/e8a5b4766c684520a02b8425dd8a828a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:24.235290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a5b4766c684520a02b8425dd8a828a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:24.237907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:24.239793 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a3642-3e0c-4be7-92f5-d51ffdf17cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:24.241122 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a3642-3e0c-4be7-92f5-d51ffdf17cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:24.241672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a3642-3e0c-4be7-92f5-d51ffdf17cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:24.242218 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a3642-3e0c-4be7-92f5-d51ffdf17cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:24.280562 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a3642-3e0c-4be7-92f5-d51ffdf17cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:24.282280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a3642-3e0c-4be7-92f5-d51ffdf17cd2 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:24.312248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1360/2687] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:24.528384 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071dd71-6613-485b-b7ab-98e1f2d77488 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:24.528971 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071dd71-6613-485b-b7ab-98e1f2d77488 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:24.529426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071dd71-6613-485b-b7ab-98e1f2d77488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:24.581132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d071dd71-6613-485b-b7ab-98e1f2d77488 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:24.583587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d071dd71-6613-485b-b7ab-98e1f2d77488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:24.600875 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a5b4766c684520a02b8425dd8a828a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:24.604893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a5b4766c684520a02b8425dd8a828a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:24.652779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a5b4766c684520a02b8425dd8a828a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:24.675015 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a5b4766c684520a02b8425dd8a828a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:24.678351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a5b4766c684520a02b8425dd8a828a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:24.691935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1361/2688] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:53:24.764929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1328/2689] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:24 2022] DELETE /identity/v3/users/e8a5b4766c684520a02b8425dd8a828a => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:24.769513 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f24eb-5a5f-41bf-8eb1-3a9ce20e4c55 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:24.770546 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f24eb-5a5f-41bf-8eb1-3a9ce20e4c55 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:24.771638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f24eb-5a5f-41bf-8eb1-3a9ce20e4c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:24.808080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-144f24eb-5a5f-41bf-8eb1-3a9ce20e4c55 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:24.809907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-144f24eb-5a5f-41bf-8eb1-3a9ce20e4c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:24.863838 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:24.867125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:24.949920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1362/2690] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:53:24.975391 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f24eb-5a5f-41bf-8eb1-3a9ce20e4c55 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:24.978790 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-144f24eb-5a5f-41bf-8eb1-3a9ce20e4c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:25.046506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4efe92-3255-4000-be1a-90995bc04b82 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:25.055162 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb870adf-0597-4f28-a018-474f2730b1bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:25.055986 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb870adf-0597-4f28-a018-474f2730b1bb service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:25.056284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb870adf-0597-4f28-a018-474f2730b1bb service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:25.056821 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb870adf-0597-4f28-a018-474f2730b1bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:25.133169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f24eb-5a5f-41bf-8eb1-3a9ce20e4c55 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:25.138770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a546ba-31f8-4603-b4b3-449725593337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:25.139800 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a546ba-31f8-4603-b4b3-449725593337 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:25.140261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a546ba-31f8-4603-b4b3-449725593337 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:25.140708 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a546ba-31f8-4603-b4b3-449725593337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:25.162076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb870adf-0597-4f28-a018-474f2730b1bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:25.165983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb870adf-0597-4f28-a018-474f2730b1bb service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:25.180337 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a546ba-31f8-4603-b4b3-449725593337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:25.185880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a546ba-31f8-4603-b4b3-449725593337 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:25.188529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1329/2691] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:53:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 10:53:25.213915 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1363/2692] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:25.686897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:25.821194 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb870adf-0597-4f28-a018-474f2730b1bb service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:25.824238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bb870adf-0597-4f28-a018-474f2730b1bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:25.886649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb870adf-0597-4f28-a018-474f2730b1bb service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:25.909122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:25.910092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:25.910628 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:25.911010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] PATH_INFO: `/v3/projects/f5a4e6a5e18f431bb8a41df476a2807f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:25.912775 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a4e6a5e18f431bb8a41df476a2807f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:25.914878 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:25.929341 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:26.190191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a4e6a5e18f431bb8a41df476a2807f', 'request_id': 'req-46a841a6-8cdd-45c5-a53a-c74cd3193317'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.202241 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a546ba-31f8-4603-b4b3-449725593337 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:26.203491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a4e6a5e18f431bb8a41df476a2807f', 'request_id': 'req-46a841a6-8cdd-45c5-a53a-c74cd3193317'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.203924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e0a546ba-31f8-4603-b4b3-449725593337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:26.248652 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a546ba-31f8-4603-b4b3-449725593337 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:26.294636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a4e6a5e18f431bb8a41df476a2807f', 'request_id': 'req-46a841a6-8cdd-45c5-a53a-c74cd3193317'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.336921 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] The token cache is being invalidate because project f5a4e6a5e18f431bb8a41df476a2807f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:26.351207 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.361010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.365290 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1330/2693] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:25 2022] DELETE /identity/v3/projects/f5a4e6a5e18f431bb8a41df476a2807f => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:26.369990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:26.377853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:26.447359 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:26.450449 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:26.450744 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:26.451029 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] PATH_INFO: `/v3/projects/072b431de1624b29b22dea75239e6848` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:26.452539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=072b431de1624b29b22dea75239e6848)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:26.456679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:26.526388 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a841a6-8cdd-45c5-a53a-c74cd3193317 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:26.533463 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:26.534128 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:26.534411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:26.534686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] PATH_INFO: `/v3/users/cc5c93fb15604e43816acc36500f7258` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:26.539458 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5c93fb15604e43816acc36500f7258)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:26.541539 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:26.729384 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072b431de1624b29b22dea75239e6848', 'request_id': 'req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.748667 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072b431de1624b29b22dea75239e6848', 'request_id': 'req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.883757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5c93fb15604e43816acc36500f7258'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.887265 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072b431de1624b29b22dea75239e6848', 'request_id': 'req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.887779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5c93fb15604e43816acc36500f7258'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.904459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] The token cache is being invalidate because project 072b431de1624b29b22dea75239e6848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:26.904762 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.906460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.911317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1364/2694] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:26 2022] DELETE /identity/v3/projects/072b431de1624b29b22dea75239e6848 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:53:26.917098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:26.917566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5c93fb15604e43816acc36500f7258'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.926226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:26.931332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5c93fb15604e43816acc36500f7258'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:26.934837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5c93fb15604e43816acc36500f7258'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:27.035061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1331/2695] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:26 2022] DELETE /identity/v3/users/cc5c93fb15604e43816acc36500f7258 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:27.156483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:27.361120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38bf8-663c-48e1-9ad8-3f8ff6325c46 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:27.450710 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:27.813281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:27.820448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:27.820786 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:27.823094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] PATH_INFO: `/v3/users/5e7e0852ca694cbb9e15a8352a9eeff5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:27.832587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7e0852ca694cbb9e15a8352a9eeff5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:27.839672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:27.843338 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:28.357522 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:28.359552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:28.395640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f7418-ff67-4c10-b501-07077baa3e63 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:28.406714 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7e0852ca694cbb9e15a8352a9eeff5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:28.414562 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:28.416245 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:28.416830 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:28.417322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a admin admin] PATH_INFO: `/v3/projects/7e06d74964a94d27bfca1cacc189db28` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:28.429783 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e06d74964a94d27bfca1cacc189db28)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:28.440252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:28.475629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7e0852ca694cbb9e15a8352a9eeff5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:28.568068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7e0852ca694cbb9e15a8352a9eeff5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:28.569386 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7e0852ca694cbb9e15a8352a9eeff5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:28.570223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7e0852ca694cbb9e15a8352a9eeff5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:28.602630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1365/2696] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:26 2022] DELETE /identity/v3/users/5e7e0852ca694cbb9e15a8352a9eeff5 => generated 0 bytes in 1684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:28.685136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e06d74964a94d27bfca1cacc189db28', 'request_id': 'req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:28.700883 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e06d74964a94d27bfca1cacc189db28', 'request_id': 'req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:28.839868 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e06d74964a94d27bfca1cacc189db28', 'request_id': 'req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:28.891364 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a admin admin] The token cache is being invalidate because project 7e06d74964a94d27bfca1cacc189db28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:28.898665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:28.907641 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fdda3dcf-0f37-47d9-9c40-47eada7d7a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:28.932196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1332/2697] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:28 2022] DELETE /identity/v3/projects/7e06d74964a94d27bfca1cacc189db28 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:29.450234 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:29.820389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:29.820389 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:29.918184 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:30.026324 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6195e-8cb0-43c3-b4a1-0a53f610f517 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:30.028396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:30.144599 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111b7d1-a825-44eb-b28e-28bf4aa70994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:30.145161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111b7d1-a825-44eb-b28e-28bf4aa70994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:30.145488 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111b7d1-a825-44eb-b28e-28bf4aa70994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:30.145773 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111b7d1-a825-44eb-b28e-28bf4aa70994 admin admin] PATH_INFO: `/v3/projects/21ecebc95bbf42a4b27eadf3a85445bb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:30.148518 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111b7d1-a825-44eb-b28e-28bf4aa70994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21ecebc95bbf42a4b27eadf3a85445bb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:30.150765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111b7d1-a825-44eb-b28e-28bf4aa70994 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:30.411084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e111b7d1-a825-44eb-b28e-28bf4aa70994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ecebc95bbf42a4b27eadf3a85445bb', 'request_id': 'req-e111b7d1-a825-44eb-b28e-28bf4aa70994'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:30.433905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e111b7d1-a825-44eb-b28e-28bf4aa70994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ecebc95bbf42a4b27eadf3a85445bb', 'request_id': 'req-e111b7d1-a825-44eb-b28e-28bf4aa70994'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:30.536944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e111b7d1-a825-44eb-b28e-28bf4aa70994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ecebc95bbf42a4b27eadf3a85445bb', 'request_id': 'req-e111b7d1-a825-44eb-b28e-28bf4aa70994'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:30.568491 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e111b7d1-a825-44eb-b28e-28bf4aa70994 admin admin] The token cache is being invalidate because project 21ecebc95bbf42a4b27eadf3a85445bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:30.568772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e111b7d1-a825-44eb-b28e-28bf4aa70994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:30.571009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e111b7d1-a825-44eb-b28e-28bf4aa70994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:30.571448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1366/2698] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:29 2022] DELETE /identity/v3/projects/21ecebc95bbf42a4b27eadf3a85445bb => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:30.576591 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90d19-bc91-458c-8d47-4d82663b87f7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:30.577594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90d19-bc91-458c-8d47-4d82663b87f7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:30.585247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90d19-bc91-458c-8d47-4d82663b87f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:30.614496 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-61d90d19-bc91-458c-8d47-4d82663b87f7 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:30.616418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-61d90d19-bc91-458c-8d47-4d82663b87f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:30.705481 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1333/2699] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:30.715069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73a5a4-4abf-44dd-be33-1016aa77b6af None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:30.715529 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73a5a4-4abf-44dd-be33-1016aa77b6af None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:30.716264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73a5a4-4abf-44dd-be33-1016aa77b6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:30.744788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5e73a5a4-4abf-44dd-be33-1016aa77b6af None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:30.746014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5e73a5a4-4abf-44dd-be33-1016aa77b6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:30.763791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1367/2700] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:30.766711 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d90d19-bc91-458c-8d47-4d82663b87f7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:30.787211 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d90d19-bc91-458c-8d47-4d82663b87f7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:30.793667 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ae643-307f-4350-8c27-a7380d36f3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:30.794906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ae643-307f-4350-8c27-a7380d36f3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:30.795406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ae643-307f-4350-8c27-a7380d36f3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:30.795898 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ae643-307f-4350-8c27-a7380d36f3f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:30.796836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ae643-307f-4350-8c27-a7380d36f3f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:53:30.797355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ae643-307f-4350-8c27-a7380d36f3f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:30.799862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ae643-307f-4350-8c27-a7380d36f3f0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:30.821182 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1334/2701] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:53:30.829174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73a5a4-4abf-44dd-be33-1016aa77b6af None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:30.865347 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73a5a4-4abf-44dd-be33-1016aa77b6af None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:30.871358 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499712-47d3-4f71-b307-259aa87cd177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:30.872431 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499712-47d3-4f71-b307-259aa87cd177 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:30.873230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499712-47d3-4f71-b307-259aa87cd177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:30.873424 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499712-47d3-4f71-b307-259aa87cd177 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:30.874283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f499712-47d3-4f71-b307-259aa87cd177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:30.877509 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f499712-47d3-4f71-b307-259aa87cd177 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:31.605850 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1368/2702] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:53:30 2022] POST /identity/v3/projects => generated 373 bytes in 781 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:53:31.612507 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ae643-307f-4350-8c27-a7380d36f3f0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:31.626810 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ae643-307f-4350-8c27-a7380d36f3f0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:31.722757 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7c005-c904-4aeb-9858-999aa2d991ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:31.723432 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7c005-c904-4aeb-9858-999aa2d991ee admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:31.723736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7c005-c904-4aeb-9858-999aa2d991ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:31.724023 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7c005-c904-4aeb-9858-999aa2d991ee admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:31.724719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7c005-c904-4aeb-9858-999aa2d991ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:31.726622 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7c005-c904-4aeb-9858-999aa2d991ee admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:31.878552 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1335/2703] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:53:31 2022] POST /identity/v3/users => generated 287 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:53:31.883501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499712-47d3-4f71-b307-259aa87cd177 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:31.893003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7c005-c904-4aeb-9858-999aa2d991ee admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:31.898109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-71b7c005-c904-4aeb-9858-999aa2d991ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:31.904567 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499712-47d3-4f71-b307-259aa87cd177 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:31.912909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb034a53-d515-4356-860f-208e02aee971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:31.914619 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb034a53-d515-4356-860f-208e02aee971 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:31.915136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb034a53-d515-4356-860f-208e02aee971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:31.915641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb034a53-d515-4356-860f-208e02aee971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:31.916824 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb034a53-d515-4356-860f-208e02aee971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:31.921284 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb034a53-d515-4356-860f-208e02aee971 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:31.936974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1369/2704] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:31.943012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb034a53-d515-4356-860f-208e02aee971 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:31.963189 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb034a53-d515-4356-860f-208e02aee971 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:31.974501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72731ae7-e5ad-4adb-9719-b264d12678fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:31.976580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72731ae7-e5ad-4adb-9719-b264d12678fd admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:31.977361 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72731ae7-e5ad-4adb-9719-b264d12678fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:31.977898 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72731ae7-e5ad-4adb-9719-b264d12678fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:31.978862 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72731ae7-e5ad-4adb-9719-b264d12678fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:31.981661 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72731ae7-e5ad-4adb-9719-b264d12678fd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:31.998100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1370/2705] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:32.006813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72731ae7-e5ad-4adb-9719-b264d12678fd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:32.031263 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72731ae7-e5ad-4adb-9719-b264d12678fd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:32.037092 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76f97-501e-49a2-8794-954fc5110c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:32.044425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76f97-501e-49a2-8794-954fc5110c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:32.044425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76f97-501e-49a2-8794-954fc5110c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:32.044425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76f97-501e-49a2-8794-954fc5110c51 admin admin] PATH_INFO: `/v3/projects/7a10225c56cf4d6baa1537c905efb60c/users/2a3477adb32e420387d6037a32baca12/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:32.067506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76f97-501e-49a2-8794-954fc5110c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a10225c56cf4d6baa1537c905efb60c, user_id=2a3477adb32e420387d6037a32baca12, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:32.067887 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7c005-c904-4aeb-9858-999aa2d991ee admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:32.070768 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76f97-501e-49a2-8794-954fc5110c51 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:32.075498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f53e5-8acb-4aa2-ad32-5dc18cb00500 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebfb233b2504463a4ee9202b5a3ab50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:32.076387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f53e5-8acb-4aa2-ad32-5dc18cb00500 service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:32.076672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f53e5-8acb-4aa2-ad32-5dc18cb00500 service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:32.077002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f53e5-8acb-4aa2-ad32-5dc18cb00500 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:32.078877 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e95f53e5-8acb-4aa2-ad32-5dc18cb00500 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:32.097204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f53e5-8acb-4aa2-ad32-5dc18cb00500 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:32.098854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f53e5-8acb-4aa2-ad32-5dc18cb00500 service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:32.119484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1336/2706] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:32.137935 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f53e5-8acb-4aa2-ad32-5dc18cb00500 service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:32.139747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e95f53e5-8acb-4aa2-ad32-5dc18cb00500 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:32.160440 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f53e5-8acb-4aa2-ad32-5dc18cb00500 service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:32.167115 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:32.167969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:32.168495 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:32.168495 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] PATH_INFO: `/v3/users/3a962c814f9f40bfa9e13efda4a66786` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:32.171107 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a962c814f9f40bfa9e13efda4a66786)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:32.171770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:32.231295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1371/2707] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:32 2022] PUT /identity/v3/projects/7a10225c56cf4d6baa1537c905efb60c/users/2a3477adb32e420387d6037a32baca12/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:32.244231 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c0360-1599-45bb-975b-27f179700b62 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:32.244514 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c0360-1599-45bb-975b-27f179700b62 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:32.244772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c0360-1599-45bb-975b-27f179700b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:32.282883 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3c4c0360-1599-45bb-975b-27f179700b62 None None] MFA Rules not processed for user `2a3477adb32e420387d6037a32baca12`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:32.282883 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3c4c0360-1599-45bb-975b-27f179700b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:32.394304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a962c814f9f40bfa9e13efda4a66786'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:32.395643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a962c814f9f40bfa9e13efda4a66786'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:32.443637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a962c814f9f40bfa9e13efda4a66786'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:32.458440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1372/2708] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:53:32.467579 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a962c814f9f40bfa9e13efda4a66786'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:32.467579 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a962c814f9f40bfa9e13efda4a66786'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:32.473153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c0360-1599-45bb-975b-27f179700b62 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:32.474728 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3c4c0360-1599-45bb-975b-27f179700b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:32.595603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1337/2709] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:32 2022] DELETE /identity/v3/users/3a962c814f9f40bfa9e13efda4a66786 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:32.616014 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c0360-1599-45bb-975b-27f179700b62 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:32.664966 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:32.721086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f23a75-ea36-4b09-be5c-dadafccc726b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:32.721799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f23a75-ea36-4b09-be5c-dadafccc726b service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:32.722079 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f23a75-ea36-4b09-be5c-dadafccc726b service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:32.722352 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f23a75-ea36-4b09-be5c-dadafccc726b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:32.724869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-58f23a75-ea36-4b09-be5c-dadafccc726b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:32.775316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:32.913117 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f23a75-ea36-4b09-be5c-dadafccc726b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:32.916894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f23a75-ea36-4b09-be5c-dadafccc726b service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:32.933247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1373/2710] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:53:32.976851 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:32.978624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:33.067621 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486ab44-8371-47d1-9e2c-69222f28b8e2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:33.073370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816944e-6de5-4c73-936a-da92abfed94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:33.074738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816944e-6de5-4c73-936a-da92abfed94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:33.074738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816944e-6de5-4c73-936a-da92abfed94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:33.074738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816944e-6de5-4c73-936a-da92abfed94b admin admin] PATH_INFO: `/v3/users/2a3477adb32e420387d6037a32baca12` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:33.075950 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816944e-6de5-4c73-936a-da92abfed94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3477adb32e420387d6037a32baca12)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:33.077879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816944e-6de5-4c73-936a-da92abfed94b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:33.207004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f23a75-ea36-4b09-be5c-dadafccc726b service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:33.210593 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-58f23a75-ea36-4b09-be5c-dadafccc726b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:33.247321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f23a75-ea36-4b09-be5c-dadafccc726b service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:33.264227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:33.265348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:33.267644 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:33.268286 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] PATH_INFO: `/v3/projects/6fbfc8ca282a4e1086b8bc4b1beb9e25` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:33.273205 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fbfc8ca282a4e1086b8bc4b1beb9e25)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:33.277183 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:33.547076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b816944e-6de5-4c73-936a-da92abfed94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3477adb32e420387d6037a32baca12'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:33.552083 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fbfc8ca282a4e1086b8bc4b1beb9e25', 'request_id': 'req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:33.557387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b816944e-6de5-4c73-936a-da92abfed94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3477adb32e420387d6037a32baca12'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:33.572991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fbfc8ca282a4e1086b8bc4b1beb9e25', 'request_id': 'req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:33.579935 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b816944e-6de5-4c73-936a-da92abfed94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3477adb32e420387d6037a32baca12'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:33.593421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b816944e-6de5-4c73-936a-da92abfed94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3477adb32e420387d6037a32baca12'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:33.594731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b816944e-6de5-4c73-936a-da92abfed94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3477adb32e420387d6037a32baca12'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:33.745888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fbfc8ca282a4e1086b8bc4b1beb9e25', 'request_id': 'req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:33.774788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] The token cache is being invalidate because project 6fbfc8ca282a4e1086b8bc4b1beb9e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:33.775513 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:33.776392 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:33.782141 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1374/2711] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:33 2022] DELETE /identity/v3/projects/6fbfc8ca282a4e1086b8bc4b1beb9e25 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:33.784889 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:33.786484 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:33.861056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1338/2712] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:32 2022] DELETE /identity/v3/users/2a3477adb32e420387d6037a32baca12 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:33.868197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204b7a1-8f30-4ecb-a747-167255263f8e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:33.868551 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204b7a1-8f30-4ecb-a747-167255263f8e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:33.868982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204b7a1-8f30-4ecb-a747-167255263f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:33.927854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a204b7a1-8f30-4ecb-a747-167255263f8e None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:33.929171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a204b7a1-8f30-4ecb-a747-167255263f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:33.934679 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfed94-a6f6-4e1f-bcf8-c68160b82fab admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:34.014364 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1339/2713] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:53:34.023522 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204b7a1-8f30-4ecb-a747-167255263f8e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:34.025699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a204b7a1-8f30-4ecb-a747-167255263f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:34.042686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:34.043672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:34.047417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:34.048913 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] PATH_INFO: `/v3/users/9a6626ba44944859b21d401a409a1181` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:34.051366 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6626ba44944859b21d401a409a1181)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:34.054397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:34.176010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204b7a1-8f30-4ecb-a747-167255263f8e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:34.183749 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246daa-1d02-40db-b305-7b35d686ec8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:34.185516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246daa-1d02-40db-b305-7b35d686ec8b service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:34.185516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246daa-1d02-40db-b305-7b35d686ec8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:34.186275 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246daa-1d02-40db-b305-7b35d686ec8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:34.214898 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a246daa-1d02-40db-b305-7b35d686ec8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:34.217922 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a246daa-1d02-40db-b305-7b35d686ec8b service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:34.252363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1340/2714] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:34.309448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:34.334296 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6626ba44944859b21d401a409a1181'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:34.371253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6626ba44944859b21d401a409a1181'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:34.468340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6626ba44944859b21d401a409a1181'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:34.469233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6626ba44944859b21d401a409a1181'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:34.469925 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6626ba44944859b21d401a409a1181'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:34.497791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1375/2715] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:33 2022] DELETE /identity/v3/users/9a6626ba44944859b21d401a409a1181 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:34.535128 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:35.004876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246daa-1d02-40db-b305-7b35d686ec8b service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:35.032778 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246daa-1d02-40db-b305-7b35d686ec8b service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:35.052556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:35.054820 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:35.168328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae9819-1d14-4423-aad1-a28aeb141059 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:35.171256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81f62d-0a7b-4182-8311-6c29c25e9a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:35.172003 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81f62d-0a7b-4182-8311-6c29c25e9a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:35.172484 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81f62d-0a7b-4182-8311-6c29c25e9a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:35.173402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81f62d-0a7b-4182-8311-6c29c25e9a75 admin admin] PATH_INFO: `/v3/projects/aaa7d4d896be4102a521a11a1130e9a2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:35.175284 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81f62d-0a7b-4182-8311-6c29c25e9a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa7d4d896be4102a521a11a1130e9a2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:35.178588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81f62d-0a7b-4182-8311-6c29c25e9a75 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:35.195813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4e03a-d2be-49d7-9a77-3d034ff4585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:35.195813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4e03a-d2be-49d7-9a77-3d034ff4585e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:35.195813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4e03a-d2be-49d7-9a77-3d034ff4585e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:35.195813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4e03a-d2be-49d7-9a77-3d034ff4585e admin admin] PATH_INFO: `/v3/projects/7a10225c56cf4d6baa1537c905efb60c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:35.196637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4e03a-d2be-49d7-9a77-3d034ff4585e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a10225c56cf4d6baa1537c905efb60c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:35.196637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4e03a-d2be-49d7-9a77-3d034ff4585e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:35.390757 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fea4e03a-d2be-49d7-9a77-3d034ff4585e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a10225c56cf4d6baa1537c905efb60c', 'request_id': 'req-fea4e03a-d2be-49d7-9a77-3d034ff4585e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:35.400984 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0c81f62d-0a7b-4182-8311-6c29c25e9a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa7d4d896be4102a521a11a1130e9a2', 'request_id': 'req-0c81f62d-0a7b-4182-8311-6c29c25e9a75'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:35.410019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fea4e03a-d2be-49d7-9a77-3d034ff4585e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a10225c56cf4d6baa1537c905efb60c', 'request_id': 'req-fea4e03a-d2be-49d7-9a77-3d034ff4585e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:35.418206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0c81f62d-0a7b-4182-8311-6c29c25e9a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa7d4d896be4102a521a11a1130e9a2', 'request_id': 'req-0c81f62d-0a7b-4182-8311-6c29c25e9a75'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:35.497403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fea4e03a-d2be-49d7-9a77-3d034ff4585e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a10225c56cf4d6baa1537c905efb60c', 'request_id': 'req-fea4e03a-d2be-49d7-9a77-3d034ff4585e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:35.500841 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:35.513908 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fea4e03a-d2be-49d7-9a77-3d034ff4585e admin admin] The token cache is being invalidate because project 7a10225c56cf4d6baa1537c905efb60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:35.514419 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fea4e03a-d2be-49d7-9a77-3d034ff4585e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:35.517119 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fea4e03a-d2be-49d7-9a77-3d034ff4585e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:35.527451 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1376/2716] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:35 2022] DELETE /identity/v3/projects/7a10225c56cf4d6baa1537c905efb60c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:35.540161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0edce-bbd1-4e12-94e2-852da0841531 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:35.540856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0edce-bbd1-4e12-94e2-852da0841531 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:35.541507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0edce-bbd1-4e12-94e2-852da0841531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:35.582654 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0c81f62d-0a7b-4182-8311-6c29c25e9a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa7d4d896be4102a521a11a1130e9a2', 'request_id': 'req-0c81f62d-0a7b-4182-8311-6c29c25e9a75'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:35.613770 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0c81f62d-0a7b-4182-8311-6c29c25e9a75 admin admin] The token cache is being invalidate because project aaa7d4d896be4102a521a11a1130e9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:35.614551 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0c81f62d-0a7b-4182-8311-6c29c25e9a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:35.617126 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0c81f62d-0a7b-4182-8311-6c29c25e9a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:35.623495 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-00d0edce-bbd1-4e12-94e2-852da0841531 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:35.626709 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1341/2717] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:35 2022] DELETE /identity/v3/projects/aaa7d4d896be4102a521a11a1130e9a2 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:35.627641 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-00d0edce-bbd1-4e12-94e2-852da0841531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:35.686358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:35.763985 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1377/2718] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:35.780746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59a908-ce55-43ed-b272-a7c2e7df281b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:35.781590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59a908-ce55-43ed-b272-a7c2e7df281b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:35.782148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59a908-ce55-43ed-b272-a7c2e7df281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:35.819814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0a59a908-ce55-43ed-b272-a7c2e7df281b None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:35.822059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a59a908-ce55-43ed-b272-a7c2e7df281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:35.841857 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1342/2719] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:53:35.844403 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0edce-bbd1-4e12-94e2-852da0841531 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:35.870963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0edce-bbd1-4e12-94e2-852da0841531 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:35.879678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f3e9-9bc7-4b17-8442-1260d9cc41b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:35.880926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f3e9-9bc7-4b17-8442-1260d9cc41b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:35.881485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f3e9-9bc7-4b17-8442-1260d9cc41b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:35.882034 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f3e9-9bc7-4b17-8442-1260d9cc41b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:35.883247 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122f3e9-9bc7-4b17-8442-1260d9cc41b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:53:35.883893 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122f3e9-9bc7-4b17-8442-1260d9cc41b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:35.886809 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122f3e9-9bc7-4b17-8442-1260d9cc41b5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:35.908703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1378/2720] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:53:35.913519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59a908-ce55-43ed-b272-a7c2e7df281b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:35.939053 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59a908-ce55-43ed-b272-a7c2e7df281b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:35.947647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4a9fa-cff4-48b2-8ab4-696afddc0847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:35.948731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4a9fa-cff4-48b2-8ab4-696afddc0847 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:35.949185 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4a9fa-cff4-48b2-8ab4-696afddc0847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:35.949660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4a9fa-cff4-48b2-8ab4-696afddc0847 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:35.950589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4a9fa-cff4-48b2-8ab4-696afddc0847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:35.952634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4a9fa-cff4-48b2-8ab4-696afddc0847 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:36.264544 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1343/2721] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:53:35 2022] POST /identity/v3/projects => generated 375 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:36.270206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f3e9-9bc7-4b17-8442-1260d9cc41b5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:36.290309 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f3e9-9bc7-4b17-8442-1260d9cc41b5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:36.374430 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeeddf-2097-406b-9668-58c607387811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:36.375030 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeeddf-2097-406b-9668-58c607387811 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:36.375306 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeeddf-2097-406b-9668-58c607387811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:36.375628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeeddf-2097-406b-9668-58c607387811 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:36.377021 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedeeddf-2097-406b-9668-58c607387811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:36.379120 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedeeddf-2097-406b-9668-58c607387811 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:36.480394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1379/2722] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:53:36 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:36.486806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4a9fa-cff4-48b2-8ab4-696afddc0847 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:36.502090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4a9fa-cff4-48b2-8ab4-696afddc0847 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:36.513739 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9040501-abe6-4d67-910c-35a6961bb1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:36.514903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9040501-abe6-4d67-910c-35a6961bb1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:36.514903 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9040501-abe6-4d67-910c-35a6961bb1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:36.515351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9040501-abe6-4d67-910c-35a6961bb1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:36.517005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9040501-abe6-4d67-910c-35a6961bb1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:36.520229 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9040501-abe6-4d67-910c-35a6961bb1d1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:36.537096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1344/2723] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:36.544528 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeeddf-2097-406b-9668-58c607387811 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:36.556507 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeeddf-2097-406b-9668-58c607387811 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:36.561730 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e95772-54b1-42e8-a184-d9de1701c486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:36.562530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95772-54b1-42e8-a184-d9de1701c486 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:36.564700 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95772-54b1-42e8-a184-d9de1701c486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:36.565292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95772-54b1-42e8-a184-d9de1701c486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:36.567533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e95772-54b1-42e8-a184-d9de1701c486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:36.569778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e95772-54b1-42e8-a184-d9de1701c486 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:36.585895 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1380/2724] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:36.590225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9040501-abe6-4d67-910c-35a6961bb1d1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:36.608101 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9040501-abe6-4d67-910c-35a6961bb1d1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:36.619746 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760359-b32f-4850-906a-1dabd8efef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:36.620768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760359-b32f-4850-906a-1dabd8efef98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:36.621197 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760359-b32f-4850-906a-1dabd8efef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:36.621674 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760359-b32f-4850-906a-1dabd8efef98 admin admin] PATH_INFO: `/v3/projects/cfed3b4d2c6e4118a0fb63afc99f3a02/users/ace85d0d241a4aa1a08a5b9b7b90a148/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:36.651195 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6760359-b32f-4850-906a-1dabd8efef98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfed3b4d2c6e4118a0fb63afc99f3a02, user_id=ace85d0d241a4aa1a08a5b9b7b90a148, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:36.654778 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6760359-b32f-4850-906a-1dabd8efef98 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:36.769402 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1345/2725] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:36 2022] PUT /identity/v3/projects/cfed3b4d2c6e4118a0fb63afc99f3a02/users/ace85d0d241a4aa1a08a5b9b7b90a148/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:36.788973 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad38408-65d6-4d0c-80e5-d00daacc12f5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:36.789751 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad38408-65d6-4d0c-80e5-d00daacc12f5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:36.790236 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad38408-65d6-4d0c-80e5-d00daacc12f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:36.854376 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-cad38408-65d6-4d0c-80e5-d00daacc12f5 None None] MFA Rules not processed for user `ace85d0d241a4aa1a08a5b9b7b90a148`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:36.855866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cad38408-65d6-4d0c-80e5-d00daacc12f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:36.966893 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1381/2726] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:36.974782 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760359-b32f-4850-906a-1dabd8efef98 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:37.091157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760359-b32f-4850-906a-1dabd8efef98 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:37.097993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb33cef-63db-4b9d-8a33-ab7d5776a904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:37.098632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb33cef-63db-4b9d-8a33-ab7d5776a904 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:37.098820 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb33cef-63db-4b9d-8a33-ab7d5776a904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:37.099057 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb33cef-63db-4b9d-8a33-ab7d5776a904 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:37.099702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb33cef-63db-4b9d-8a33-ab7d5776a904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:37.101645 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb33cef-63db-4b9d-8a33-ab7d5776a904 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:37.109100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:37.221315 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1346/2727] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:53:36 2022] POST /identity/v3/projects => generated 373 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:37.222372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad38408-65d6-4d0c-80e5-d00daacc12f5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:37.249778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad38408-65d6-4d0c-80e5-d00daacc12f5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:37.301937 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:37.380089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d28acc-89b6-45e3-8d54-dd6ab6b814d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:37.380674 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d28acc-89b6-45e3-8d54-dd6ab6b814d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:37.381143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d28acc-89b6-45e3-8d54-dd6ab6b814d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:37.381590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d28acc-89b6-45e3-8d54-dd6ab6b814d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:37.385636 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d28acc-89b6-45e3-8d54-dd6ab6b814d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:37.386920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d28acc-89b6-45e3-8d54-dd6ab6b814d4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:37.515387 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1382/2728] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:53:37 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:53:37.517240 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb33cef-63db-4b9d-8a33-ab7d5776a904 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:37.530573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb33cef-63db-4b9d-8a33-ab7d5776a904 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:37.539114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ad1c4-3bae-4bdf-9cd2-e86ea0ba0fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:37.539808 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ad1c4-3bae-4bdf-9cd2-e86ea0ba0fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:37.540158 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ad1c4-3bae-4bdf-9cd2-e86ea0ba0fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:37.540510 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ad1c4-3bae-4bdf-9cd2-e86ea0ba0fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:37.541114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ad1c4-3bae-4bdf-9cd2-e86ea0ba0fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:37.545120 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ad1c4-3bae-4bdf-9cd2-e86ea0ba0fd2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:37.569593 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1347/2729] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:37.570717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d28acc-89b6-45e3-8d54-dd6ab6b814d4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:37.588489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d28acc-89b6-45e3-8d54-dd6ab6b814d4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:37.598332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8cda6-5202-4776-8923-827df347e7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:37.599037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8cda6-5202-4776-8923-827df347e7ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:37.599317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8cda6-5202-4776-8923-827df347e7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:37.599630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8cda6-5202-4776-8923-827df347e7ef admin admin] PATH_INFO: `/v3/projects/21842a380f86482c884c50b8d2563478/users/a64d2cb55e5f4c498dc9f92b73da7752/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:37.625132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8cda6-5202-4776-8923-827df347e7ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=21842a380f86482c884c50b8d2563478, user_id=a64d2cb55e5f4c498dc9f92b73da7752, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:37.630322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8cda6-5202-4776-8923-827df347e7ef admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:37.777505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1383/2730] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:37 2022] PUT /identity/v3/projects/21842a380f86482c884c50b8d2563478/users/a64d2cb55e5f4c498dc9f92b73da7752/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:37.783601 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ad1c4-3bae-4bdf-9cd2-e86ea0ba0fd2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:37.804098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ad1c4-3bae-4bdf-9cd2-e86ea0ba0fd2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:37.894318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddc1e2-8d28-4a2c-8e3e-8d9e3803bc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:37.894945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddc1e2-8d28-4a2c-8e3e-8d9e3803bc7f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:37.895226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddc1e2-8d28-4a2c-8e3e-8d9e3803bc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:37.895497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddc1e2-8d28-4a2c-8e3e-8d9e3803bc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:37.896177 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddc1e2-8d28-4a2c-8e3e-8d9e3803bc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:37.897977 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddc1e2-8d28-4a2c-8e3e-8d9e3803bc7f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:37.909908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1348/2731] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:37.914288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8cda6-5202-4776-8923-827df347e7ef admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:37.931461 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8cda6-5202-4776-8923-827df347e7ef admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:37.936548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81047284-1afd-4b8c-8494-6c0b3d835dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:37.940986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81047284-1afd-4b8c-8494-6c0b3d835dce admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:37.940986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81047284-1afd-4b8c-8494-6c0b3d835dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:37.940986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81047284-1afd-4b8c-8494-6c0b3d835dce admin admin] PATH_INFO: `/v3/projects/21842a380f86482c884c50b8d2563478/users/a64d2cb55e5f4c498dc9f92b73da7752/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:37.940986 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81047284-1afd-4b8c-8494-6c0b3d835dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=21842a380f86482c884c50b8d2563478, user_id=a64d2cb55e5f4c498dc9f92b73da7752, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:37.943576 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81047284-1afd-4b8c-8494-6c0b3d835dce admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:37.960569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1384/2732] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:37 2022] PUT /identity/v3/projects/21842a380f86482c884c50b8d2563478/users/a64d2cb55e5f4c498dc9f92b73da7752/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:38.039785 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:38.040565 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f1062-fa32-492c-8f98-e6a097be72de None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:38.040893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f1062-fa32-492c-8f98-e6a097be72de None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:38.041125 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f1062-fa32-492c-8f98-e6a097be72de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:38.080226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ed2f1062-fa32-492c-8f98-e6a097be72de None None] MFA Rules not processed for user `a64d2cb55e5f4c498dc9f92b73da7752`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:38.082339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ed2f1062-fa32-492c-8f98-e6a097be72de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:38.237405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1349/2733] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:38.254974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81047284-1afd-4b8c-8494-6c0b3d835dce admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:38.257340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-81047284-1afd-4b8c-8494-6c0b3d835dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:38.365132 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81047284-1afd-4b8c-8494-6c0b3d835dce admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:38.377387 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606759a-683a-4a16-909e-d120bf602d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:38.378144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606759a-683a-4a16-909e-d120bf602d76 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:38.378570 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606759a-683a-4a16-909e-d120bf602d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:38.378888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606759a-683a-4a16-909e-d120bf602d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:38.408608 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:38.504522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606759a-683a-4a16-909e-d120bf602d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:38.506448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606759a-683a-4a16-909e-d120bf602d76 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:38.525138 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1385/2734] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:41.351628 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab1037-8666-4b79-9701-24d722359be8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:41.352136 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab1037-8666-4b79-9701-24d722359be8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:41.352238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab1037-8666-4b79-9701-24d722359be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:41.374059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-16ab1037-8666-4b79-9701-24d722359be8 None None] MFA Rules not processed for user `bc818edc509d423b99476981532f02a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:41.375426 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-16ab1037-8666-4b79-9701-24d722359be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:41.398112 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:41.448546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1350/2735] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:41.973097 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606759a-683a-4a16-909e-d120bf602d76 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:42.063740 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606759a-683a-4a16-909e-d120bf602d76 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:42.069623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:42.070255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:42.070533 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:42.070807 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] PATH_INFO: `/v3/users/ace85d0d241a4aa1a08a5b9b7b90a148` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:42.072084 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace85d0d241a4aa1a08a5b9b7b90a148)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:42.074008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:42.377833 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace85d0d241a4aa1a08a5b9b7b90a148'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:42.410935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace85d0d241a4aa1a08a5b9b7b90a148'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:42.598769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace85d0d241a4aa1a08a5b9b7b90a148'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:42.599318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace85d0d241a4aa1a08a5b9b7b90a148'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:42.599989 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace85d0d241a4aa1a08a5b9b7b90a148'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:42.619802 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1386/2736] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:41 2022] DELETE /identity/v3/users/ace85d0d241a4aa1a08a5b9b7b90a148 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:42.625335 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67528a-57f9-4c89-b2f8-f865bfee61c8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:42.626214 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67528a-57f9-4c89-b2f8-f865bfee61c8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:42.626359 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67528a-57f9-4c89-b2f8-f865bfee61c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:42.647533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-de67528a-57f9-4c89-b2f8-f865bfee61c8 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:42.648836 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-de67528a-57f9-4c89-b2f8-f865bfee61c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:42.730495 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1351/2737] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:42.743790 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:42.745323 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:42.800058 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:42.824438 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbc5b1-2bdf-4686-919c-266fcd177008 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:42.828321 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba4ef3-c9b3-4c1f-aa44-f0f5c5cb5f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:42.829486 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba4ef3-c9b3-4c1f-aa44-f0f5c5cb5f2a service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:42.829765 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba4ef3-c9b3-4c1f-aa44-f0f5c5cb5f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:42.830039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba4ef3-c9b3-4c1f-aa44-f0f5c5cb5f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:42.841450 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba4ef3-c9b3-4c1f-aa44-f0f5c5cb5f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:42.843035 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba4ef3-c9b3-4c1f-aa44-f0f5c5cb5f2a service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:42.855283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1387/2738] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:43.355321 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67528a-57f9-4c89-b2f8-f865bfee61c8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:43.359594 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-de67528a-57f9-4c89-b2f8-f865bfee61c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:43.372768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67528a-57f9-4c89-b2f8-f865bfee61c8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:43.387548 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:43.388257 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:43.388595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:43.389021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] PATH_INFO: `/v3/projects/cfed3b4d2c6e4118a0fb63afc99f3a02` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:43.390243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfed3b4d2c6e4118a0fb63afc99f3a02)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:43.392637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:43.561963 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfed3b4d2c6e4118a0fb63afc99f3a02', 'request_id': 'req-759e4748-efc4-49f6-a23b-28aa90685498'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:43.570901 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfed3b4d2c6e4118a0fb63afc99f3a02', 'request_id': 'req-759e4748-efc4-49f6-a23b-28aa90685498'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:43.698936 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfed3b4d2c6e4118a0fb63afc99f3a02', 'request_id': 'req-759e4748-efc4-49f6-a23b-28aa90685498'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:43.710659 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] The token cache is being invalidate because project cfed3b4d2c6e4118a0fb63afc99f3a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:43.710946 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:43.711626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:43.713151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1352/2739] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:43 2022] DELETE /identity/v3/projects/cfed3b4d2c6e4118a0fb63afc99f3a02 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:43.717646 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba4ef3-c9b3-4c1f-aa44-f0f5c5cb5f2a service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:43.727860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba4ef3-c9b3-4c1f-aa44-f0f5c5cb5f2a service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:43.817074 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6d23c-7378-4b19-9e6c-45fccadc9d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:43.817729 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6d23c-7378-4b19-9e6c-45fccadc9d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:43.818010 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6d23c-7378-4b19-9e6c-45fccadc9d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:43.818284 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6d23c-7378-4b19-9e6c-45fccadc9d3c admin admin] PATH_INFO: `/v3/users/a64d2cb55e5f4c498dc9f92b73da7752` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:43.819492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6d23c-7378-4b19-9e6c-45fccadc9d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64d2cb55e5f4c498dc9f92b73da7752)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:43.821673 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6d23c-7378-4b19-9e6c-45fccadc9d3c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:44.089019 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fea6d23c-7378-4b19-9e6c-45fccadc9d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64d2cb55e5f4c498dc9f92b73da7752'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:44.104280 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fea6d23c-7378-4b19-9e6c-45fccadc9d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64d2cb55e5f4c498dc9f92b73da7752'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:44.221746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fea6d23c-7378-4b19-9e6c-45fccadc9d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64d2cb55e5f4c498dc9f92b73da7752'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:44.222379 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fea6d23c-7378-4b19-9e6c-45fccadc9d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64d2cb55e5f4c498dc9f92b73da7752'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:44.222975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fea6d23c-7378-4b19-9e6c-45fccadc9d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64d2cb55e5f4c498dc9f92b73da7752'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:44.237408 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1388/2740] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:43 2022] DELETE /identity/v3/users/a64d2cb55e5f4c498dc9f92b73da7752 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:44.800222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:44.802492 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:44.815559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e4748-efc4-49f6-a23b-28aa90685498 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:44.874491 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:44.885211 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2de964-fe31-4baf-8db3-88b3895daa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:44.885926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2de964-fe31-4baf-8db3-88b3895daa0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:44.886203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2de964-fe31-4baf-8db3-88b3895daa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:44.886796 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2de964-fe31-4baf-8db3-88b3895daa0f admin admin] PATH_INFO: `/v3/projects/21842a380f86482c884c50b8d2563478` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:44.888690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2de964-fe31-4baf-8db3-88b3895daa0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=21842a380f86482c884c50b8d2563478)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:44.891759 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2de964-fe31-4baf-8db3-88b3895daa0f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:45.028061 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5b2de964-fe31-4baf-8db3-88b3895daa0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21842a380f86482c884c50b8d2563478', 'request_id': 'req-5b2de964-fe31-4baf-8db3-88b3895daa0f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:45.036392 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5b2de964-fe31-4baf-8db3-88b3895daa0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21842a380f86482c884c50b8d2563478', 'request_id': 'req-5b2de964-fe31-4baf-8db3-88b3895daa0f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:45.130421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5b2de964-fe31-4baf-8db3-88b3895daa0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21842a380f86482c884c50b8d2563478', 'request_id': 'req-5b2de964-fe31-4baf-8db3-88b3895daa0f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:45.149217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5b2de964-fe31-4baf-8db3-88b3895daa0f admin admin] The token cache is being invalidate because project 21842a380f86482c884c50b8d2563478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:45.149525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5b2de964-fe31-4baf-8db3-88b3895daa0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:45.150183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5b2de964-fe31-4baf-8db3-88b3895daa0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:45.151690 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1353/2741] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:44 2022] DELETE /identity/v3/projects/21842a380f86482c884c50b8d2563478 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:45.158008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b668b-eec9-4ae0-93b5-ba104e4692ed None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:45.160813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b668b-eec9-4ae0-93b5-ba104e4692ed None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:45.160813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b668b-eec9-4ae0-93b5-ba104e4692ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:45.187858 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1d0b668b-eec9-4ae0-93b5-ba104e4692ed None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:45.189212 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1d0b668b-eec9-4ae0-93b5-ba104e4692ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:45.256100 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:45.268956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1389/2742] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:45.282019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce713684-056c-47fb-8be0-88a351f7bb85 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:45.287084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce713684-056c-47fb-8be0-88a351f7bb85 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:45.287084 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce713684-056c-47fb-8be0-88a351f7bb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:45.308504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ce713684-056c-47fb-8be0-88a351f7bb85 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:45.310274 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ce713684-056c-47fb-8be0-88a351f7bb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:45.320906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1354/2743] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:45.325213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b668b-eec9-4ae0-93b5-ba104e4692ed None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:45.336242 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b668b-eec9-4ae0-93b5-ba104e4692ed None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:45.341396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63142b2-29eb-43c0-8de8-d376fbcc07c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:45.342037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63142b2-29eb-43c0-8de8-d376fbcc07c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:45.342510 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63142b2-29eb-43c0-8de8-d376fbcc07c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:45.342809 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63142b2-29eb-43c0-8de8-d376fbcc07c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:45.343475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63142b2-29eb-43c0-8de8-d376fbcc07c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:53:45.344161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63142b2-29eb-43c0-8de8-d376fbcc07c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:45.346745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63142b2-29eb-43c0-8de8-d376fbcc07c7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:45.366141 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1390/2744] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:53:45.369367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce713684-056c-47fb-8be0-88a351f7bb85 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:45.383181 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce713684-056c-47fb-8be0-88a351f7bb85 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:45.389669 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1829593-285a-484b-b022-441459c80de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:45.390634 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1829593-285a-484b-b022-441459c80de6 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:45.396666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1829593-285a-484b-b022-441459c80de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:45.396666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1829593-285a-484b-b022-441459c80de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:45.396666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1829593-285a-484b-b022-441459c80de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:45.396666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1829593-285a-484b-b022-441459c80de6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:45.502358 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1355/2745] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:53:45 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:45.507230 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63142b2-29eb-43c0-8de8-d376fbcc07c7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:45.519222 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63142b2-29eb-43c0-8de8-d376fbcc07c7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:45.628348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb94dc-4625-4cb0-a34a-693a87b66457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:45.628964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb94dc-4625-4cb0-a34a-693a87b66457 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:45.629326 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb94dc-4625-4cb0-a34a-693a87b66457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:45.629540 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb94dc-4625-4cb0-a34a-693a87b66457 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:45.630316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb94dc-4625-4cb0-a34a-693a87b66457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:45.632214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb94dc-4625-4cb0-a34a-693a87b66457 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:45.719773 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1391/2746] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:53:45 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:53:45.726131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1829593-285a-484b-b022-441459c80de6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:45.740799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1829593-285a-484b-b022-441459c80de6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:45.752712 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fbd01-4b2a-4919-979b-dd9b474292b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:45.753421 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fbd01-4b2a-4919-979b-dd9b474292b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:45.753807 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fbd01-4b2a-4919-979b-dd9b474292b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:45.754116 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fbd01-4b2a-4919-979b-dd9b474292b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:45.755361 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fbd01-4b2a-4919-979b-dd9b474292b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:45.757892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fbd01-4b2a-4919-979b-dd9b474292b1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:45.772387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1356/2747] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:45.777136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb94dc-4625-4cb0-a34a-693a87b66457 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:45.797012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb94dc-4625-4cb0-a34a-693a87b66457 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:45.803281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac81d4-741d-4d3b-83d3-622ed882b8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:45.803982 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac81d4-741d-4d3b-83d3-622ed882b8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:45.804261 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac81d4-741d-4d3b-83d3-622ed882b8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:45.804689 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac81d4-741d-4d3b-83d3-622ed882b8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:45.805334 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac81d4-741d-4d3b-83d3-622ed882b8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:45.806959 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac81d4-741d-4d3b-83d3-622ed882b8d6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:45.819427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1392/2748] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:53:45.825499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fbd01-4b2a-4919-979b-dd9b474292b1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:45.837241 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fbd01-4b2a-4919-979b-dd9b474292b1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:45.842551 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997a6ef-1c2e-464a-a68d-2cf17c38abf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:45.843239 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997a6ef-1c2e-464a-a68d-2cf17c38abf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:45.843515 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997a6ef-1c2e-464a-a68d-2cf17c38abf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:45.843823 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997a6ef-1c2e-464a-a68d-2cf17c38abf1 admin admin] PATH_INFO: `/v3/projects/3158bde4be01424d8b204d631ba88769/users/0697ee08b3a341c3a17eae0c7cfcc760/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:45.864472 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997a6ef-1c2e-464a-a68d-2cf17c38abf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3158bde4be01424d8b204d631ba88769, user_id=0697ee08b3a341c3a17eae0c7cfcc760, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:45.867412 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997a6ef-1c2e-464a-a68d-2cf17c38abf1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:45.918839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab76d4c-f011-4611-a2fa-bb3793e2a890 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:45.919125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab76d4c-f011-4611-a2fa-bb3793e2a890 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:45.919417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab76d4c-f011-4611-a2fa-bb3793e2a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:45.942464 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8ab76d4c-f011-4611-a2fa-bb3793e2a890 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:45.943935 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8ab76d4c-f011-4611-a2fa-bb3793e2a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:45.960369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1357/2749] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:53:45 2022] PUT /identity/v3/projects/3158bde4be01424d8b204d631ba88769/users/0697ee08b3a341c3a17eae0c7cfcc760/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:45.971824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38f26-49a7-46fa-b892-40774209c6d5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:45.972094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38f26-49a7-46fa-b892-40774209c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:45.972365 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38f26-49a7-46fa-b892-40774209c6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:46.014567 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-32a38f26-49a7-46fa-b892-40774209c6d5 None None] MFA Rules not processed for user `0697ee08b3a341c3a17eae0c7cfcc760`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:46.015858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-32a38f26-49a7-46fa-b892-40774209c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:46.021190 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1393/2750] 10.222.0.91 () {58 vars in 1009 bytes} [Wed Aug 24 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:46.039620 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab76d4c-f011-4611-a2fa-bb3793e2a890 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:46.041633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8ab76d4c-f011-4611-a2fa-bb3793e2a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:46.128074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1358/2751] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:53:46.133584 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab76d4c-f011-4611-a2fa-bb3793e2a890 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:46.139638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:46.140954 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a38f26-49a7-46fa-b892-40774209c6d5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:46.143599 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-32a38f26-49a7-46fa-b892-40774209c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:46.169033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:46.218123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25874325-2806-467c-a220-d7e91591fab2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:46.218717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25874325-2806-467c-a220-d7e91591fab2 service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:46.218961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25874325-2806-467c-a220-d7e91591fab2 service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:46.219257 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25874325-2806-467c-a220-d7e91591fab2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:46.231892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a38f26-49a7-46fa-b892-40774209c6d5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:46.236652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c236a2-3751-4ac5-9f70-0d6af71a96d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:46.237413 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c236a2-3751-4ac5-9f70-0d6af71a96d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:46.237725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c236a2-3751-4ac5-9f70-0d6af71a96d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:46.238106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c236a2-3751-4ac5-9f70-0d6af71a96d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:46.252326 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c236a2-3751-4ac5-9f70-0d6af71a96d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:46.255104 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c236a2-3751-4ac5-9f70-0d6af71a96d1 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:46.265647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1359/2752] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:53:46.299361 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25874325-2806-467c-a220-d7e91591fab2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:46.301582 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25874325-2806-467c-a220-d7e91591fab2 service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:46.313508 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1394/2753] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:53:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 10:53:51.536753 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c236a2-3751-4ac5-9f70-0d6af71a96d1 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:51.680587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c236a2-3751-4ac5-9f70-0d6af71a96d1 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:51.696132 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:51.697090 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:51.697514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:51.697981 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] PATH_INFO: `/v3/users/0697ee08b3a341c3a17eae0c7cfcc760` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:51.710388 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0697ee08b3a341c3a17eae0c7cfcc760)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:51.714809 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:52.103273 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0697ee08b3a341c3a17eae0c7cfcc760'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:52.104039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0697ee08b3a341c3a17eae0c7cfcc760'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:52.125758 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0697ee08b3a341c3a17eae0c7cfcc760'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:52.151418 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0697ee08b3a341c3a17eae0c7cfcc760'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:52.152611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0697ee08b3a341c3a17eae0c7cfcc760'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:52.237850 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1360/2754] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:53:51 2022] DELETE /identity/v3/users/0697ee08b3a341c3a17eae0c7cfcc760 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:53:52.249127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81278b0-4659-45ef-87a9-5ee83bb942ee None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:52.250094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81278b0-4659-45ef-87a9-5ee83bb942ee None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:52.250094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81278b0-4659-45ef-87a9-5ee83bb942ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:52.278961 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e81278b0-4659-45ef-87a9-5ee83bb942ee None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:52.283537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e81278b0-4659-45ef-87a9-5ee83bb942ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:52.441080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1395/2755] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:52.454705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:52.461451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:52.542270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:52.602586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c0865-38ea-465a-9dde-883f5b57b40c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:52.629378 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcfb17-96e5-484b-ba1c-1f742209629b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:52.630256 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcfb17-96e5-484b-ba1c-1f742209629b service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:52.630543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcfb17-96e5-484b-ba1c-1f742209629b service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:52.631014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcfb17-96e5-484b-ba1c-1f742209629b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:52.644989 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcfb17-96e5-484b-ba1c-1f742209629b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:52.646456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcfb17-96e5-484b-ba1c-1f742209629b service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:52.686781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1361/2756] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:53.379269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81278b0-4659-45ef-87a9-5ee83bb942ee None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:53.381167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e81278b0-4659-45ef-87a9-5ee83bb942ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:53.408127 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81278b0-4659-45ef-87a9-5ee83bb942ee None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:53.416294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ec3e4-15cf-4b05-baa8-b02c4d9def92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:53.417143 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec3e4-15cf-4b05-baa8-b02c4d9def92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:53.417492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec3e4-15cf-4b05-baa8-b02c4d9def92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:53.417933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec3e4-15cf-4b05-baa8-b02c4d9def92 admin admin] PATH_INFO: `/v3/projects/3158bde4be01424d8b204d631ba88769` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:53.419142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ec3e4-15cf-4b05-baa8-b02c4d9def92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3158bde4be01424d8b204d631ba88769)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:53.421291 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ec3e4-15cf-4b05-baa8-b02c4d9def92 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:53.597125 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:53.605501 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-130ec3e4-15cf-4b05-baa8-b02c4d9def92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3158bde4be01424d8b204d631ba88769', 'request_id': 'req-130ec3e4-15cf-4b05-baa8-b02c4d9def92'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:53.619694 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-130ec3e4-15cf-4b05-baa8-b02c4d9def92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3158bde4be01424d8b204d631ba88769', 'request_id': 'req-130ec3e4-15cf-4b05-baa8-b02c4d9def92'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:53.741453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-130ec3e4-15cf-4b05-baa8-b02c4d9def92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3158bde4be01424d8b204d631ba88769', 'request_id': 'req-130ec3e4-15cf-4b05-baa8-b02c4d9def92'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:53.767590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-130ec3e4-15cf-4b05-baa8-b02c4d9def92 admin admin] The token cache is being invalidate because project 3158bde4be01424d8b204d631ba88769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:53:53.767590 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-130ec3e4-15cf-4b05-baa8-b02c4d9def92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:53.768801 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-130ec3e4-15cf-4b05-baa8-b02c4d9def92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:53:53.789909 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1396/2757] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:53:53 2022] DELETE /identity/v3/projects/3158bde4be01424d8b204d631ba88769 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:02.683014 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=12 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:03.917672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:08.448007 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcfb17-96e5-484b-ba1c-1f742209629b service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:08.449450 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d1bcfb17-96e5-484b-ba1c-1f742209629b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:08.462107 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcfb17-96e5-484b-ba1c-1f742209629b service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:08.527429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e0d7-e5ed-45dc-9b9b-7691b32c5dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:08.527429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e0d7-e5ed-45dc-9b9b-7691b32c5dff service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:08.527429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e0d7-e5ed-45dc-9b9b-7691b32c5dff service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:08.527429 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e0d7-e5ed-45dc-9b9b-7691b32c5dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:08.528106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6444e0d7-e5ed-45dc-9b9b-7691b32c5dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:08.608648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444e0d7-e5ed-45dc-9b9b-7691b32c5dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:08.610523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444e0d7-e5ed-45dc-9b9b-7691b32c5dff service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:08.621888 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1362/2758] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:18.616751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=50 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:25.297941 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f9e68-e983-45cf-be54-eddbdce31e1f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:25.301916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f9e68-e983-45cf-be54-eddbdce31e1f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:25.301916 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f9e68-e983-45cf-be54-eddbdce31e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:25.319630 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-002f9e68-e983-45cf-be54-eddbdce31e1f None None] MFA Rules not processed for user `bb2ab51f75f84727831566a44db3d9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:25.321016 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-002f9e68-e983-45cf-be54-eddbdce31e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:25.379984 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1397/2759] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:35.372285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=25 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:18.775242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e0d7-e5ed-45dc-9b9b-7691b32c5dff service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:18.777036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6444e0d7-e5ed-45dc-9b9b-7691b32c5dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:18.840800 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e0d7-e5ed-45dc-9b9b-7691b32c5dff service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:18.845355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cf1f6-5722-46fa-b200-3c7395efcab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:18.845962 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cf1f6-5722-46fa-b200-3c7395efcab0 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:18.846255 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cf1f6-5722-46fa-b200-3c7395efcab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:18.846526 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cf1f6-5722-46fa-b200-3c7395efcab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:18.848438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-976cf1f6-5722-46fa-b200-3c7395efcab0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:18.928076 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cf1f6-5722-46fa-b200-3c7395efcab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:18.929439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cf1f6-5722-46fa-b200-3c7395efcab0 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:18.942747 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1363/2760] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:22.151709 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f9e68-e983-45cf-be54-eddbdce31e1f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:22.153174 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-002f9e68-e983-45cf-be54-eddbdce31e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:22.166293 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f9e68-e983-45cf-be54-eddbdce31e1f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:22.169923 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c103-06e2-445b-b2f9-a9354ac71be6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:22.170523 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c103-06e2-445b-b2f9-a9354ac71be6 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:22.170798 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c103-06e2-445b-b2f9-a9354ac71be6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:22.171065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c103-06e2-445b-b2f9-a9354ac71be6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:22.174166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5bb3c103-06e2-445b-b2f9-a9354ac71be6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:22.189020 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c103-06e2-445b-b2f9-a9354ac71be6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:22.190673 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c103-06e2-445b-b2f9-a9354ac71be6 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:22.202962 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1398/2761] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:28.936083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=54 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:32.197494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:35.521923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe49479-66f9-4249-8c01-e6ec0d279a31 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:35.522357 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe49479-66f9-4249-8c01-e6ec0d279a31 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:35.522516 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe49479-66f9-4249-8c01-e6ec0d279a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:35.580661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4fe49479-66f9-4249-8c01-e6ec0d279a31 None None] MFA Rules not processed for user `1ed2c124184645adad2be9cd89c9e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:35.582409 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4fe49479-66f9-4249-8c01-e6ec0d279a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:35.661273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c103-06e2-445b-b2f9-a9354ac71be6 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:35.662852 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5bb3c103-06e2-445b-b2f9-a9354ac71be6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:35.664549 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1364/2762] 10.222.0.91 () {58 vars in 967 bytes} [Wed Aug 24 10:55:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:35.676516 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c103-06e2-445b-b2f9-a9354ac71be6 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:35.680088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79fef3-0e99-4350-94ac-4911fb8644a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:35.680665 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79fef3-0e99-4350-94ac-4911fb8644a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:35.680937 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79fef3-0e99-4350-94ac-4911fb8644a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:35.681248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79fef3-0e99-4350-94ac-4911fb8644a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:35.683091 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6a79fef3-0e99-4350-94ac-4911fb8644a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:35.709230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe49479-66f9-4249-8c01-e6ec0d279a31 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:35.710626 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4fe49479-66f9-4249-8c01-e6ec0d279a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:35.760476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79fef3-0e99-4350-94ac-4911fb8644a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:35.762320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79fef3-0e99-4350-94ac-4911fb8644a3 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:35.778860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1399/2763] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:55:35.817010 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe49479-66f9-4249-8c01-e6ec0d279a31 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:35.822094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dd607-b6b1-4908-a73a-23657e7bd2a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4671efa1526643cdb32f56d44903db1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:35.822929 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dd607-b6b1-4908-a73a-23657e7bd2a7 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:35.823204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dd607-b6b1-4908-a73a-23657e7bd2a7 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:35.823475 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dd607-b6b1-4908-a73a-23657e7bd2a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:35.832913 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dd607-b6b1-4908-a73a-23657e7bd2a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:35.834489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dd607-b6b1-4908-a73a-23657e7bd2a7 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:35.842829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1365/2764] 10.222.0.91 () {60 vars in 1384 bytes} [Wed Aug 24 10:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 10:55:40.202943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79fef3-0e99-4350-94ac-4911fb8644a3 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:40.206243 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6a79fef3-0e99-4350-94ac-4911fb8644a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:40.226133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79fef3-0e99-4350-94ac-4911fb8644a3 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:40.249808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b857be-24e1-4055-9427-c5c831b0ff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:40.251123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b857be-24e1-4055-9427-c5c831b0ff78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:40.251781 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b857be-24e1-4055-9427-c5c831b0ff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:40.252568 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b857be-24e1-4055-9427-c5c831b0ff78 admin admin] PATH_INFO: `/v3/users/bb2ab51f75f84727831566a44db3d9d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:40.256342 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b857be-24e1-4055-9427-c5c831b0ff78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2ab51f75f84727831566a44db3d9d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:40.260428 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b857be-24e1-4055-9427-c5c831b0ff78 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:40.527172 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-13b857be-24e1-4055-9427-c5c831b0ff78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2ab51f75f84727831566a44db3d9d0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:40.565947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-13b857be-24e1-4055-9427-c5c831b0ff78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2ab51f75f84727831566a44db3d9d0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:40.660017 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-13b857be-24e1-4055-9427-c5c831b0ff78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2ab51f75f84727831566a44db3d9d0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:40.661028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-13b857be-24e1-4055-9427-c5c831b0ff78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2ab51f75f84727831566a44db3d9d0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:40.661808 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-13b857be-24e1-4055-9427-c5c831b0ff78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2ab51f75f84727831566a44db3d9d0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:40.676448 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1400/2765] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:40 2022] DELETE /identity/v3/users/bb2ab51f75f84727831566a44db3d9d0 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:41.061296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dd607-b6b1-4908-a73a-23657e7bd2a7 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:41.084509 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dd607-b6b1-4908-a73a-23657e7bd2a7 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:41.164559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:41.192350 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8651f-ecce-4f6d-9897-555dc9b20e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:41.193251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8651f-ecce-4f6d-9897-555dc9b20e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:41.193693 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8651f-ecce-4f6d-9897-555dc9b20e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:41.194078 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8651f-ecce-4f6d-9897-555dc9b20e93 admin admin] PATH_INFO: `/v3/projects/e658bf6421dc42b0bdc7e0352ac0f9e6` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:41.196102 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8651f-ecce-4f6d-9897-555dc9b20e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e658bf6421dc42b0bdc7e0352ac0f9e6)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:41.199501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8651f-ecce-4f6d-9897-555dc9b20e93 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:41.368635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-75e8651f-ecce-4f6d-9897-555dc9b20e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e658bf6421dc42b0bdc7e0352ac0f9e6', 'request_id': 'req-75e8651f-ecce-4f6d-9897-555dc9b20e93'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:41.378818 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-75e8651f-ecce-4f6d-9897-555dc9b20e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e658bf6421dc42b0bdc7e0352ac0f9e6', 'request_id': 'req-75e8651f-ecce-4f6d-9897-555dc9b20e93'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:41.448435 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-75e8651f-ecce-4f6d-9897-555dc9b20e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e658bf6421dc42b0bdc7e0352ac0f9e6', 'request_id': 'req-75e8651f-ecce-4f6d-9897-555dc9b20e93'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:41.472222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-75e8651f-ecce-4f6d-9897-555dc9b20e93 admin admin] The token cache is being invalidate because project e658bf6421dc42b0bdc7e0352ac0f9e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:41.472222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-75e8651f-ecce-4f6d-9897-555dc9b20e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:41.472222 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-75e8651f-ecce-4f6d-9897-555dc9b20e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:41.479776 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1366/2766] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:41 2022] DELETE /identity/v3/projects/e658bf6421dc42b0bdc7e0352ac0f9e6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:41.482388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94705210-0a7a-414c-916d-7c8c53838471 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:41.483287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94705210-0a7a-414c-916d-7c8c53838471 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:41.483287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94705210-0a7a-414c-916d-7c8c53838471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:41.517407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-94705210-0a7a-414c-916d-7c8c53838471 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:41.518717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-94705210-0a7a-414c-916d-7c8c53838471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:41.597436 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1401/2767] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:41.606692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba09391-65ed-4f55-a37e-f6ede94a17ea None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:41.607178 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba09391-65ed-4f55-a37e-f6ede94a17ea None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:41.607486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba09391-65ed-4f55-a37e-f6ede94a17ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:41.638688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1ba09391-65ed-4f55-a37e-f6ede94a17ea None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:41.640682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1ba09391-65ed-4f55-a37e-f6ede94a17ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:41.653219 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1367/2768] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:41.658370 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94705210-0a7a-414c-916d-7c8c53838471 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:41.668600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94705210-0a7a-414c-916d-7c8c53838471 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:41.674157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb08581-ed7f-4c14-a1b8-e05f4a602a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:41.674761 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb08581-ed7f-4c14-a1b8-e05f4a602a05 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:41.675107 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb08581-ed7f-4c14-a1b8-e05f4a602a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:41.675439 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb08581-ed7f-4c14-a1b8-e05f4a602a05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:41.676199 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb08581-ed7f-4c14-a1b8-e05f4a602a05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:55:41.676628 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb08581-ed7f-4c14-a1b8-e05f4a602a05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:41.678492 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb08581-ed7f-4c14-a1b8-e05f4a602a05 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:41.680530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:41.698849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1402/2769] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:55:41.700456 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba09391-65ed-4f55-a37e-f6ede94a17ea None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:41.711619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba09391-65ed-4f55-a37e-f6ede94a17ea None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:41.716680 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a46f1-b5fd-4858-9caf-b5d40c9e0a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:41.717316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a46f1-b5fd-4858-9caf-b5d40c9e0a57 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:41.717590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a46f1-b5fd-4858-9caf-b5d40c9e0a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:41.717932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a46f1-b5fd-4858-9caf-b5d40c9e0a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:41.719337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a46f1-b5fd-4858-9caf-b5d40c9e0a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:41.721374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a46f1-b5fd-4858-9caf-b5d40c9e0a57 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:41.853636 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1368/2770] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:55:41 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:41.860821 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb08581-ed7f-4c14-a1b8-e05f4a602a05 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:41.877465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb08581-ed7f-4c14-a1b8-e05f4a602a05 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:41.961585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fb595-8ad2-473c-aed0-8acc774e85d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:41.962746 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fb595-8ad2-473c-aed0-8acc774e85d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:41.963235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fb595-8ad2-473c-aed0-8acc774e85d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:41.963740 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fb595-8ad2-473c-aed0-8acc774e85d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:41.970310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fb595-8ad2-473c-aed0-8acc774e85d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:41.970310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fb595-8ad2-473c-aed0-8acc774e85d5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:42.061064 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1403/2771] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:55:41 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:42.073495 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a46f1-b5fd-4858-9caf-b5d40c9e0a57 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:42.086644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a46f1-b5fd-4858-9caf-b5d40c9e0a57 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:42.091311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95fd9e-c5e8-4f10-a9cb-2b0ee08830a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:42.092031 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95fd9e-c5e8-4f10-a9cb-2b0ee08830a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:42.092274 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95fd9e-c5e8-4f10-a9cb-2b0ee08830a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:42.092545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95fd9e-c5e8-4f10-a9cb-2b0ee08830a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:42.093377 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95fd9e-c5e8-4f10-a9cb-2b0ee08830a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:42.095131 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95fd9e-c5e8-4f10-a9cb-2b0ee08830a1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:42.107380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1369/2772] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:55:42.111878 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fb595-8ad2-473c-aed0-8acc774e85d5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:42.122387 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fb595-8ad2-473c-aed0-8acc774e85d5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:42.128339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dccfe-d29f-418b-ae32-e21930768799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:42.129245 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dccfe-d29f-418b-ae32-e21930768799 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:42.129531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dccfe-d29f-418b-ae32-e21930768799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:42.129806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dccfe-d29f-418b-ae32-e21930768799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:42.130458 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dccfe-d29f-418b-ae32-e21930768799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:42.132161 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dccfe-d29f-418b-ae32-e21930768799 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:42.144235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1404/2773] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:55:42.148824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95fd9e-c5e8-4f10-a9cb-2b0ee08830a1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:42.159639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95fd9e-c5e8-4f10-a9cb-2b0ee08830a1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:42.166235 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc46f4-72b5-4a16-b469-fcae37b04341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:42.166979 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc46f4-72b5-4a16-b469-fcae37b04341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:42.167329 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc46f4-72b5-4a16-b469-fcae37b04341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:42.167665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc46f4-72b5-4a16-b469-fcae37b04341 admin admin] PATH_INFO: `/v3/projects/53c3518abe894f499245c0d261271f13/users/ab916c7bba144dedad03f71c87d18295/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:42.184269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc46f4-72b5-4a16-b469-fcae37b04341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c3518abe894f499245c0d261271f13, user_id=ab916c7bba144dedad03f71c87d18295, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:42.189193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc46f4-72b5-4a16-b469-fcae37b04341 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:42.286772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1370/2774] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:55:42 2022] PUT /identity/v3/projects/53c3518abe894f499245c0d261271f13/users/ab916c7bba144dedad03f71c87d18295/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:55:42.298681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ba134-2790-4ac2-ba82-30bc3ed9411f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:42.299032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ba134-2790-4ac2-ba82-30bc3ed9411f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:42.299365 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ba134-2790-4ac2-ba82-30bc3ed9411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:42.342066 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2b5ba134-2790-4ac2-ba82-30bc3ed9411f None None] MFA Rules not processed for user `ab916c7bba144dedad03f71c87d18295`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:42.344583 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2b5ba134-2790-4ac2-ba82-30bc3ed9411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:42.440289 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1405/2775] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:55:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:42.442486 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc46f4-72b5-4a16-b469-fcae37b04341 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:42.536300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc46f4-72b5-4a16-b469-fcae37b04341 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:42.541118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0d1a1-3e8c-4a42-80db-d2f25fa611b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:42.541514 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0d1a1-3e8c-4a42-80db-d2f25fa611b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:42.541791 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0d1a1-3e8c-4a42-80db-d2f25fa611b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:42.542057 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0d1a1-3e8c-4a42-80db-d2f25fa611b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:42.542678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0d1a1-3e8c-4a42-80db-d2f25fa611b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:42.544639 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0d1a1-3e8c-4a42-80db-d2f25fa611b5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:42.550774 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:42.653206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1371/2776] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:55:42 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:42.657309 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ba134-2790-4ac2-ba82-30bc3ed9411f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:42.668596 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ba134-2790-4ac2-ba82-30bc3ed9411f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:42.730756 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3acdcd-bb71-4655-93ac-fff057e41b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:42.731410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3acdcd-bb71-4655-93ac-fff057e41b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:42.731688 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3acdcd-bb71-4655-93ac-fff057e41b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:42.731998 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3acdcd-bb71-4655-93ac-fff057e41b78 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:42.732642 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3acdcd-bb71-4655-93ac-fff057e41b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:42.735302 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3acdcd-bb71-4655-93ac-fff057e41b78 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:42.745086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:42.832142 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1406/2777] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:55:42 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:55:42.836479 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0d1a1-3e8c-4a42-80db-d2f25fa611b5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:42.849508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0d1a1-3e8c-4a42-80db-d2f25fa611b5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:42.854044 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52501418-a765-4105-a01e-af7bd6b4c563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:42.854665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501418-a765-4105-a01e-af7bd6b4c563 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:42.854948 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501418-a765-4105-a01e-af7bd6b4c563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:42.855224 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501418-a765-4105-a01e-af7bd6b4c563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:42.856798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52501418-a765-4105-a01e-af7bd6b4c563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:42.858476 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52501418-a765-4105-a01e-af7bd6b4c563 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:42.876328 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1372/2778] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:55:42.880638 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3acdcd-bb71-4655-93ac-fff057e41b78 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:42.897823 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3acdcd-bb71-4655-93ac-fff057e41b78 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:42.907133 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea81b4-82a5-407b-b5b2-6845d53e448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:42.907735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea81b4-82a5-407b-b5b2-6845d53e448b admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:42.908031 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea81b4-82a5-407b-b5b2-6845d53e448b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:42.908310 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea81b4-82a5-407b-b5b2-6845d53e448b admin admin] PATH_INFO: `/v3/projects/56c0b0b188df430391a3b4dfce76fe75/users/ff2c244a1a0d47039a9bc27810b337c6/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:42.929736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea81b4-82a5-407b-b5b2-6845d53e448b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c0b0b188df430391a3b4dfce76fe75, user_id=ff2c244a1a0d47039a9bc27810b337c6, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:42.933000 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea81b4-82a5-407b-b5b2-6845d53e448b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:43.024907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1407/2779] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:55:42 2022] PUT /identity/v3/projects/56c0b0b188df430391a3b4dfce76fe75/users/ff2c244a1a0d47039a9bc27810b337c6/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:43.030263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52501418-a765-4105-a01e-af7bd6b4c563 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:43.049614 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52501418-a765-4105-a01e-af7bd6b4c563 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:43.150363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30bda3-654f-4219-9df3-99d400bd08e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:43.150363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30bda3-654f-4219-9df3-99d400bd08e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:43.150363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30bda3-654f-4219-9df3-99d400bd08e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:43.150363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30bda3-654f-4219-9df3-99d400bd08e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:43.151237 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30bda3-654f-4219-9df3-99d400bd08e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:43.151706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30bda3-654f-4219-9df3-99d400bd08e2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:43.167504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1373/2780] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:55:43.176639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea81b4-82a5-407b-b5b2-6845d53e448b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:43.190140 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea81b4-82a5-407b-b5b2-6845d53e448b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:43.199199 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632edc-6d2c-4ce2-b3a8-caeea37ce5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:43.200308 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632edc-6d2c-4ce2-b3a8-caeea37ce5db admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:43.201073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632edc-6d2c-4ce2-b3a8-caeea37ce5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:43.201288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632edc-6d2c-4ce2-b3a8-caeea37ce5db admin admin] PATH_INFO: `/v3/projects/56c0b0b188df430391a3b4dfce76fe75/users/ff2c244a1a0d47039a9bc27810b337c6/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:43.204316 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632edc-6d2c-4ce2-b3a8-caeea37ce5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c0b0b188df430391a3b4dfce76fe75, user_id=ff2c244a1a0d47039a9bc27810b337c6, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:43.208175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632edc-6d2c-4ce2-b3a8-caeea37ce5db admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:43.220639 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1408/2781] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:55:43 2022] PUT /identity/v3/projects/56c0b0b188df430391a3b4dfce76fe75/users/ff2c244a1a0d47039a9bc27810b337c6/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:55:43.240226 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db36c-186f-430e-b7b9-d131b054e3b7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:43.240837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db36c-186f-430e-b7b9-d131b054e3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:43.240837 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db36c-186f-430e-b7b9-d131b054e3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:43.280346 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-df0db36c-186f-430e-b7b9-d131b054e3b7 None None] MFA Rules not processed for user `ff2c244a1a0d47039a9bc27810b337c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:43.282736 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-df0db36c-186f-430e-b7b9-d131b054e3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:43.377843 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1374/2782] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:55:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:43.392121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632edc-6d2c-4ce2-b3a8-caeea37ce5db admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:43.394618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-31632edc-6d2c-4ce2-b3a8-caeea37ce5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:43.482657 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632edc-6d2c-4ce2-b3a8-caeea37ce5db admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:43.488213 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c815c9-1436-4b34-8714-041faab39e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:43.488778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c815c9-1436-4b34-8714-041faab39e97 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:43.489131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c815c9-1436-4b34-8714-041faab39e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:43.490116 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c815c9-1436-4b34-8714-041faab39e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:43.575905 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c815c9-1436-4b34-8714-041faab39e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:43.581996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c815c9-1436-4b34-8714-041faab39e97 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:43.594521 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1409/2783] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:45.915052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0db36c-186f-430e-b7b9-d131b054e3b7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:45.916519 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-df0db36c-186f-430e-b7b9-d131b054e3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:45.985570 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:45.996428 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0db36c-186f-430e-b7b9-d131b054e3b7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:45.996972 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:45.997846 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:45.998307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:45.998760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] PATH_INFO: `/v3/users/bc818edc509d423b99476981532f02a9` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:46.000886 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc818edc509d423b99476981532f02a9)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:46.004215 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:46.207052 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc818edc509d423b99476981532f02a9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.207734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc818edc509d423b99476981532f02a9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.225310 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc818edc509d423b99476981532f02a9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.232440 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc818edc509d423b99476981532f02a9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.233263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc818edc509d423b99476981532f02a9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.320772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1375/2784] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:45 2022] DELETE /identity/v3/users/bc818edc509d423b99476981532f02a9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:46.584942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c815c9-1436-4b34-8714-041faab39e97 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:46.600248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c815c9-1436-4b34-8714-041faab39e97 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:46.667340 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:46.667994 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:46.668274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:46.668548 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] PATH_INFO: `/v3/projects/4930556c77524d18bdcfbafb47732832` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:46.669722 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4930556c77524d18bdcfbafb47732832)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:46.672527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:46.683754 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:46.810126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4930556c77524d18bdcfbafb47732832', 'request_id': 'req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.816866 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4930556c77524d18bdcfbafb47732832', 'request_id': 'req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.887838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4930556c77524d18bdcfbafb47732832', 'request_id': 'req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.901453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] The token cache is being invalidate because project 4930556c77524d18bdcfbafb47732832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:46.902220 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.902397 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.903967 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1410/2785] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:46 2022] DELETE /identity/v3/projects/4930556c77524d18bdcfbafb47732832 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:46.908882 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:46.913339 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:46.925664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f47114-7c40-4036-898e-f007e6fae08c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:46.968444 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:46.970653 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:46.999126 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:47.000310 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:47.000585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:47.007204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] PATH_INFO: `/v3/users/c8522caa9bb74295b0b414c13a60e591` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:47.007204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8522caa9bb74295b0b414c13a60e591)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:47.007204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:47.044331 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee97146-5353-4ce5-a6a2-16e4bd60fc3c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:47.051518 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426daf6-5a06-4f4a-b64c-5e5debe4ff40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:47.052226 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426daf6-5a06-4f4a-b64c-5e5debe4ff40 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:47.052563 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426daf6-5a06-4f4a-b64c-5e5debe4ff40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:47.052838 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426daf6-5a06-4f4a-b64c-5e5debe4ff40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:47.055206 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4426daf6-5a06-4f4a-b64c-5e5debe4ff40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:47.136217 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426daf6-5a06-4f4a-b64c-5e5debe4ff40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:47.137985 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426daf6-5a06-4f4a-b64c-5e5debe4ff40 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:47.152330 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1411/2786] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:47.239894 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8522caa9bb74295b0b414c13a60e591'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:47.240606 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8522caa9bb74295b0b414c13a60e591'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:47.253682 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8522caa9bb74295b0b414c13a60e591'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:47.267008 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8522caa9bb74295b0b414c13a60e591'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:47.271445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8522caa9bb74295b0b414c13a60e591'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:47.274660 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:47.396975 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1376/2787] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:46 2022] DELETE /identity/v3/users/c8522caa9bb74295b0b414c13a60e591 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:55:47.711643 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426daf6-5a06-4f4a-b64c-5e5debe4ff40 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:47.713347 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4426daf6-5a06-4f4a-b64c-5e5debe4ff40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:47.730440 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426daf6-5a06-4f4a-b64c-5e5debe4ff40 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:47.782894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:47.796004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e22ff-773c-467a-a0d8-da2d8879b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:47.796977 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e22ff-773c-467a-a0d8-da2d8879b2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:47.797286 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e22ff-773c-467a-a0d8-da2d8879b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:47.797703 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e22ff-773c-467a-a0d8-da2d8879b2d3 admin admin] PATH_INFO: `/v3/projects/e1e11d671bcd4e32b43174ae5d67ecd7` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:47.799249 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e22ff-773c-467a-a0d8-da2d8879b2d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e11d671bcd4e32b43174ae5d67ecd7)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:47.801073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e22ff-773c-467a-a0d8-da2d8879b2d3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:47.928950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-565e22ff-773c-467a-a0d8-da2d8879b2d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e11d671bcd4e32b43174ae5d67ecd7', 'request_id': 'req-565e22ff-773c-467a-a0d8-da2d8879b2d3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:47.940485 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-565e22ff-773c-467a-a0d8-da2d8879b2d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e11d671bcd4e32b43174ae5d67ecd7', 'request_id': 'req-565e22ff-773c-467a-a0d8-da2d8879b2d3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:48.024933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-565e22ff-773c-467a-a0d8-da2d8879b2d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e11d671bcd4e32b43174ae5d67ecd7', 'request_id': 'req-565e22ff-773c-467a-a0d8-da2d8879b2d3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:48.037134 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-565e22ff-773c-467a-a0d8-da2d8879b2d3 admin admin] The token cache is being invalidate because project e1e11d671bcd4e32b43174ae5d67ecd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:48.037453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-565e22ff-773c-467a-a0d8-da2d8879b2d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:48.038177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-565e22ff-773c-467a-a0d8-da2d8879b2d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:48.039784 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1412/2788] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:47 2022] DELETE /identity/v3/projects/e1e11d671bcd4e32b43174ae5d67ecd7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:57.561994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:58.128568 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:02.340744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:02.342643 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:02.355569 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe579da-aaa5-466f-9dfd-f825c4d41c01 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:02.413444 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:02.414073 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:02.414356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:02.414637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] PATH_INFO: `/v3/users/ab916c7bba144dedad03f71c87d18295` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:02.415788 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab916c7bba144dedad03f71c87d18295)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:02.417731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:02.602501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab916c7bba144dedad03f71c87d18295'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:02.603127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab916c7bba144dedad03f71c87d18295'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:02.617005 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab916c7bba144dedad03f71c87d18295'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:02.624858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab916c7bba144dedad03f71c87d18295'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:02.625715 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab916c7bba144dedad03f71c87d18295'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:02.733785 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1377/2789] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:56:02 2022] DELETE /identity/v3/users/ab916c7bba144dedad03f71c87d18295 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:02.738706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1fb7c-4ff0-49aa-b100-e2873f9f46eb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:02.739168 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1fb7c-4ff0-49aa-b100-e2873f9f46eb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:02.739269 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1fb7c-4ff0-49aa-b100-e2873f9f46eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:02.760049 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-62e1fb7c-4ff0-49aa-b100-e2873f9f46eb None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:02.761265 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-62e1fb7c-4ff0-49aa-b100-e2873f9f46eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:02.821228 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1413/2790] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:02.831274 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:02.832806 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:02.896632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98cf8d-8007-498f-ae3e-cf5ab857e6c9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:02.900424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967c7a8-14c4-4ecb-a0eb-3ac68039083c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:02.901018 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967c7a8-14c4-4ecb-a0eb-3ac68039083c service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:02.901292 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967c7a8-14c4-4ecb-a0eb-3ac68039083c service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:02.901556 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967c7a8-14c4-4ecb-a0eb-3ac68039083c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:02.911100 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967c7a8-14c4-4ecb-a0eb-3ac68039083c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:02.912695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967c7a8-14c4-4ecb-a0eb-3ac68039083c service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:02.923002 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1378/2791] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:03.335527 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1fb7c-4ff0-49aa-b100-e2873f9f46eb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:03.337015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-62e1fb7c-4ff0-49aa-b100-e2873f9f46eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:03.350513 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1fb7c-4ff0-49aa-b100-e2873f9f46eb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:03.356348 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:03.356995 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:03.357287 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:03.357519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] PATH_INFO: `/v3/projects/53c3518abe894f499245c0d261271f13` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:03.359086 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c3518abe894f499245c0d261271f13)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:03.361451 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:03.516476 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c3518abe894f499245c0d261271f13', 'request_id': 'req-984b10f0-46fb-4486-85ec-ae70307aa118'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:03.522881 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c3518abe894f499245c0d261271f13', 'request_id': 'req-984b10f0-46fb-4486-85ec-ae70307aa118'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:03.585167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c3518abe894f499245c0d261271f13', 'request_id': 'req-984b10f0-46fb-4486-85ec-ae70307aa118'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:03.596626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] The token cache is being invalidate because project 53c3518abe894f499245c0d261271f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:56:03.596910 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:03.597552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:03.599522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1414/2792] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:56:03 2022] DELETE /identity/v3/projects/53c3518abe894f499245c0d261271f13 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:03.603174 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967c7a8-14c4-4ecb-a0eb-3ac68039083c service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:03.614044 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967c7a8-14c4-4ecb-a0eb-3ac68039083c service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:03.633139 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:03.673244 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80c5f9-6876-4047-8e52-998b4a690de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:03.673872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80c5f9-6876-4047-8e52-998b4a690de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:03.674220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80c5f9-6876-4047-8e52-998b4a690de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:03.674497 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80c5f9-6876-4047-8e52-998b4a690de3 admin admin] PATH_INFO: `/v3/users/ff2c244a1a0d47039a9bc27810b337c6` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:03.675649 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80c5f9-6876-4047-8e52-998b4a690de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2c244a1a0d47039a9bc27810b337c6)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:03.677610 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80c5f9-6876-4047-8e52-998b4a690de3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:03.855855 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b80c5f9-6876-4047-8e52-998b4a690de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2c244a1a0d47039a9bc27810b337c6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:03.856448 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b80c5f9-6876-4047-8e52-998b4a690de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2c244a1a0d47039a9bc27810b337c6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:03.869961 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b80c5f9-6876-4047-8e52-998b4a690de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2c244a1a0d47039a9bc27810b337c6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:03.877600 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b80c5f9-6876-4047-8e52-998b4a690de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2c244a1a0d47039a9bc27810b337c6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:03.878508 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b80c5f9-6876-4047-8e52-998b4a690de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2c244a1a0d47039a9bc27810b337c6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:03.950542 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1379/2793] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:56:03 2022] DELETE /identity/v3/users/ff2c244a1a0d47039a9bc27810b337c6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:04.421219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:04.421219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:04.431347 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b10f0-46fb-4486-85ec-ae70307aa118 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:04.494567 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:04.495197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:04.495540 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:04.495869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3 admin admin] PATH_INFO: `/v3/projects/56c0b0b188df430391a3b4dfce76fe75` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:04.497012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c0b0b188df430391a3b4dfce76fe75)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:04.499135 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:04.624336 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:04.641012 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c0b0b188df430391a3b4dfce76fe75', 'request_id': 'req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:04.647391 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c0b0b188df430391a3b4dfce76fe75', 'request_id': 'req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:04.778936 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c0b0b188df430391a3b4dfce76fe75', 'request_id': 'req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:04.790796 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3 admin admin] The token cache is being invalidate because project 56c0b0b188df430391a3b4dfce76fe75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:56:04.794294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:04.794294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bbc5314d-2b9a-414b-87b7-49c02f2cc7e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:04.794294 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1415/2794] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:56:04 2022] DELETE /identity/v3/projects/56c0b0b188df430391a3b4dfce76fe75 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:56:04.799029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49134-0df4-4381-a7ee-89c311ab0270 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:04.799513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49134-0df4-4381-a7ee-89c311ab0270 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:04.799637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49134-0df4-4381-a7ee-89c311ab0270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:04.819535 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f6a49134-0df4-4381-a7ee-89c311ab0270 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:04.820786 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f6a49134-0df4-4381-a7ee-89c311ab0270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:04.881619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1380/2795] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:04.890678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7027b32-afa3-4492-a385-862ac39e1186 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:04.890956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7027b32-afa3-4492-a385-862ac39e1186 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:04.891227 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7027b32-afa3-4492-a385-862ac39e1186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:04.912068 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d7027b32-afa3-4492-a385-862ac39e1186 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:04.913292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d7027b32-afa3-4492-a385-862ac39e1186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:04.922985 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1416/2796] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:04.927228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49134-0df4-4381-a7ee-89c311ab0270 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:04.937814 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49134-0df4-4381-a7ee-89c311ab0270 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:04.942718 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59d1e7-8433-4bd6-a380-5e1e2625105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:04.943320 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59d1e7-8433-4bd6-a380-5e1e2625105c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:04.943597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59d1e7-8433-4bd6-a380-5e1e2625105c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:04.943906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59d1e7-8433-4bd6-a380-5e1e2625105c admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:04.944879 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59d1e7-8433-4bd6-a380-5e1e2625105c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:56:04.945303 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59d1e7-8433-4bd6-a380-5e1e2625105c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:04.947044 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59d1e7-8433-4bd6-a380-5e1e2625105c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:04.960355 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1381/2797] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:56:04.964739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7027b32-afa3-4492-a385-862ac39e1186 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:04.975248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7027b32-afa3-4492-a385-862ac39e1186 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:04.979938 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaf38b-9d41-41b5-b328-8d194f1fc0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:04.980536 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaf38b-9d41-41b5-b328-8d194f1fc0fc admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:04.980810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaf38b-9d41-41b5-b328-8d194f1fc0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:04.981077 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaf38b-9d41-41b5-b328-8d194f1fc0fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:04.981697 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaf38b-9d41-41b5-b328-8d194f1fc0fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:04.984175 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaf38b-9d41-41b5-b328-8d194f1fc0fc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:05.117149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1417/2798] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:56:04 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:05.121518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59d1e7-8433-4bd6-a380-5e1e2625105c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:05.132719 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59d1e7-8433-4bd6-a380-5e1e2625105c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:05.159369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:05.191535 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730b1ee-5b3a-4c86-95f1-11d61099cb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:05.192164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730b1ee-5b3a-4c86-95f1-11d61099cb9e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:05.192438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730b1ee-5b3a-4c86-95f1-11d61099cb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:05.192705 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730b1ee-5b3a-4c86-95f1-11d61099cb9e admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:05.193327 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730b1ee-5b3a-4c86-95f1-11d61099cb9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:05.195242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730b1ee-5b3a-4c86-95f1-11d61099cb9e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:05.385790 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1382/2799] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:56:05 2022] POST /identity/v3/users => generated 294 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:05.390047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaf38b-9d41-41b5-b328-8d194f1fc0fc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:05.400607 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaf38b-9d41-41b5-b328-8d194f1fc0fc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:05.405919 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4a357-2f79-47ab-a826-9b5b61005c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:05.406519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4a357-2f79-47ab-a826-9b5b61005c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:05.406799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4a357-2f79-47ab-a826-9b5b61005c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:05.407069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4a357-2f79-47ab-a826-9b5b61005c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:05.407708 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4a357-2f79-47ab-a826-9b5b61005c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:05.409363 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4a357-2f79-47ab-a826-9b5b61005c24 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:05.419673 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1418/2800] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:05.424658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730b1ee-5b3a-4c86-95f1-11d61099cb9e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:05.434987 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730b1ee-5b3a-4c86-95f1-11d61099cb9e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:05.439826 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc6e6a-022a-4fae-b0bb-67cc5a251e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:05.440453 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc6e6a-022a-4fae-b0bb-67cc5a251e8f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:05.440738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc6e6a-022a-4fae-b0bb-67cc5a251e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:05.441012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc6e6a-022a-4fae-b0bb-67cc5a251e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:05.441681 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc6e6a-022a-4fae-b0bb-67cc5a251e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:05.443386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc6e6a-022a-4fae-b0bb-67cc5a251e8f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:05.453910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1383/2801] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:05.458090 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4a357-2f79-47ab-a826-9b5b61005c24 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:05.469239 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4a357-2f79-47ab-a826-9b5b61005c24 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:05.474054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef16aa0-e9c2-4bce-b7e6-14ac516240c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:05.474719 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef16aa0-e9c2-4bce-b7e6-14ac516240c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:05.474997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef16aa0-e9c2-4bce-b7e6-14ac516240c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:05.475268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef16aa0-e9c2-4bce-b7e6-14ac516240c9 admin admin] PATH_INFO: `/v3/projects/e94bdccce8084b79b167df1795e8b767/users/ed9a588161e543888c13c9f466115fc8/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:05.491888 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef16aa0-e9c2-4bce-b7e6-14ac516240c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94bdccce8084b79b167df1795e8b767, user_id=ed9a588161e543888c13c9f466115fc8, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:05.494545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef16aa0-e9c2-4bce-b7e6-14ac516240c9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:05.631672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1419/2802] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:05 2022] PUT /identity/v3/projects/e94bdccce8084b79b167df1795e8b767/users/ed9a588161e543888c13c9f466115fc8/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:05.644066 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c73ca-2a4b-40fe-9513-29ca7acc9b73 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:05.644273 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c73ca-2a4b-40fe-9513-29ca7acc9b73 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:05.644546 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c73ca-2a4b-40fe-9513-29ca7acc9b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:05.674916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-704c73ca-2a4b-40fe-9513-29ca7acc9b73 None None] MFA Rules not processed for user `ed9a588161e543888c13c9f466115fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:05.676150 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-704c73ca-2a4b-40fe-9513-29ca7acc9b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:05.743982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1384/2803] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:05.748874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef16aa0-e9c2-4bce-b7e6-14ac516240c9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:05.811655 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef16aa0-e9c2-4bce-b7e6-14ac516240c9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:05.816289 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab60ca-52e2-4b56-8285-a020e6b2e500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:05.816933 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab60ca-52e2-4b56-8285-a020e6b2e500 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:05.817204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab60ca-52e2-4b56-8285-a020e6b2e500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:05.817470 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab60ca-52e2-4b56-8285-a020e6b2e500 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:05.818094 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab60ca-52e2-4b56-8285-a020e6b2e500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:05.820004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab60ca-52e2-4b56-8285-a020e6b2e500 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:05.929315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1420/2804] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:56:05 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:05.933400 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c73ca-2a4b-40fe-9513-29ca7acc9b73 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:05.945590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c73ca-2a4b-40fe-9513-29ca7acc9b73 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:06.003648 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f104d-87eb-4f63-a336-74c2fb473d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:06.004304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f104d-87eb-4f63-a336-74c2fb473d35 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:06.004586 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f104d-87eb-4f63-a336-74c2fb473d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:06.004864 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f104d-87eb-4f63-a336-74c2fb473d35 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:06.005506 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f104d-87eb-4f63-a336-74c2fb473d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:06.007439 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f104d-87eb-4f63-a336-74c2fb473d35 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:06.097302 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1385/2805] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:56:05 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:06.101498 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab60ca-52e2-4b56-8285-a020e6b2e500 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:06.113266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab60ca-52e2-4b56-8285-a020e6b2e500 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:06.117907 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68322d-1b0a-4e39-bfc9-f3e6bddd0f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:06.118538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68322d-1b0a-4e39-bfc9-f3e6bddd0f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:06.118813 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68322d-1b0a-4e39-bfc9-f3e6bddd0f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:06.119080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68322d-1b0a-4e39-bfc9-f3e6bddd0f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:06.119707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68322d-1b0a-4e39-bfc9-f3e6bddd0f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:06.121318 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68322d-1b0a-4e39-bfc9-f3e6bddd0f34 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:06.133718 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1421/2806] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:06.137907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f104d-87eb-4f63-a336-74c2fb473d35 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:06.148942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f104d-87eb-4f63-a336-74c2fb473d35 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:06.153566 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86218919-5817-4149-a7a2-2ab4ec91833d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:06.154166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86218919-5817-4149-a7a2-2ab4ec91833d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:06.154451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86218919-5817-4149-a7a2-2ab4ec91833d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:06.154824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86218919-5817-4149-a7a2-2ab4ec91833d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:06.155625 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86218919-5817-4149-a7a2-2ab4ec91833d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:06.157244 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86218919-5817-4149-a7a2-2ab4ec91833d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:06.167550 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1386/2807] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:06.172149 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68322d-1b0a-4e39-bfc9-f3e6bddd0f34 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:06.187013 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68322d-1b0a-4e39-bfc9-f3e6bddd0f34 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:06.188832 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b93a4c-bc44-4ede-bb16-03322486eb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:06.189487 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b93a4c-bc44-4ede-bb16-03322486eb9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:06.189769 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b93a4c-bc44-4ede-bb16-03322486eb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:06.190046 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b93a4c-bc44-4ede-bb16-03322486eb9a admin admin] PATH_INFO: `/v3/projects/1616ab14f5d944c690563251c8c1344d/users/443876db8d3f427e904b7296d8010e71/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:06.206115 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b93a4c-bc44-4ede-bb16-03322486eb9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1616ab14f5d944c690563251c8c1344d, user_id=443876db8d3f427e904b7296d8010e71, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:06.208847 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b93a4c-bc44-4ede-bb16-03322486eb9a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:06.299312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:06.304042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1422/2808] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:06 2022] PUT /identity/v3/projects/1616ab14f5d944c690563251c8c1344d/users/443876db8d3f427e904b7296d8010e71/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:56:06.315107 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacb80f-26fe-48a9-a373-1b241a09d65a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:06.315395 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacb80f-26fe-48a9-a373-1b241a09d65a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:06.315686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacb80f-26fe-48a9-a373-1b241a09d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:06.345672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-dcacb80f-26fe-48a9-a373-1b241a09d65a None None] MFA Rules not processed for user `443876db8d3f427e904b7296d8010e71`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:06.346901 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dcacb80f-26fe-48a9-a373-1b241a09d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:06.351196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:06.416653 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1387/2809] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:06.421987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b93a4c-bc44-4ede-bb16-03322486eb9a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:06.484890 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b93a4c-bc44-4ede-bb16-03322486eb9a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:06.489925 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3047e-56a8-4536-9365-9502c2fae17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:06.492597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3047e-56a8-4536-9365-9502c2fae17d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:06.492597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3047e-56a8-4536-9365-9502c2fae17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:06.492597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3047e-56a8-4536-9365-9502c2fae17d admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:06.492597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3047e-56a8-4536-9365-9502c2fae17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:06.493633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3047e-56a8-4536-9365-9502c2fae17d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:06.591686 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1423/2810] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:56:06 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:06.596092 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacb80f-26fe-48a9-a373-1b241a09d65a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:06.607091 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacb80f-26fe-48a9-a373-1b241a09d65a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:06.666049 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ccce7-9534-49a5-a6e5-1a5042312de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:06.666650 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ccce7-9534-49a5-a6e5-1a5042312de8 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:06.666923 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ccce7-9534-49a5-a6e5-1a5042312de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:06.667193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ccce7-9534-49a5-a6e5-1a5042312de8 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:06.667849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ccce7-9534-49a5-a6e5-1a5042312de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:06.669733 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ccce7-9534-49a5-a6e5-1a5042312de8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:06.773794 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1388/2811] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:56:06 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:06.777901 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3047e-56a8-4536-9365-9502c2fae17d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:06.788974 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3047e-56a8-4536-9365-9502c2fae17d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:06.793702 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0a31b-b251-4978-8a44-637a30c5416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:06.794283 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0a31b-b251-4978-8a44-637a30c5416b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:06.794565 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0a31b-b251-4978-8a44-637a30c5416b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:06.794837 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0a31b-b251-4978-8a44-637a30c5416b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:06.796173 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0a31b-b251-4978-8a44-637a30c5416b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:06.797759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0a31b-b251-4978-8a44-637a30c5416b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:06.808629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1424/2812] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:56:06.813351 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ccce7-9534-49a5-a6e5-1a5042312de8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:06.824082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ccce7-9534-49a5-a6e5-1a5042312de8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:06.828798 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21939976-6449-4de3-b6be-e415933187ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:06.829455 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21939976-6449-4de3-b6be-e415933187ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:06.829760 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21939976-6449-4de3-b6be-e415933187ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:06.830036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21939976-6449-4de3-b6be-e415933187ac admin admin] PATH_INFO: `/v3/projects/d40e34a2a35d49139d1b699433a8ffc2/users/677b6da01c2e4a1681b68112c2a9ad5e/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:06.846568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21939976-6449-4de3-b6be-e415933187ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40e34a2a35d49139d1b699433a8ffc2, user_id=677b6da01c2e4a1681b68112c2a9ad5e, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:06.849482 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21939976-6449-4de3-b6be-e415933187ac admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:06.921189 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1389/2813] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:06 2022] PUT /identity/v3/projects/d40e34a2a35d49139d1b699433a8ffc2/users/677b6da01c2e4a1681b68112c2a9ad5e/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:06.925275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0a31b-b251-4978-8a44-637a30c5416b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:06.936478 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0a31b-b251-4978-8a44-637a30c5416b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:06.997099 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a985e-a218-4a3a-91ab-b107f8ffccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:06.997717 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a985e-a218-4a3a-91ab-b107f8ffccc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:06.997983 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a985e-a218-4a3a-91ab-b107f8ffccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:06.998255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a985e-a218-4a3a-91ab-b107f8ffccc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:06.999442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a985e-a218-4a3a-91ab-b107f8ffccc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:07.001088 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a985e-a218-4a3a-91ab-b107f8ffccc2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:07.011255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1425/2814] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:07.016607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21939976-6449-4de3-b6be-e415933187ac admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:07.027121 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21939976-6449-4de3-b6be-e415933187ac admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:07.031910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e642b3-4353-415d-ae56-945d587e424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:07.032553 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e642b3-4353-415d-ae56-945d587e424d admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:07.032828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e642b3-4353-415d-ae56-945d587e424d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:07.033099 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e642b3-4353-415d-ae56-945d587e424d admin admin] PATH_INFO: `/v3/projects/d40e34a2a35d49139d1b699433a8ffc2/users/677b6da01c2e4a1681b68112c2a9ad5e/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:07.035013 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e642b3-4353-415d-ae56-945d587e424d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40e34a2a35d49139d1b699433a8ffc2, user_id=677b6da01c2e4a1681b68112c2a9ad5e, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:07.037672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e642b3-4353-415d-ae56-945d587e424d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:07.048939 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1390/2815] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:07 2022] PUT /identity/v3/projects/d40e34a2a35d49139d1b699433a8ffc2/users/677b6da01c2e4a1681b68112c2a9ad5e/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:07.059259 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffaa7b-9c09-4a97-981a-1fd76c739113 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:07.059545 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffaa7b-9c09-4a97-981a-1fd76c739113 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:07.059876 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffaa7b-9c09-4a97-981a-1fd76c739113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:07.089797 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f7ffaa7b-9c09-4a97-981a-1fd76c739113 None None] MFA Rules not processed for user `677b6da01c2e4a1681b68112c2a9ad5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:07.091078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f7ffaa7b-9c09-4a97-981a-1fd76c739113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:07.159505 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:07.168659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1426/2816] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:07.180247 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e642b3-4353-415d-ae56-945d587e424d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:07.182098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e5e642b3-4353-415d-ae56-945d587e424d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:07.241938 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e642b3-4353-415d-ae56-945d587e424d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:07.245733 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdafd5f-d82f-4346-a7e7-be9d39da9165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:07.246338 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdafd5f-d82f-4346-a7e7-be9d39da9165 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:07.246616 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdafd5f-d82f-4346-a7e7-be9d39da9165 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:07.246891 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdafd5f-d82f-4346-a7e7-be9d39da9165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:07.256935 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdafd5f-d82f-4346-a7e7-be9d39da9165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:07.258369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdafd5f-d82f-4346-a7e7-be9d39da9165 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:07.263635 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:07.269149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1391/2817] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:08.301942 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffaa7b-9c09-4a97-981a-1fd76c739113 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:08.303482 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f7ffaa7b-9c09-4a97-981a-1fd76c739113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:08.317101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffaa7b-9c09-4a97-981a-1fd76c739113 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:08.320690 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71644c54-206b-4108-91d7-83318f793c63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:08.321292 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71644c54-206b-4108-91d7-83318f793c63 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:08.321574 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71644c54-206b-4108-91d7-83318f793c63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:08.321847 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71644c54-206b-4108-91d7-83318f793c63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:08.381333 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71644c54-206b-4108-91d7-83318f793c63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:08.382777 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71644c54-206b-4108-91d7-83318f793c63 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:08.392875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1427/2818] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:13.537183 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdafd5f-d82f-4346-a7e7-be9d39da9165 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:13.546196 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdafd5f-d82f-4346-a7e7-be9d39da9165 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:13.550859 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf1c65-0341-4d54-89cc-851f358e2a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:13.551465 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf1c65-0341-4d54-89cc-851f358e2a05 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:13.551764 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf1c65-0341-4d54-89cc-851f358e2a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:13.552040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf1c65-0341-4d54-89cc-851f358e2a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:13.614637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf1c65-0341-4d54-89cc-851f358e2a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:13.616127 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf1c65-0341-4d54-89cc-851f358e2a05 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:13.626274 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1392/2819] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:17.975357 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71644c54-206b-4108-91d7-83318f793c63 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:18.043238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71644c54-206b-4108-91d7-83318f793c63 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:18.049368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:18.049991 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:18.050307 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:18.050612 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] PATH_INFO: `/v3/users/ed9a588161e543888c13c9f466115fc8` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:18.051788 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed9a588161e543888c13c9f466115fc8)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:18.053727 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:18.267304 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed9a588161e543888c13c9f466115fc8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:18.280008 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed9a588161e543888c13c9f466115fc8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:18.365255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed9a588161e543888c13c9f466115fc8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:18.365947 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed9a588161e543888c13c9f466115fc8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:18.366598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed9a588161e543888c13c9f466115fc8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:18.383288 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1428/2820] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:56:17 2022] DELETE /identity/v3/users/ed9a588161e543888c13c9f466115fc8 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:18.387118 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05474b87-9420-4772-b6c0-39eb0deccac7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:18.387604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05474b87-9420-4772-b6c0-39eb0deccac7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:18.387706 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05474b87-9420-4772-b6c0-39eb0deccac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:18.409016 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-05474b87-9420-4772-b6c0-39eb0deccac7 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:18.410225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05474b87-9420-4772-b6c0-39eb0deccac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:18.478220 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1393/2821] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:18.488519 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:18.489975 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:18.505976 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:18.553479 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa9dce-685f-4b6c-b842-204a7dc3f28e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:18.557098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144b8d2-dea8-40b7-9b38-14200d1732ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:18.557739 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144b8d2-dea8-40b7-9b38-14200d1732ed service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:18.558048 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144b8d2-dea8-40b7-9b38-14200d1732ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:18.558320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144b8d2-dea8-40b7-9b38-14200d1732ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:18.569900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144b8d2-dea8-40b7-9b38-14200d1732ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:18.571414 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144b8d2-dea8-40b7-9b38-14200d1732ed service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:18.581437 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1429/2822] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:19.036109 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05474b87-9420-4772-b6c0-39eb0deccac7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:19.037620 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05474b87-9420-4772-b6c0-39eb0deccac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:19.050480 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05474b87-9420-4772-b6c0-39eb0deccac7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:19.055380 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:19.056074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:19.056349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:19.056618 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] PATH_INFO: `/v3/projects/e94bdccce8084b79b167df1795e8b767` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:19.057829 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94bdccce8084b79b167df1795e8b767)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:19.059988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:19.177540 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94bdccce8084b79b167df1795e8b767', 'request_id': 'req-176595e0-4da4-420d-8e0f-ec2afbb908e9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:19.184021 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94bdccce8084b79b167df1795e8b767', 'request_id': 'req-176595e0-4da4-420d-8e0f-ec2afbb908e9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:19.247425 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94bdccce8084b79b167df1795e8b767', 'request_id': 'req-176595e0-4da4-420d-8e0f-ec2afbb908e9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:19.260206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] The token cache is being invalidate because project e94bdccce8084b79b167df1795e8b767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:56:19.260593 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:19.261315 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:19.263036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1394/2823] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:56:19 2022] DELETE /identity/v3/projects/e94bdccce8084b79b167df1795e8b767 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:19.268037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144b8d2-dea8-40b7-9b38-14200d1732ed service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:19.278197 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144b8d2-dea8-40b7-9b38-14200d1732ed service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:19.338391 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:19.339023 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:19.339305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:19.339594 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] PATH_INFO: `/v3/users/443876db8d3f427e904b7296d8010e71` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:19.340743 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] RBAC: Authorizing `identity:delete_user(user_id=443876db8d3f427e904b7296d8010e71)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:19.342691 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:19.508223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443876db8d3f427e904b7296d8010e71'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:19.522195 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443876db8d3f427e904b7296d8010e71'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:19.584385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443876db8d3f427e904b7296d8010e71'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:19.585184 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443876db8d3f427e904b7296d8010e71'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:19.585892 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443876db8d3f427e904b7296d8010e71'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:19.601842 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1430/2824] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:56:19 2022] DELETE /identity/v3/users/443876db8d3f427e904b7296d8010e71 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:20.043332 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:20.044989 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:20.065009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176595e0-4da4-420d-8e0f-ec2afbb908e9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:20.085231 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:20.127962 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:20.128607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:20.128890 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:20.129165 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] PATH_INFO: `/v3/projects/1616ab14f5d944c690563251c8c1344d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:20.130334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1616ab14f5d944c690563251c8c1344d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:20.132359 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:20.326637 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1616ab14f5d944c690563251c8c1344d', 'request_id': 'req-9dd15cba-659d-401c-9565-5d2ac5675601'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:20.333738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1616ab14f5d944c690563251c8c1344d', 'request_id': 'req-9dd15cba-659d-401c-9565-5d2ac5675601'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:20.468191 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1616ab14f5d944c690563251c8c1344d', 'request_id': 'req-9dd15cba-659d-401c-9565-5d2ac5675601'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:20.479337 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] The token cache is being invalidate because project 1616ab14f5d944c690563251c8c1344d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:56:20.479627 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:20.480295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:20.481777 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1395/2825] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:56:20 2022] DELETE /identity/v3/projects/1616ab14f5d944c690563251c8c1344d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:20.486183 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:20.487626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:20.501098 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6abab8-1110-4387-9f94-33412db7164f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:20.536585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:20.564817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe57f9-92da-485a-98d1-eb7dcab17aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:20.565496 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe57f9-92da-485a-98d1-eb7dcab17aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:20.565772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe57f9-92da-485a-98d1-eb7dcab17aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:20.566037 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe57f9-92da-485a-98d1-eb7dcab17aa3 admin admin] PATH_INFO: `/v3/users/677b6da01c2e4a1681b68112c2a9ad5e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:20.567274 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe57f9-92da-485a-98d1-eb7dcab17aa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=677b6da01c2e4a1681b68112c2a9ad5e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:20.569167 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe57f9-92da-485a-98d1-eb7dcab17aa3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:20.819944 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0cfe57f9-92da-485a-98d1-eb7dcab17aa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677b6da01c2e4a1681b68112c2a9ad5e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:20.832139 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0cfe57f9-92da-485a-98d1-eb7dcab17aa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677b6da01c2e4a1681b68112c2a9ad5e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:20.949903 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0cfe57f9-92da-485a-98d1-eb7dcab17aa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677b6da01c2e4a1681b68112c2a9ad5e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:20.950513 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0cfe57f9-92da-485a-98d1-eb7dcab17aa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677b6da01c2e4a1681b68112c2a9ad5e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:20.951157 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0cfe57f9-92da-485a-98d1-eb7dcab17aa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677b6da01c2e4a1681b68112c2a9ad5e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:20.965494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1431/2826] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:56:20 2022] DELETE /identity/v3/users/677b6da01c2e4a1681b68112c2a9ad5e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:21.420157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:21.421893 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:21.435797 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd15cba-659d-401c-9565-5d2ac5675601 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:21.500729 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:21.501370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:21.501646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:21.501916 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e admin admin] PATH_INFO: `/v3/projects/d40e34a2a35d49139d1b699433a8ffc2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:21.503089 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40e34a2a35d49139d1b699433a8ffc2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:21.505051 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:21.608588 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40e34a2a35d49139d1b699433a8ffc2', 'request_id': 'req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:21.617860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40e34a2a35d49139d1b699433a8ffc2', 'request_id': 'req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:21.619860 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:21.770937 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40e34a2a35d49139d1b699433a8ffc2', 'request_id': 'req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:21.787907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e admin admin] The token cache is being invalidate because project d40e34a2a35d49139d1b699433a8ffc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:56:21.788300 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:21.788828 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bcdf9c15-22a3-409c-a4f7-fe89cad4ec3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:21.790314 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1396/2827] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:56:21 2022] DELETE /identity/v3/projects/d40e34a2a35d49139d1b699433a8ffc2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:21.796480 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdca95a-4e48-4f61-89ef-c63d2c15288d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:21.797671 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdca95a-4e48-4f61-89ef-c63d2c15288d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:21.797671 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdca95a-4e48-4f61-89ef-c63d2c15288d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:21.818678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8fdca95a-4e48-4f61-89ef-c63d2c15288d None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:21.821695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8fdca95a-4e48-4f61-89ef-c63d2c15288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:21.891396 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1432/2828] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:21.957483 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57238464-4054-48bd-aae0-f36f87a3bdf9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:21.957769 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57238464-4054-48bd-aae0-f36f87a3bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:21.958045 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57238464-4054-48bd-aae0-f36f87a3bdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:21.981155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-57238464-4054-48bd-aae0-f36f87a3bdf9 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:21.982370 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-57238464-4054-48bd-aae0-f36f87a3bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:21.991564 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1397/2829] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:21.997633 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdca95a-4e48-4f61-89ef-c63d2c15288d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:22.006810 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdca95a-4e48-4f61-89ef-c63d2c15288d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:22.011520 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff255f-c565-49c8-8b03-49d7d1e1da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:22.012196 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff255f-c565-49c8-8b03-49d7d1e1da76 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:22.012472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff255f-c565-49c8-8b03-49d7d1e1da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:22.012760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff255f-c565-49c8-8b03-49d7d1e1da76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:22.013400 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff255f-c565-49c8-8b03-49d7d1e1da76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:56:22.013731 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff255f-c565-49c8-8b03-49d7d1e1da76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:22.015345 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff255f-c565-49c8-8b03-49d7d1e1da76 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:22.028791 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1433/2830] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:56:22.034405 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57238464-4054-48bd-aae0-f36f87a3bdf9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:22.043870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57238464-4054-48bd-aae0-f36f87a3bdf9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:22.050145 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5a6fb-38e6-4996-8212-f0ca2aad3ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:22.050715 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5a6fb-38e6-4996-8212-f0ca2aad3ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:22.050993 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5a6fb-38e6-4996-8212-f0ca2aad3ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:22.051263 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5a6fb-38e6-4996-8212-f0ca2aad3ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:22.051934 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5a6fb-38e6-4996-8212-f0ca2aad3ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:22.053902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5a6fb-38e6-4996-8212-f0ca2aad3ec3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:22.152174 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1398/2831] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:56:22 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:56:22.152416 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff255f-c565-49c8-8b03-49d7d1e1da76 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:22.161556 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff255f-c565-49c8-8b03-49d7d1e1da76 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:22.206687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:22.224409 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc6022-17ad-41d5-912e-cd4c542704b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:22.225048 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc6022-17ad-41d5-912e-cd4c542704b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:22.225330 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc6022-17ad-41d5-912e-cd4c542704b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:22.225603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc6022-17ad-41d5-912e-cd4c542704b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:22.226268 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc6022-17ad-41d5-912e-cd4c542704b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:22.228253 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc6022-17ad-41d5-912e-cd4c542704b1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:22.334220 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1434/2832] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:56:22 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:56:22.338699 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5a6fb-38e6-4996-8212-f0ca2aad3ec3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:22.351459 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5a6fb-38e6-4996-8212-f0ca2aad3ec3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:22.356725 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507c565-07c8-47b5-a0a0-8c09b0ceb5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:22.357336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507c565-07c8-47b5-a0a0-8c09b0ceb5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:22.357632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507c565-07c8-47b5-a0a0-8c09b0ceb5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:22.357902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507c565-07c8-47b5-a0a0-8c09b0ceb5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:22.358545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507c565-07c8-47b5-a0a0-8c09b0ceb5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:22.360203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507c565-07c8-47b5-a0a0-8c09b0ceb5e0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:22.371433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1399/2833] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:22.376705 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc6022-17ad-41d5-912e-cd4c542704b1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:22.387460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc6022-17ad-41d5-912e-cd4c542704b1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:22.393047 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7e319-f200-4746-94be-3c133ac9e45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:22.393687 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7e319-f200-4746-94be-3c133ac9e45e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:22.394252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7e319-f200-4746-94be-3c133ac9e45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:22.394252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7e319-f200-4746-94be-3c133ac9e45e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:22.394856 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7e319-f200-4746-94be-3c133ac9e45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:22.396560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7e319-f200-4746-94be-3c133ac9e45e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:22.409675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1435/2834] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:22.414298 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507c565-07c8-47b5-a0a0-8c09b0ceb5e0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:22.425697 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507c565-07c8-47b5-a0a0-8c09b0ceb5e0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:22.430473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0376d7-c250-4015-bed9-67ddca74a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:22.431330 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0376d7-c250-4015-bed9-67ddca74a8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:22.431612 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0376d7-c250-4015-bed9-67ddca74a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:22.431932 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0376d7-c250-4015-bed9-67ddca74a8a5 admin admin] PATH_INFO: `/v3/projects/ec19b68ed0834949903b62e5a43bc1b3/users/a5057aad89e047089efe5e0d2a01ae20/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:22.449631 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0376d7-c250-4015-bed9-67ddca74a8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec19b68ed0834949903b62e5a43bc1b3, user_id=a5057aad89e047089efe5e0d2a01ae20, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:22.452496 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0376d7-c250-4015-bed9-67ddca74a8a5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:22.520862 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1400/2835] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:22 2022] PUT /identity/v3/projects/ec19b68ed0834949903b62e5a43bc1b3/users/a5057aad89e047089efe5e0d2a01ae20/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:22.532080 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1405850-0c80-474d-8b14-5496bce37ec6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:22.532367 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1405850-0c80-474d-8b14-5496bce37ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:22.532674 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1405850-0c80-474d-8b14-5496bce37ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:22.563204 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d1405850-0c80-474d-8b14-5496bce37ec6 None None] MFA Rules not processed for user `a5057aad89e047089efe5e0d2a01ae20`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:22.564538 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d1405850-0c80-474d-8b14-5496bce37ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:22.635220 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1436/2836] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:22.639908 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0376d7-c250-4015-bed9-67ddca74a8a5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:22.711180 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0376d7-c250-4015-bed9-67ddca74a8a5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:22.716656 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2febfe7-e5db-4dad-9ff0-19e1a111daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:22.717295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2febfe7-e5db-4dad-9ff0-19e1a111daaa admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:22.717604 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2febfe7-e5db-4dad-9ff0-19e1a111daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:22.717876 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2febfe7-e5db-4dad-9ff0-19e1a111daaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:22.718538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2febfe7-e5db-4dad-9ff0-19e1a111daaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:22.720579 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2febfe7-e5db-4dad-9ff0-19e1a111daaa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:22.812457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1401/2837] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:56:22 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:22.817745 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1405850-0c80-474d-8b14-5496bce37ec6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:22.828923 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1405850-0c80-474d-8b14-5496bce37ec6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:22.893603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f805e77-12a7-422b-b95c-403be0ad70b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:22.894219 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f805e77-12a7-422b-b95c-403be0ad70b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:22.894499 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f805e77-12a7-422b-b95c-403be0ad70b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:22.894770 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f805e77-12a7-422b-b95c-403be0ad70b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:22.895402 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f805e77-12a7-422b-b95c-403be0ad70b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:22.897393 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f805e77-12a7-422b-b95c-403be0ad70b6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:23.024670 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1437/2838] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:56:22 2022] POST /identity/v3/users => generated 300 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:23.029047 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2febfe7-e5db-4dad-9ff0-19e1a111daaa admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:23.040297 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2febfe7-e5db-4dad-9ff0-19e1a111daaa admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:23.045200 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4770103-5bf3-47ba-bd72-8a62b0a3a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:23.045865 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4770103-5bf3-47ba-bd72-8a62b0a3a9fd admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:23.046149 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4770103-5bf3-47ba-bd72-8a62b0a3a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:23.046424 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4770103-5bf3-47ba-bd72-8a62b0a3a9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:23.047568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4770103-5bf3-47ba-bd72-8a62b0a3a9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:23.049270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4770103-5bf3-47ba-bd72-8a62b0a3a9fd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:23.061619 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1402/2839] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:23.066875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f805e77-12a7-422b-b95c-403be0ad70b6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:23.078552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f805e77-12a7-422b-b95c-403be0ad70b6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:23.083368 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8ba09-344a-4beb-b85e-3256da8162a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:23.084061 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8ba09-344a-4beb-b85e-3256da8162a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:23.084339 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8ba09-344a-4beb-b85e-3256da8162a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:23.084675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8ba09-344a-4beb-b85e-3256da8162a8 admin admin] PATH_INFO: `/v3/projects/46d3c1e01d2946cab276c34ab2c098d1/users/6af0c4926bde46bfaaf330dd876c1265/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:23.102926 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8ba09-344a-4beb-b85e-3256da8162a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d3c1e01d2946cab276c34ab2c098d1, user_id=6af0c4926bde46bfaaf330dd876c1265, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:23.106002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8ba09-344a-4beb-b85e-3256da8162a8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:23.195459 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1438/2840] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:23 2022] PUT /identity/v3/projects/46d3c1e01d2946cab276c34ab2c098d1/users/6af0c4926bde46bfaaf330dd876c1265/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:23.199569 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4770103-5bf3-47ba-bd72-8a62b0a3a9fd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:23.210834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4770103-5bf3-47ba-bd72-8a62b0a3a9fd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:23.262311 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:23.271316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004dace-03f8-4bcf-a183-fc35565fa6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:23.271949 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004dace-03f8-4bcf-a183-fc35565fa6bd admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:23.272232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004dace-03f8-4bcf-a183-fc35565fa6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:23.272504 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004dace-03f8-4bcf-a183-fc35565fa6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:23.273151 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004dace-03f8-4bcf-a183-fc35565fa6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:23.274897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004dace-03f8-4bcf-a183-fc35565fa6bd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:23.285980 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1403/2841] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:23.290343 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8ba09-344a-4beb-b85e-3256da8162a8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:23.302940 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8ba09-344a-4beb-b85e-3256da8162a8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:23.307775 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955b5b8-9dd3-471b-b5b8-c6a4094322e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:23.308910 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955b5b8-9dd3-471b-b5b8-c6a4094322e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:23.308910 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955b5b8-9dd3-471b-b5b8-c6a4094322e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:23.309159 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955b5b8-9dd3-471b-b5b8-c6a4094322e4 admin admin] PATH_INFO: `/v3/projects/46d3c1e01d2946cab276c34ab2c098d1/users/6af0c4926bde46bfaaf330dd876c1265/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:23.310987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955b5b8-9dd3-471b-b5b8-c6a4094322e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d3c1e01d2946cab276c34ab2c098d1, user_id=6af0c4926bde46bfaaf330dd876c1265, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:23.313946 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955b5b8-9dd3-471b-b5b8-c6a4094322e4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:23.325123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1439/2842] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:23 2022] PUT /identity/v3/projects/46d3c1e01d2946cab276c34ab2c098d1/users/6af0c4926bde46bfaaf330dd876c1265/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:23.337114 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e492289-c985-48c4-a48f-d323fd780189 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:23.337392 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e492289-c985-48c4-a48f-d323fd780189 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:23.337666 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e492289-c985-48c4-a48f-d323fd780189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:23.369672 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9e492289-c985-48c4-a48f-d323fd780189 None None] MFA Rules not processed for user `6af0c4926bde46bfaaf330dd876c1265`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:23.370899 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9e492289-c985-48c4-a48f-d323fd780189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:23.448156 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1404/2843] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:23.460043 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955b5b8-9dd3-471b-b5b8-c6a4094322e4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:23.461752 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1955b5b8-9dd3-471b-b5b8-c6a4094322e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:23.467238 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:23.524594 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955b5b8-9dd3-471b-b5b8-c6a4094322e4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:23.528460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dfa3a-5e39-4c40-acf1-af8036669304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:23.529004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dfa3a-5e39-4c40-acf1-af8036669304 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:23.529285 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dfa3a-5e39-4c40-acf1-af8036669304 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:23.529662 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dfa3a-5e39-4c40-acf1-af8036669304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:23.540489 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dfa3a-5e39-4c40-acf1-af8036669304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:23.541938 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dfa3a-5e39-4c40-acf1-af8036669304 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:23.554922 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1440/2844] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:23.700587 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e492289-c985-48c4-a48f-d323fd780189 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:23.768268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e492289-c985-48c4-a48f-d323fd780189 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:23.773033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:23.773661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:23.773944 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:23.774216 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] PATH_INFO: `/v3/users/a5057aad89e047089efe5e0d2a01ae20` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:23.775379 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5057aad89e047089efe5e0d2a01ae20)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:23.777381 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:23.971033 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5057aad89e047089efe5e0d2a01ae20'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:23.971768 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5057aad89e047089efe5e0d2a01ae20'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:23.984217 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5057aad89e047089efe5e0d2a01ae20'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:23.992304 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5057aad89e047089efe5e0d2a01ae20'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:23.993096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5057aad89e047089efe5e0d2a01ae20'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:23.995702 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:24.126062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1405/2845] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:56:23 2022] DELETE /identity/v3/users/a5057aad89e047089efe5e0d2a01ae20 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:56:24.131637 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef095d-12e4-4cb5-8614-c98dcb499461 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:24.132222 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef095d-12e4-4cb5-8614-c98dcb499461 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:24.132222 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef095d-12e4-4cb5-8614-c98dcb499461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:24.153806 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a2ef095d-12e4-4cb5-8614-c98dcb499461 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:24.155101 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a2ef095d-12e4-4cb5-8614-c98dcb499461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:24.219418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1441/2846] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:56:24.229501 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:24.230956 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:24.295438 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00a4bd-2c77-49e1-b567-c65d3c636ff6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:24.299518 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4aa14-af0a-4789-b43b-340b65769738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:24.300169 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4aa14-af0a-4789-b43b-340b65769738 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:24.300445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4aa14-af0a-4789-b43b-340b65769738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:24.300738 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4aa14-af0a-4789-b43b-340b65769738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:24.310678 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4aa14-af0a-4789-b43b-340b65769738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:24.312159 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4aa14-af0a-4789-b43b-340b65769738 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:24.322271 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1406/2847] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:24.951635 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef095d-12e4-4cb5-8614-c98dcb499461 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:24.953182 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a2ef095d-12e4-4cb5-8614-c98dcb499461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:24.966447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef095d-12e4-4cb5-8614-c98dcb499461 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:24.971472 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:24.972153 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:24.972426 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:24.972705 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] PATH_INFO: `/v3/projects/ec19b68ed0834949903b62e5a43bc1b3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:24.973831 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec19b68ed0834949903b62e5a43bc1b3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:24.975811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:25.101169 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec19b68ed0834949903b62e5a43bc1b3', 'request_id': 'req-4e2db022-dd92-48d4-8158-e39806a321b2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:25.107402 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec19b68ed0834949903b62e5a43bc1b3', 'request_id': 'req-4e2db022-dd92-48d4-8158-e39806a321b2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:25.203560 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec19b68ed0834949903b62e5a43bc1b3', 'request_id': 'req-4e2db022-dd92-48d4-8158-e39806a321b2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:25.217458 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] The token cache is being invalidate because project ec19b68ed0834949903b62e5a43bc1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:56:25.217740 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:25.218404 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:25.220002 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1442/2848] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:56:24 2022] DELETE /identity/v3/projects/ec19b68ed0834949903b62e5a43bc1b3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:25.224778 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4aa14-af0a-4789-b43b-340b65769738 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:25.234831 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4aa14-af0a-4789-b43b-340b65769738 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:25.296869 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1b8e1-c51a-4ca5-a97c-7ab1e69bd228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:25.297499 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1b8e1-c51a-4ca5-a97c-7ab1e69bd228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:25.297781 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1b8e1-c51a-4ca5-a97c-7ab1e69bd228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:25.298079 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1b8e1-c51a-4ca5-a97c-7ab1e69bd228 admin admin] PATH_INFO: `/v3/users/6af0c4926bde46bfaaf330dd876c1265` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:25.300122 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1b8e1-c51a-4ca5-a97c-7ab1e69bd228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af0c4926bde46bfaaf330dd876c1265)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:25.302276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1b8e1-c51a-4ca5-a97c-7ab1e69bd228 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:25.508789 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebf1b8e1-c51a-4ca5-a97c-7ab1e69bd228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af0c4926bde46bfaaf330dd876c1265'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:25.509490 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebf1b8e1-c51a-4ca5-a97c-7ab1e69bd228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af0c4926bde46bfaaf330dd876c1265'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:25.523665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebf1b8e1-c51a-4ca5-a97c-7ab1e69bd228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af0c4926bde46bfaaf330dd876c1265'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:25.536301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebf1b8e1-c51a-4ca5-a97c-7ab1e69bd228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af0c4926bde46bfaaf330dd876c1265'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:25.537103 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebf1b8e1-c51a-4ca5-a97c-7ab1e69bd228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af0c4926bde46bfaaf330dd876c1265'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:25.613983 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1407/2849] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:56:25 2022] DELETE /identity/v3/users/6af0c4926bde46bfaaf330dd876c1265 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:26.112587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:26.114123 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:26.127233 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2db022-dd92-48d4-8158-e39806a321b2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:26.162963 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:26.195920 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade6132-56be-4b35-a9dd-9e61a2c0ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:26.196564 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade6132-56be-4b35-a9dd-9e61a2c0ecce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:26.196846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade6132-56be-4b35-a9dd-9e61a2c0ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:26.197121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade6132-56be-4b35-a9dd-9e61a2c0ecce admin admin] PATH_INFO: `/v3/projects/46d3c1e01d2946cab276c34ab2c098d1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:26.198281 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade6132-56be-4b35-a9dd-9e61a2c0ecce admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d3c1e01d2946cab276c34ab2c098d1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:26.200255 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade6132-56be-4b35-a9dd-9e61a2c0ecce admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:26.334987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fade6132-56be-4b35-a9dd-9e61a2c0ecce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d3c1e01d2946cab276c34ab2c098d1', 'request_id': 'req-fade6132-56be-4b35-a9dd-9e61a2c0ecce'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:26.341835 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fade6132-56be-4b35-a9dd-9e61a2c0ecce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d3c1e01d2946cab276c34ab2c098d1', 'request_id': 'req-fade6132-56be-4b35-a9dd-9e61a2c0ecce'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:26.412569 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fade6132-56be-4b35-a9dd-9e61a2c0ecce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d3c1e01d2946cab276c34ab2c098d1', 'request_id': 'req-fade6132-56be-4b35-a9dd-9e61a2c0ecce'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:26.424537 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fade6132-56be-4b35-a9dd-9e61a2c0ecce admin admin] The token cache is being invalidate because project 46d3c1e01d2946cab276c34ab2c098d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:56:26.424951 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fade6132-56be-4b35-a9dd-9e61a2c0ecce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:26.426311 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fade6132-56be-4b35-a9dd-9e61a2c0ecce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:26.428640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1443/2850] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:56:26 2022] DELETE /identity/v3/projects/46d3c1e01d2946cab276c34ab2c098d1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:26.433695 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102676e5-1b13-4638-8e26-9b5fb08aa55a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:26.434234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102676e5-1b13-4638-8e26-9b5fb08aa55a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:26.434234 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102676e5-1b13-4638-8e26-9b5fb08aa55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:26.456869 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-102676e5-1b13-4638-8e26-9b5fb08aa55a None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:26.462737 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-102676e5-1b13-4638-8e26-9b5fb08aa55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:26.471840 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:26.529140 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1408/2851] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:26.538264 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf065-8779-43fe-96e6-4521824af18f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:26.538604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf065-8779-43fe-96e6-4521824af18f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:26.538844 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf065-8779-43fe-96e6-4521824af18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:26.560846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4f5bf065-8779-43fe-96e6-4521824af18f None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:26.562073 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4f5bf065-8779-43fe-96e6-4521824af18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:26.571315 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1444/2852] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:26.575942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102676e5-1b13-4638-8e26-9b5fb08aa55a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:26.587238 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102676e5-1b13-4638-8e26-9b5fb08aa55a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:26.591897 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec97b2-3950-479e-a6f6-7607a6355892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:26.592601 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec97b2-3950-479e-a6f6-7607a6355892 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:26.593198 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec97b2-3950-479e-a6f6-7607a6355892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:26.593455 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec97b2-3950-479e-a6f6-7607a6355892 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:26.594186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec97b2-3950-479e-a6f6-7607a6355892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:56:26.594665 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec97b2-3950-479e-a6f6-7607a6355892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:26.597568 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec97b2-3950-479e-a6f6-7607a6355892 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:26.614296 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1409/2853] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:56:26.616081 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bf065-8779-43fe-96e6-4521824af18f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:26.626531 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bf065-8779-43fe-96e6-4521824af18f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:26.631530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d113e0-64d2-4530-b65f-0f4d12ed5d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:26.632177 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d113e0-64d2-4530-b65f-0f4d12ed5d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:26.632453 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d113e0-64d2-4530-b65f-0f4d12ed5d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:26.632763 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d113e0-64d2-4530-b65f-0f4d12ed5d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:26.633678 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d113e0-64d2-4530-b65f-0f4d12ed5d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:26.635317 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d113e0-64d2-4530-b65f-0f4d12ed5d39 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:26.746455 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1445/2854] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:56:26 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:26.750838 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec97b2-3950-479e-a6f6-7607a6355892 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:26.761716 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec97b2-3950-479e-a6f6-7607a6355892 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:26.823571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873f530-59ce-45dd-95de-21d9166f1f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:26.825055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873f530-59ce-45dd-95de-21d9166f1f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:26.825055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873f530-59ce-45dd-95de-21d9166f1f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:26.825055 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873f530-59ce-45dd-95de-21d9166f1f59 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:26.825366 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873f530-59ce-45dd-95de-21d9166f1f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:26.827367 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873f530-59ce-45dd-95de-21d9166f1f59 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:26.917192 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1410/2855] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:56:26 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:26.921423 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d113e0-64d2-4530-b65f-0f4d12ed5d39 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:26.932387 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d113e0-64d2-4530-b65f-0f4d12ed5d39 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:26.936894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca777f-8929-4a95-8543-afc3a3752062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:26.937481 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca777f-8929-4a95-8543-afc3a3752062 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:26.937755 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca777f-8929-4a95-8543-afc3a3752062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:26.938020 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca777f-8929-4a95-8543-afc3a3752062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:26.938646 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca777f-8929-4a95-8543-afc3a3752062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:26.940600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca777f-8929-4a95-8543-afc3a3752062 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:26.950522 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1446/2856] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:26.955633 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873f530-59ce-45dd-95de-21d9166f1f59 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:26.966727 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873f530-59ce-45dd-95de-21d9166f1f59 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:26.972343 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8e56e-4aae-4c03-9be2-151a9678cd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:26.972953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8e56e-4aae-4c03-9be2-151a9678cd87 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:26.973250 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8e56e-4aae-4c03-9be2-151a9678cd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:26.973525 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8e56e-4aae-4c03-9be2-151a9678cd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:26.974352 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8e56e-4aae-4c03-9be2-151a9678cd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:26.975992 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8e56e-4aae-4c03-9be2-151a9678cd87 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:26.987997 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1411/2857] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:26.992455 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca777f-8929-4a95-8543-afc3a3752062 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:27.003394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca777f-8929-4a95-8543-afc3a3752062 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:27.010190 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037677c4-7bbb-4227-9385-57c684cd8afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:27.011026 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037677c4-7bbb-4227-9385-57c684cd8afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:27.011407 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037677c4-7bbb-4227-9385-57c684cd8afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:27.011845 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037677c4-7bbb-4227-9385-57c684cd8afe admin admin] PATH_INFO: `/v3/projects/b9874f80fa3e4a7d85db2c4317562865/users/6cc7eec311d74c68a21e635b57cd47a2/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:27.028640 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037677c4-7bbb-4227-9385-57c684cd8afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9874f80fa3e4a7d85db2c4317562865, user_id=6cc7eec311d74c68a21e635b57cd47a2, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:27.031360 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037677c4-7bbb-4227-9385-57c684cd8afe admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:27.125600 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1447/2858] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:26 2022] PUT /identity/v3/projects/b9874f80fa3e4a7d85db2c4317562865/users/6cc7eec311d74c68a21e635b57cd47a2/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:27.136173 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289e23e-fc41-4d7a-9cbe-7de6618a7a77 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:27.136457 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289e23e-fc41-4d7a-9cbe-7de6618a7a77 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:27.136751 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289e23e-fc41-4d7a-9cbe-7de6618a7a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:27.168243 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d289e23e-fc41-4d7a-9cbe-7de6618a7a77 None None] MFA Rules not processed for user `6cc7eec311d74c68a21e635b57cd47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:27.169376 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d289e23e-fc41-4d7a-9cbe-7de6618a7a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:27.245602 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1412/2859] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:27.257988 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037677c4-7bbb-4227-9385-57c684cd8afe admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:27.259736 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-037677c4-7bbb-4227-9385-57c684cd8afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:27.324804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037677c4-7bbb-4227-9385-57c684cd8afe admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:27.328927 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ea078-69a5-4cbf-b2ca-ba6535d354d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75138f08ea2b4813b095635d920599d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:27.329530 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ea078-69a5-4cbf-b2ca-ba6535d354d0 service glance] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:27.329880 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ea078-69a5-4cbf-b2ca-ba6535d354d0 service glance] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:27.330198 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ea078-69a5-4cbf-b2ca-ba6535d354d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:27.338789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ea078-69a5-4cbf-b2ca-ba6535d354d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:27.340246 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ea078-69a5-4cbf-b2ca-ba6535d354d0 service glance] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:27.343817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:27.350943 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1448/2860] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:37.242410 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:37.475875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:42.706567 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289e23e-fc41-4d7a-9cbe-7de6618a7a77 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:42.777597 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289e23e-fc41-4d7a-9cbe-7de6618a7a77 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:42.782530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:42.783155 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:42.783433 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:42.783701 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] PATH_INFO: `/v3/users/6cc7eec311d74c68a21e635b57cd47a2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:42.784867 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc7eec311d74c68a21e635b57cd47a2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:42.786854 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:42.970230 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc7eec311d74c68a21e635b57cd47a2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:42.970941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc7eec311d74c68a21e635b57cd47a2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:42.984322 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc7eec311d74c68a21e635b57cd47a2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:42.992455 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc7eec311d74c68a21e635b57cd47a2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:42.993206 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc7eec311d74c68a21e635b57cd47a2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:43.076688 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1413/2861] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:56:42 2022] DELETE /identity/v3/users/6cc7eec311d74c68a21e635b57cd47a2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:43.081494 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2576f-c709-42f0-800a-54402afd0d25 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:43.086772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2576f-c709-42f0-800a-54402afd0d25 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:43.086772 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2576f-c709-42f0-800a-54402afd0d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:43.102706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-33e2576f-c709-42f0-800a-54402afd0d25 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:43.103964 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-33e2576f-c709-42f0-800a-54402afd0d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:43.169626 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1449/2862] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:43.181039 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:43.182824 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:43.253535 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a7749-efba-42e7-b597-ce4f383f6b1d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:43.257941 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3f01c-432d-4895-8ad6-7184c2971ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:43.258560 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3f01c-432d-4895-8ad6-7184c2971ebf service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:43.258842 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3f01c-432d-4895-8ad6-7184c2971ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:43.259116 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3f01c-432d-4895-8ad6-7184c2971ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:43.269445 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3f01c-432d-4895-8ad6-7184c2971ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:43.271573 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3f01c-432d-4895-8ad6-7184c2971ebf service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:43.281964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1414/2863] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:56:43.826395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2576f-c709-42f0-800a-54402afd0d25 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:43.827938 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-33e2576f-c709-42f0-800a-54402afd0d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:43.840925 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2576f-c709-42f0-800a-54402afd0d25 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:43.845656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c534465-869f-4cca-9406-684b59e2d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:43.846297 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c534465-869f-4cca-9406-684b59e2d454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:43.846592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c534465-869f-4cca-9406-684b59e2d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:43.846869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c534465-869f-4cca-9406-684b59e2d454 admin admin] PATH_INFO: `/v3/projects/b9874f80fa3e4a7d85db2c4317562865` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:43.848007 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c534465-869f-4cca-9406-684b59e2d454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9874f80fa3e4a7d85db2c4317562865)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:43.850137 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c534465-869f-4cca-9406-684b59e2d454 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:43.967789 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7c534465-869f-4cca-9406-684b59e2d454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9874f80fa3e4a7d85db2c4317562865', 'request_id': 'req-7c534465-869f-4cca-9406-684b59e2d454'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:43.974214 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7c534465-869f-4cca-9406-684b59e2d454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9874f80fa3e4a7d85db2c4317562865', 'request_id': 'req-7c534465-869f-4cca-9406-684b59e2d454'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:44.041050 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7c534465-869f-4cca-9406-684b59e2d454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9874f80fa3e4a7d85db2c4317562865', 'request_id': 'req-7c534465-869f-4cca-9406-684b59e2d454'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:44.052874 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7c534465-869f-4cca-9406-684b59e2d454 admin admin] The token cache is being invalidate because project b9874f80fa3e4a7d85db2c4317562865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:56:44.053306 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7c534465-869f-4cca-9406-684b59e2d454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:44.053956 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7c534465-869f-4cca-9406-684b59e2d454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:44.055465 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1450/2864] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:56:43 2022] DELETE /identity/v3/projects/b9874f80fa3e4a7d85db2c4317562865 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:56:44.060589 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0606c-fc35-4def-ad70-b943ec9f73ad None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:44.061082 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0606c-fc35-4def-ad70-b943ec9f73ad None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:44.061203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0606c-fc35-4def-ad70-b943ec9f73ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:44.084080 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f4c0606c-fc35-4def-ad70-b943ec9f73ad None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:44.085528 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f4c0606c-fc35-4def-ad70-b943ec9f73ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:44.105607 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:44.151228 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1415/2865] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:56:44.160301 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83482b-7a2d-4b77-86eb-c20ff2c438ee None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:44.160811 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83482b-7a2d-4b77-86eb-c20ff2c438ee None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:44.160923 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83482b-7a2d-4b77-86eb-c20ff2c438ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:44.181575 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2b83482b-7a2d-4b77-86eb-c20ff2c438ee None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:44.182848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2b83482b-7a2d-4b77-86eb-c20ff2c438ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:44.191308 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1451/2866] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:44.196027 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0606c-fc35-4def-ad70-b943ec9f73ad None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:44.205870 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0606c-fc35-4def-ad70-b943ec9f73ad None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:44.211664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3bd01-f365-4b81-a7c8-0edcb5535302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:44.212301 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3bd01-f365-4b81-a7c8-0edcb5535302 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:44.212581 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3bd01-f365-4b81-a7c8-0edcb5535302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:44.212853 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3bd01-f365-4b81-a7c8-0edcb5535302 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:44.213498 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3bd01-f365-4b81-a7c8-0edcb5535302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:56:44.213799 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3bd01-f365-4b81-a7c8-0edcb5535302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:44.215403 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3bd01-f365-4b81-a7c8-0edcb5535302 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:44.229166 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1416/2867] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:56:44.233587 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83482b-7a2d-4b77-86eb-c20ff2c438ee None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:44.244306 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83482b-7a2d-4b77-86eb-c20ff2c438ee None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:44.249208 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb5b56-da32-44a9-aabc-368111a12aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:44.249799 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb5b56-da32-44a9-aabc-368111a12aaa admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:44.250076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb5b56-da32-44a9-aabc-368111a12aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:44.250344 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb5b56-da32-44a9-aabc-368111a12aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:44.250960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb5b56-da32-44a9-aabc-368111a12aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:44.252960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb5b56-da32-44a9-aabc-368111a12aaa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:44.363089 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1452/2868] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:56:44 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:44.367878 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3bd01-f365-4b81-a7c8-0edcb5535302 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:44.379094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3bd01-f365-4b81-a7c8-0edcb5535302 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:44.440742 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc477a0-5009-4768-8b21-32da374b04aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:44.441356 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc477a0-5009-4768-8b21-32da374b04aa admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:44.441632 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc477a0-5009-4768-8b21-32da374b04aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:44.441902 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc477a0-5009-4768-8b21-32da374b04aa admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:44.442530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc477a0-5009-4768-8b21-32da374b04aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:44.445134 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc477a0-5009-4768-8b21-32da374b04aa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:44.554609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1417/2869] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:56:44 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:44.558985 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb5b56-da32-44a9-aabc-368111a12aaa admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:44.570950 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb5b56-da32-44a9-aabc-368111a12aaa admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:44.575776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41a226-acd0-4049-a578-bd8f3d290a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:44.576417 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41a226-acd0-4049-a578-bd8f3d290a7c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:44.576719 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41a226-acd0-4049-a578-bd8f3d290a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:44.576996 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41a226-acd0-4049-a578-bd8f3d290a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:44.577648 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41a226-acd0-4049-a578-bd8f3d290a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:44.579320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41a226-acd0-4049-a578-bd8f3d290a7c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:44.590968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1453/2870] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:44.594982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc477a0-5009-4768-8b21-32da374b04aa admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:44.606266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc477a0-5009-4768-8b21-32da374b04aa admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:44.611087 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486a87a-5fe1-4ca2-a13f-75c3197ed51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:44.611686 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486a87a-5fe1-4ca2-a13f-75c3197ed51d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:44.611994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486a87a-5fe1-4ca2-a13f-75c3197ed51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:44.612260 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486a87a-5fe1-4ca2-a13f-75c3197ed51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:44.612969 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486a87a-5fe1-4ca2-a13f-75c3197ed51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:44.614571 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486a87a-5fe1-4ca2-a13f-75c3197ed51d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:44.626802 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1418/2871] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:44.631846 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41a226-acd0-4049-a578-bd8f3d290a7c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:44.642054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41a226-acd0-4049-a578-bd8f3d290a7c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:44.647660 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d8d28-bd37-4c22-8f27-69b567c02fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:44.648346 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d8d28-bd37-4c22-8f27-69b567c02fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:44.648623 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d8d28-bd37-4c22-8f27-69b567c02fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:44.648896 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d8d28-bd37-4c22-8f27-69b567c02fe3 admin admin] PATH_INFO: `/v3/projects/dca80ba4ec7a49b49fb088a7d9d6523e/users/46a152cb83334f9ea2db8ba176a93f21/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:44.664895 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d8d28-bd37-4c22-8f27-69b567c02fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca80ba4ec7a49b49fb088a7d9d6523e, user_id=46a152cb83334f9ea2db8ba176a93f21, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:44.667618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d8d28-bd37-4c22-8f27-69b567c02fe3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:44.748332 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1454/2872] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:44 2022] PUT /identity/v3/projects/dca80ba4ec7a49b49fb088a7d9d6523e/users/46a152cb83334f9ea2db8ba176a93f21/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:44.759924 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70ae4-6b71-47cc-8dc8-1582c5357623 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:44.760245 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70ae4-6b71-47cc-8dc8-1582c5357623 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:44.760523 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70ae4-6b71-47cc-8dc8-1582c5357623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:44.789732 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d5e70ae4-6b71-47cc-8dc8-1582c5357623 None None] MFA Rules not processed for user `46a152cb83334f9ea2db8ba176a93f21`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:44.790953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d5e70ae4-6b71-47cc-8dc8-1582c5357623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:44.860647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1419/2873] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:44.866248 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d8d28-bd37-4c22-8f27-69b567c02fe3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:44.888566 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:44.930124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d8d28-bd37-4c22-8f27-69b567c02fe3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:44.935069 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef2f92-32bc-4ca4-a683-bba61c2f1674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:44.935676 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2f92-32bc-4ca4-a683-bba61c2f1674 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:44.935992 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2f92-32bc-4ca4-a683-bba61c2f1674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:44.936305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2f92-32bc-4ca4-a683-bba61c2f1674 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:44.936918 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef2f92-32bc-4ca4-a683-bba61c2f1674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:44.938869 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef2f92-32bc-4ca4-a683-bba61c2f1674 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:45.044163 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1455/2874] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:56:44 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:56:45.048363 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e70ae4-6b71-47cc-8dc8-1582c5357623 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:45.060317 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e70ae4-6b71-47cc-8dc8-1582c5357623 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:45.073644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:45.119246 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364b62e-57cc-4e50-9d19-c4008e47f097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:45.119834 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364b62e-57cc-4e50-9d19-c4008e47f097 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:45.120117 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364b62e-57cc-4e50-9d19-c4008e47f097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:45.120391 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364b62e-57cc-4e50-9d19-c4008e47f097 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:45.121028 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364b62e-57cc-4e50-9d19-c4008e47f097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:45.122964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364b62e-57cc-4e50-9d19-c4008e47f097 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:45.196164 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1420/2875] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:56:45 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:45.200262 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef2f92-32bc-4ca4-a683-bba61c2f1674 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:45.211707 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef2f92-32bc-4ca4-a683-bba61c2f1674 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:45.216435 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fb0c6-deb7-4ebc-af14-142bd5d71fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:45.217022 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fb0c6-deb7-4ebc-af14-142bd5d71fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:45.217305 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fb0c6-deb7-4ebc-af14-142bd5d71fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:45.217579 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fb0c6-deb7-4ebc-af14-142bd5d71fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:45.218252 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fb0c6-deb7-4ebc-af14-142bd5d71fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:45.219894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fb0c6-deb7-4ebc-af14-142bd5d71fa5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:45.231855 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1456/2876] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:45.236227 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364b62e-57cc-4e50-9d19-c4008e47f097 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:45.246559 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364b62e-57cc-4e50-9d19-c4008e47f097 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:45.251294 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd3ab6-990c-4e9d-bd73-de9fbb9099a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:45.251926 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd3ab6-990c-4e9d-bd73-de9fbb9099a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:45.252204 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd3ab6-990c-4e9d-bd73-de9fbb9099a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:45.252477 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd3ab6-990c-4e9d-bd73-de9fbb9099a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:45.253148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd3ab6-990c-4e9d-bd73-de9fbb9099a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:45.254744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd3ab6-990c-4e9d-bd73-de9fbb9099a6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:45.265872 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1421/2877] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:56:45.269968 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fb0c6-deb7-4ebc-af14-142bd5d71fa5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:45.282447 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fb0c6-deb7-4ebc-af14-142bd5d71fa5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:45.288078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a332ecd-65bf-4af2-9442-66c48624e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:45.288750 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a332ecd-65bf-4af2-9442-66c48624e569 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:45.289972 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a332ecd-65bf-4af2-9442-66c48624e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:45.289972 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a332ecd-65bf-4af2-9442-66c48624e569 admin admin] PATH_INFO: `/v3/projects/5042890c6ef74bf4992fda4b2ac6c7e3/users/e0edcd89b6e74502a31fd2adb1a1e765/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:45.306625 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a332ecd-65bf-4af2-9442-66c48624e569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5042890c6ef74bf4992fda4b2ac6c7e3, user_id=e0edcd89b6e74502a31fd2adb1a1e765, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:45.309377 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a332ecd-65bf-4af2-9442-66c48624e569 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:45.407016 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1457/2878] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:45 2022] PUT /identity/v3/projects/5042890c6ef74bf4992fda4b2ac6c7e3/users/e0edcd89b6e74502a31fd2adb1a1e765/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:45.419158 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111281d-94c2-4ef7-87f4-2515cb88d2e0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:45.419473 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111281d-94c2-4ef7-87f4-2515cb88d2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:45.419767 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111281d-94c2-4ef7-87f4-2515cb88d2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:45.450910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9111281d-94c2-4ef7-87f4-2515cb88d2e0 None None] MFA Rules not processed for user `e0edcd89b6e74502a31fd2adb1a1e765`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:45.452349 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9111281d-94c2-4ef7-87f4-2515cb88d2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:45.524953 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1422/2879] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:45.533805 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a332ecd-65bf-4af2-9442-66c48624e569 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:45.615075 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a332ecd-65bf-4af2-9442-66c48624e569 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:45.622922 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0696dc9-2b7d-4c75-ae89-b667ac618b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:45.623552 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0696dc9-2b7d-4c75-ae89-b667ac618b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:45.623875 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0696dc9-2b7d-4c75-ae89-b667ac618b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:45.624154 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0696dc9-2b7d-4c75-ae89-b667ac618b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:45.624793 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0696dc9-2b7d-4c75-ae89-b667ac618b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:45.626804 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0696dc9-2b7d-4c75-ae89-b667ac618b75 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:45.749894 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1458/2880] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:56:45 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:45.756832 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111281d-94c2-4ef7-87f4-2515cb88d2e0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:45.777269 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111281d-94c2-4ef7-87f4-2515cb88d2e0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:45.848907 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deb9ac-e292-4983-987b-350f54837c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:45.849734 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deb9ac-e292-4983-987b-350f54837c00 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:45.850096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deb9ac-e292-4983-987b-350f54837c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:45.850399 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deb9ac-e292-4983-987b-350f54837c00 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:45.851040 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deb9ac-e292-4983-987b-350f54837c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:45.853063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deb9ac-e292-4983-987b-350f54837c00 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:45.962360 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1423/2881] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:56:45 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:45.967221 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0696dc9-2b7d-4c75-ae89-b667ac618b75 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:45.979054 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0696dc9-2b7d-4c75-ae89-b667ac618b75 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:45.984028 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2720-2d56-42f0-b726-c90b36b2beb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:45.987848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2720-2d56-42f0-b726-c90b36b2beb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:45.987848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2720-2d56-42f0-b726-c90b36b2beb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:45.987848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2720-2d56-42f0-b726-c90b36b2beb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:45.987848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2720-2d56-42f0-b726-c90b36b2beb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:45.987848 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2720-2d56-42f0-b726-c90b36b2beb2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:46.000009 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1459/2882] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:56:46.004375 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deb9ac-e292-4983-987b-350f54837c00 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:46.015784 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deb9ac-e292-4983-987b-350f54837c00 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:46.020633 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a916f6-36de-4739-93b0-85b1ae275320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:46.022106 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a916f6-36de-4739-93b0-85b1ae275320 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:46.022661 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a916f6-36de-4739-93b0-85b1ae275320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:46.022874 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a916f6-36de-4739-93b0-85b1ae275320 admin admin] PATH_INFO: `/v3/projects/8e2aa95483a84fd899634b99d091b645/users/d602b7d5202f486b975b6c1f5872ce7d/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:46.040373 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:46.046107 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a916f6-36de-4739-93b0-85b1ae275320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2aa95483a84fd899634b99d091b645, user_id=d602b7d5202f486b975b6c1f5872ce7d, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:46.048885 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a916f6-36de-4739-93b0-85b1ae275320 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:46.122942 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1424/2883] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:46 2022] PUT /identity/v3/projects/8e2aa95483a84fd899634b99d091b645/users/d602b7d5202f486b975b6c1f5872ce7d/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:46.127225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2720-2d56-42f0-b726-c90b36b2beb2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:46.138411 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2720-2d56-42f0-b726-c90b36b2beb2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:46.184071 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:46.202220 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac144c6a-106b-48a4-8dc9-82e9e349d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:46.203076 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac144c6a-106b-48a4-8dc9-82e9e349d86b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:46.203217 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac144c6a-106b-48a4-8dc9-82e9e349d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:46.203422 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac144c6a-106b-48a4-8dc9-82e9e349d86b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:46.204126 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac144c6a-106b-48a4-8dc9-82e9e349d86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:46.205737 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac144c6a-106b-48a4-8dc9-82e9e349d86b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:46.218442 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1460/2884] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:46.222858 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a916f6-36de-4739-93b0-85b1ae275320 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:46.234046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a916f6-36de-4739-93b0-85b1ae275320 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:46.239085 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde8d4e-b6bd-428e-afb1-e7f666bea7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:46.239884 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde8d4e-b6bd-428e-afb1-e7f666bea7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:46.240252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde8d4e-b6bd-428e-afb1-e7f666bea7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:46.240647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde8d4e-b6bd-428e-afb1-e7f666bea7f9 admin admin] PATH_INFO: `/v3/projects/8e2aa95483a84fd899634b99d091b645/users/d602b7d5202f486b975b6c1f5872ce7d/roles/60abeefc9ac84e31a0162ac559220669` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:46.242646 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde8d4e-b6bd-428e-afb1-e7f666bea7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2aa95483a84fd899634b99d091b645, user_id=d602b7d5202f486b975b6c1f5872ce7d, role_id=60abeefc9ac84e31a0162ac559220669)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:46.245471 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde8d4e-b6bd-428e-afb1-e7f666bea7f9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:46.257455 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1425/2885] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:46 2022] PUT /identity/v3/projects/8e2aa95483a84fd899634b99d091b645/users/d602b7d5202f486b975b6c1f5872ce7d/roles/60abeefc9ac84e31a0162ac559220669 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:46.268372 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb26404-55f5-47b1-8e4f-cbc608ab56cc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:46.268778 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb26404-55f5-47b1-8e4f-cbc608ab56cc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:46.269131 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb26404-55f5-47b1-8e4f-cbc608ab56cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:46.304266 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ccb26404-55f5-47b1-8e4f-cbc608ab56cc None None] MFA Rules not processed for user `d602b7d5202f486b975b6c1f5872ce7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:46.305666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ccb26404-55f5-47b1-8e4f-cbc608ab56cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:46.383166 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1461/2886] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:46.395225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde8d4e-b6bd-428e-afb1-e7f666bea7f9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:46.397193 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1fde8d4e-b6bd-428e-afb1-e7f666bea7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:46.469270 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde8d4e-b6bd-428e-afb1-e7f666bea7f9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:46.473059 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba863-d4e7-4a6f-a6ad-8c0a753de9ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:46.473668 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba863-d4e7-4a6f-a6ad-8c0a753de9ae service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:46.473990 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba863-d4e7-4a6f-a6ad-8c0a753de9ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:46.474530 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba863-d4e7-4a6f-a6ad-8c0a753de9ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:46.535295 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ba863-d4e7-4a6f-a6ad-8c0a753de9ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:46.536848 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ba863-d4e7-4a6f-a6ad-8c0a753de9ae service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:46.546664 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1426/2887] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:48.598312 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb26404-55f5-47b1-8e4f-cbc608ab56cc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:48.601398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ccb26404-55f5-47b1-8e4f-cbc608ab56cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:48.614553 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb26404-55f5-47b1-8e4f-cbc608ab56cc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:48.619382 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e109e0-28d5-42fb-9ade-6b79a8f8ece9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:48.620039 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e109e0-28d5-42fb-9ade-6b79a8f8ece9 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:48.620322 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e109e0-28d5-42fb-9ade-6b79a8f8ece9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:48.620597 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e109e0-28d5-42fb-9ade-6b79a8f8ece9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:48.691124 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e109e0-28d5-42fb-9ade-6b79a8f8ece9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:48.692873 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e109e0-28d5-42fb-9ade-6b79a8f8ece9 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:48.702621 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1462/2888] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:50.126906 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba863-d4e7-4a6f-a6ad-8c0a753de9ae service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:50.136488 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba863-d4e7-4a6f-a6ad-8c0a753de9ae service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:50.140396 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ad599-2aa6-45fe-b2fd-2e0ce3e37a6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:50.141036 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ad599-2aa6-45fe-b2fd-2e0ce3e37a6e service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:50.141316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ad599-2aa6-45fe-b2fd-2e0ce3e37a6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:50.141609 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ad599-2aa6-45fe-b2fd-2e0ce3e37a6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:50.154982 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ad599-2aa6-45fe-b2fd-2e0ce3e37a6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:50.158502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ad599-2aa6-45fe-b2fd-2e0ce3e37a6e service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:50.168203 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1427/2889] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:55.096759 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e109e0-28d5-42fb-9ade-6b79a8f8ece9 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:55.161738 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e109e0-28d5-42fb-9ade-6b79a8f8ece9 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:55.166406 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:55.167032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:55.167314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:55.167588 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] PATH_INFO: `/v3/users/46a152cb83334f9ea2db8ba176a93f21` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:55.168780 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a152cb83334f9ea2db8ba176a93f21)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:55.170735 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:55.175672 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:55.353585 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a152cb83334f9ea2db8ba176a93f21'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:55.368945 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a152cb83334f9ea2db8ba176a93f21'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:55.427518 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a152cb83334f9ea2db8ba176a93f21'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:55.428273 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a152cb83334f9ea2db8ba176a93f21'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:55.429004 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a152cb83334f9ea2db8ba176a93f21'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:55.444325 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1463/2890] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:56:55 2022] DELETE /identity/v3/users/46a152cb83334f9ea2db8ba176a93f21 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:55.449046 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fc33a-4d13-4abe-8c01-530b80dd41e8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:55.449543 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fc33a-4d13-4abe-8c01-530b80dd41e8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:55.449642 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fc33a-4d13-4abe-8c01-530b80dd41e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:55.469545 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c20fc33a-4d13-4abe-8c01-530b80dd41e8 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:55.470783 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c20fc33a-4d13-4abe-8c01-530b80dd41e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:55.535364 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1428/2891] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:55.549275 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:55.550681 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:55.612839 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c357b-bf76-42e4-82ed-c079c4ab31fb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:55.616755 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663ff15-90e7-4f59-a7b9-25053ed47576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:55.617659 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663ff15-90e7-4f59-a7b9-25053ed47576 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:55.618078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663ff15-90e7-4f59-a7b9-25053ed47576 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:55.618434 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663ff15-90e7-4f59-a7b9-25053ed47576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:55.628928 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663ff15-90e7-4f59-a7b9-25053ed47576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:55.635225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663ff15-90e7-4f59-a7b9-25053ed47576 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:55.641328 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1464/2892] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:56.070096 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fc33a-4d13-4abe-8c01-530b80dd41e8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:56.071658 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c20fc33a-4d13-4abe-8c01-530b80dd41e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:56.086502 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fc33a-4d13-4abe-8c01-530b80dd41e8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:56.091019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:56.091655 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:56.091960 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:56.092252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] PATH_INFO: `/v3/projects/dca80ba4ec7a49b49fb088a7d9d6523e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:56.093369 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca80ba4ec7a49b49fb088a7d9d6523e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:56.095276 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:56.113585 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:56.206885 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca80ba4ec7a49b49fb088a7d9d6523e', 'request_id': 'req-f51ef663-01d6-450c-aebd-cf84f6083ad2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:56.213970 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca80ba4ec7a49b49fb088a7d9d6523e', 'request_id': 'req-f51ef663-01d6-450c-aebd-cf84f6083ad2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:56.273752 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca80ba4ec7a49b49fb088a7d9d6523e', 'request_id': 'req-f51ef663-01d6-450c-aebd-cf84f6083ad2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:56.285468 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] The token cache is being invalidate because project dca80ba4ec7a49b49fb088a7d9d6523e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:56:56.285779 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:56.286647 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:56.288855 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1429/2893] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:56:56 2022] DELETE /identity/v3/projects/dca80ba4ec7a49b49fb088a7d9d6523e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:56.293198 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663ff15-90e7-4f59-a7b9-25053ed47576 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:56.303415 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663ff15-90e7-4f59-a7b9-25053ed47576 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:56.365271 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:56.366187 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:56.366592 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:56.367152 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] PATH_INFO: `/v3/users/e0edcd89b6e74502a31fd2adb1a1e765` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:56.368539 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0edcd89b6e74502a31fd2adb1a1e765)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:56.370572 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:56.489042 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:56.585604 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0edcd89b6e74502a31fd2adb1a1e765'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:56.598580 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0edcd89b6e74502a31fd2adb1a1e765'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:56.681277 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0edcd89b6e74502a31fd2adb1a1e765'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:56.681924 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0edcd89b6e74502a31fd2adb1a1e765'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:56.682529 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0edcd89b6e74502a31fd2adb1a1e765'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:56.695706 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1465/2894] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:56:56 2022] DELETE /identity/v3/users/e0edcd89b6e74502a31fd2adb1a1e765 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:57.146171 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:57.148148 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:57.176029 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ef663-01d6-450c-aebd-cf84f6083ad2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:57.244679 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:57.245533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:57.245988 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:57.246451 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] PATH_INFO: `/v3/projects/5042890c6ef74bf4992fda4b2ac6c7e3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:57.248009 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5042890c6ef74bf4992fda4b2ac6c7e3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:57.250138 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:57.379692 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5042890c6ef74bf4992fda4b2ac6c7e3', 'request_id': 'req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:57.387098 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5042890c6ef74bf4992fda4b2ac6c7e3', 'request_id': 'req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:57.440489 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5042890c6ef74bf4992fda4b2ac6c7e3', 'request_id': 'req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:57.452063 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] The token cache is being invalidate because project 5042890c6ef74bf4992fda4b2ac6c7e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:56:57.452354 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:57.453062 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:57.454580 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1430/2895] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:56:57 2022] DELETE /identity/v3/projects/5042890c6ef74bf4992fda4b2ac6c7e3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:57.460015 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:57.461534 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:57.474460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2072-8161-4147-9ea5-308a00ed3aa9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:57.535186 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ee51b-b701-4791-8058-0a4833b2319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:57.535849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee51b-b701-4791-8058-0a4833b2319d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:57.536129 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee51b-b701-4791-8058-0a4833b2319d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:57.536401 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee51b-b701-4791-8058-0a4833b2319d admin admin] PATH_INFO: `/v3/users/d602b7d5202f486b975b6c1f5872ce7d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:57.538136 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ee51b-b701-4791-8058-0a4833b2319d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d602b7d5202f486b975b6c1f5872ce7d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:57.540506 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ee51b-b701-4791-8058-0a4833b2319d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:57.776388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d10ee51b-b701-4791-8058-0a4833b2319d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd602b7d5202f486b975b6c1f5872ce7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:57.789093 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d10ee51b-b701-4791-8058-0a4833b2319d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd602b7d5202f486b975b6c1f5872ce7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:57.880999 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d10ee51b-b701-4791-8058-0a4833b2319d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd602b7d5202f486b975b6c1f5872ce7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:57.882178 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d10ee51b-b701-4791-8058-0a4833b2319d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd602b7d5202f486b975b6c1f5872ce7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:57.882829 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d10ee51b-b701-4791-8058-0a4833b2319d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd602b7d5202f486b975b6c1f5872ce7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:57.896164 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1466/2896] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:56:57 2022] DELETE /identity/v3/users/d602b7d5202f486b975b6c1f5872ce7d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:58.281307 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:58.283436 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:58.297394 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9bf34-8b87-4d9a-aea6-d1b852a694d1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:58.333849 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:58.362611 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669882f0-c38e-477b-a854-777a3575f39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:58.363251 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669882f0-c38e-477b-a854-777a3575f39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:58.363534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669882f0-c38e-477b-a854-777a3575f39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:58.363905 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669882f0-c38e-477b-a854-777a3575f39d admin admin] PATH_INFO: `/v3/projects/8e2aa95483a84fd899634b99d091b645` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:58.366603 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669882f0-c38e-477b-a854-777a3575f39d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2aa95483a84fd899634b99d091b645)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:58.369232 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669882f0-c38e-477b-a854-777a3575f39d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:58.478094 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-669882f0-c38e-477b-a854-777a3575f39d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2aa95483a84fd899634b99d091b645', 'request_id': 'req-669882f0-c38e-477b-a854-777a3575f39d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:58.485083 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-669882f0-c38e-477b-a854-777a3575f39d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2aa95483a84fd899634b99d091b645', 'request_id': 'req-669882f0-c38e-477b-a854-777a3575f39d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:58.572624 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-669882f0-c38e-477b-a854-777a3575f39d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2aa95483a84fd899634b99d091b645', 'request_id': 'req-669882f0-c38e-477b-a854-777a3575f39d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:58.584280 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-669882f0-c38e-477b-a854-777a3575f39d admin admin] The token cache is being invalidate because project 8e2aa95483a84fd899634b99d091b645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:56:58.588434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-669882f0-c38e-477b-a854-777a3575f39d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:58.588434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-669882f0-c38e-477b-a854-777a3575f39d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:56:58.588434 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1431/2897] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:56:58 2022] DELETE /identity/v3/projects/8e2aa95483a84fd899634b99d091b645 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:58.592395 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882787f2-6bc4-42c5-9b2a-74927759e436 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:58.592931 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882787f2-6bc4-42c5-9b2a-74927759e436 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:58.593032 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882787f2-6bc4-42c5-9b2a-74927759e436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:58.614987 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-882787f2-6bc4-42c5-9b2a-74927759e436 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:58.617320 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-882787f2-6bc4-42c5-9b2a-74927759e436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:58.636661 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:58.680959 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1467/2898] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:58.688945 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472865ed-d042-4fed-a3a9-5e0e66ef6320 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:58.689225 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472865ed-d042-4fed-a3a9-5e0e66ef6320 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:58.689496 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472865ed-d042-4fed-a3a9-5e0e66ef6320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:58.711892 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-472865ed-d042-4fed-a3a9-5e0e66ef6320 None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:58.713186 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-472865ed-d042-4fed-a3a9-5e0e66ef6320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:58.721527 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1432/2899] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:58.726598 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882787f2-6bc4-42c5-9b2a-74927759e436 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:58.737223 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882787f2-6bc4-42c5-9b2a-74927759e436 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:58.742776 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ccfb1-0f7c-46e3-8cbe-0908d4a5edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:58.743398 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ccfb1-0f7c-46e3-8cbe-0908d4a5edde admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:58.743675 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ccfb1-0f7c-46e3-8cbe-0908d4a5edde admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:58.743978 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ccfb1-0f7c-46e3-8cbe-0908d4a5edde admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:58.744629 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ccfb1-0f7c-46e3-8cbe-0908d4a5edde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:56:58.744930 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ccfb1-0f7c-46e3-8cbe-0908d4a5edde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:58.746542 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ccfb1-0f7c-46e3-8cbe-0908d4a5edde admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:58.760314 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1468/2900] 10.222.0.91 () {58 vars in 1153 bytes} [Wed Aug 24 10:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:56:58.765022 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472865ed-d042-4fed-a3a9-5e0e66ef6320 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:58.775671 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472865ed-d042-4fed-a3a9-5e0e66ef6320 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:58.780644 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1f2be-bf68-43ab-89ba-6332fbacbbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:58.781262 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1f2be-bf68-43ab-89ba-6332fbacbbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:58.781540 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1f2be-bf68-43ab-89ba-6332fbacbbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:58.781813 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1f2be-bf68-43ab-89ba-6332fbacbbf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:58.782461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1f2be-bf68-43ab-89ba-6332fbacbbf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:58.784411 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1f2be-bf68-43ab-89ba-6332fbacbbf6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:58.896374 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1433/2901] 10.222.0.91 () {60 vars in 1153 bytes} [Wed Aug 24 10:56:58 2022] POST /identity/v3/projects => generated 399 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:56:58.901354 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ccfb1-0f7c-46e3-8cbe-0908d4a5edde admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:58.914051 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ccfb1-0f7c-46e3-8cbe-0908d4a5edde admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:58.985078 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e258bc-4e0e-4d67-b4e8-6c07e12bb1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:58.985684 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e258bc-4e0e-4d67-b4e8-6c07e12bb1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:58.985960 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e258bc-4e0e-4d67-b4e8-6c07e12bb1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:58.986225 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e258bc-4e0e-4d67-b4e8-6c07e12bb1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:58.986859 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e258bc-4e0e-4d67-b4e8-6c07e12bb1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:58.988900 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e258bc-4e0e-4d67-b4e8-6c07e12bb1f5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:59.085512 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1469/2902] 10.222.0.91 () {60 vars in 1144 bytes} [Wed Aug 24 10:56:58 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:56:59.090080 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1f2be-bf68-43ab-89ba-6332fbacbbf6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:59.101576 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1f2be-bf68-43ab-89ba-6332fbacbbf6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:59.106336 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee005d-d4f0-4e97-a178-1eaa173182aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:59.106959 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee005d-d4f0-4e97-a178-1eaa173182aa admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:59.107268 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee005d-d4f0-4e97-a178-1eaa173182aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:59.107533 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee005d-d4f0-4e97-a178-1eaa173182aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:59.108213 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee005d-d4f0-4e97-a178-1eaa173182aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:59.110074 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee005d-d4f0-4e97-a178-1eaa173182aa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:59.121037 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1434/2903] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:56:59.125487 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e258bc-4e0e-4d67-b4e8-6c07e12bb1f5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:59.136666 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e258bc-4e0e-4d67-b4e8-6c07e12bb1f5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:59.141394 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4dafb-076d-4a6a-814d-089fb414f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:59.142155 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4dafb-076d-4a6a-814d-089fb414f9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:59.142427 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4dafb-076d-4a6a-814d-089fb414f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:59.142695 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4dafb-076d-4a6a-814d-089fb414f9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:59.143425 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4dafb-076d-4a6a-814d-089fb414f9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:59.145087 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4dafb-076d-4a6a-814d-089fb414f9d1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:59.162059 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1470/2904] 10.222.0.91 () {58 vars in 1122 bytes} [Wed Aug 24 10:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:56:59.167316 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee005d-d4f0-4e97-a178-1eaa173182aa admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:59.177461 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee005d-d4f0-4e97-a178-1eaa173182aa admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:59.182652 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5151f60-54b9-40bb-a62f-6aa98ed649f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:59.183305 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5151f60-54b9-40bb-a62f-6aa98ed649f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:59.183584 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5151f60-54b9-40bb-a62f-6aa98ed649f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:59.183884 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5151f60-54b9-40bb-a62f-6aa98ed649f0 admin admin] PATH_INFO: `/v3/projects/c11bb0629d6844158435a02cfd512dfd/users/42e403f423644eacbfa1ad3e9e7d0a9a/roles/aa830dbb276f42eebec54786852e6f47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:59.200861 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5151f60-54b9-40bb-a62f-6aa98ed649f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11bb0629d6844158435a02cfd512dfd, user_id=42e403f423644eacbfa1ad3e9e7d0a9a, role_id=aa830dbb276f42eebec54786852e6f47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:59.203513 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5151f60-54b9-40bb-a62f-6aa98ed649f0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:59.283538 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1435/2905] 10.222.0.91 () {60 vars in 1483 bytes} [Wed Aug 24 10:56:59 2022] PUT /identity/v3/projects/c11bb0629d6844158435a02cfd512dfd/users/42e403f423644eacbfa1ad3e9e7d0a9a/roles/aa830dbb276f42eebec54786852e6f47 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:59.296603 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f66c7-caca-4201-828c-9ecad8fdd5c5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:59.296910 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f66c7-caca-4201-828c-9ecad8fdd5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:59.297181 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f66c7-caca-4201-828c-9ecad8fdd5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:59.328418 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-721f66c7-caca-4201-828c-9ecad8fdd5c5 None None] MFA Rules not processed for user `42e403f423644eacbfa1ad3e9e7d0a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:59.329656 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-721f66c7-caca-4201-828c-9ecad8fdd5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:59.404355 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1471/2906] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:56:59.416590 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5151f60-54b9-40bb-a62f-6aa98ed649f0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:59.418242 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e5151f60-54b9-40bb-a62f-6aa98ed649f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:59.478157 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5151f60-54b9-40bb-a62f-6aa98ed649f0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:59.482119 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573633b2-3d90-4d00-87a3-63b807dc9e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc05a509ea1c4aa582380541cfc37989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:59.482731 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573633b2-3d90-4d00-87a3-63b807dc9e93 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:59.483012 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573633b2-3d90-4d00-87a3-63b807dc9e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:59.483288 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573633b2-3d90-4d00-87a3-63b807dc9e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:59.493158 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573633b2-3d90-4d00-87a3-63b807dc9e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:59.494595 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573633b2-3d90-4d00-87a3-63b807dc9e93 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:59.503640 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1436/2907] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:57:05.441474 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f66c7-caca-4201-828c-9ecad8fdd5c5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:57:05.462025 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:57:05.504817 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f66c7-caca-4201-828c-9ecad8fdd5c5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:57:05.509498 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:57:05.527144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:57:05.527144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:57:05.527144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] PATH_INFO: `/v3/users/42e403f423644eacbfa1ad3e9e7d0a9a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:57:05.527144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e403f423644eacbfa1ad3e9e7d0a9a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:57:05.527144 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:57:05.728460 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e403f423644eacbfa1ad3e9e7d0a9a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:57:05.741385 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e403f423644eacbfa1ad3e9e7d0a9a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:57:05.805997 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e403f423644eacbfa1ad3e9e7d0a9a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:57:05.806680 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e403f423644eacbfa1ad3e9e7d0a9a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:57:05.807463 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e403f423644eacbfa1ad3e9e7d0a9a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:57:05.821121 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1472/2908] 10.222.0.91 () {58 vars in 1224 bytes} [Wed Aug 24 10:57:05 2022] DELETE /identity/v3/users/42e403f423644eacbfa1ad3e9e7d0a9a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:57:05.825744 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee4f28-3f1f-4754-b6db-1506e0cccefc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:57:05.826266 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee4f28-3f1f-4754-b6db-1506e0cccefc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:57:05.826386 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee4f28-3f1f-4754-b6db-1506e0cccefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:57:05.833406 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:57:05.846772 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e8ee4f28-3f1f-4754-b6db-1506e0cccefc None None] MFA Rules not processed for user `9c9fa0b484ce4f7bb377c75f947c0872`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:57:05.848019 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e8ee4f28-3f1f-4754-b6db-1506e0cccefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:57:05.912529 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1437/2909] 10.222.0.91 () {58 vars in 958 bytes} [Wed Aug 24 10:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:57:05.923388 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:57:05.924849 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:57:05.988921 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5595-7562-4bdb-a4c2-0e988d7ddbfa admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:57:05.992860 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a41afa-526f-4ef6-9f9f-e49b6df4a0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8956453f963242a087d2f90d70ed8f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:57:05.993475 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a41afa-526f-4ef6-9f9f-e49b6df4a0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:57:05.993958 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a41afa-526f-4ef6-9f9f-e49b6df4a0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:57:05.994578 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a41afa-526f-4ef6-9f9f-e49b6df4a0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:57:06.005760 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a41afa-526f-4ef6-9f9f-e49b6df4a0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:57:06.007295 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a41afa-526f-4ef6-9f9f-e49b6df4a0d4 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:57:06.019211 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1473/2910] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:57:06.490998 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee4f28-3f1f-4754-b6db-1506e0cccefc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:57:06.496318 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e8ee4f28-3f1f-4754-b6db-1506e0cccefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:57:06.510443 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee4f28-3f1f-4754-b6db-1506e0cccefc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:57:06.518404 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb15ea-33c8-4fae-a758-ddad059034f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9fa0b484ce4f7bb377c75f947c0872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8164e47598a34978921b5d7bbf1d90ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:57:06.519056 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb15ea-33c8-4fae-a758-ddad059034f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:57:06.519334 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb15ea-33c8-4fae-a758-ddad059034f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:57:06.519600 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb15ea-33c8-4fae-a758-ddad059034f7 admin admin] PATH_INFO: `/v3/projects/c11bb0629d6844158435a02cfd512dfd` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:57:06.520910 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb15ea-33c8-4fae-a758-ddad059034f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11bb0629d6844158435a02cfd512dfd)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:57:06.524964 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb15ea-33c8-4fae-a758-ddad059034f7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:57:06.636072 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cbdb15ea-33c8-4fae-a758-ddad059034f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11bb0629d6844158435a02cfd512dfd', 'request_id': 'req-cbdb15ea-33c8-4fae-a758-ddad059034f7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:57:06.642775 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cbdb15ea-33c8-4fae-a758-ddad059034f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11bb0629d6844158435a02cfd512dfd', 'request_id': 'req-cbdb15ea-33c8-4fae-a758-ddad059034f7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:57:06.714933 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cbdb15ea-33c8-4fae-a758-ddad059034f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11bb0629d6844158435a02cfd512dfd', 'request_id': 'req-cbdb15ea-33c8-4fae-a758-ddad059034f7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:57:06.726976 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cbdb15ea-33c8-4fae-a758-ddad059034f7 admin admin] The token cache is being invalidate because project c11bb0629d6844158435a02cfd512dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:57:06.727252 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cbdb15ea-33c8-4fae-a758-ddad059034f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:57:06.727994 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cbdb15ea-33c8-4fae-a758-ddad059034f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:57:06.729534 dv-cinder-854274-2-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1438/2911] 10.222.0.91 () {58 vars in 1233 bytes} [Wed Aug 24 10:57:06 2022] DELETE /identity/v3/projects/c11bb0629d6844158435a02cfd512dfd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:57:16.013948 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=70,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:57:16.723387 dv-cinder-854274-2-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:18.638235 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a41afa-526f-4ef6-9f9f-e49b6df4a0d4 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:18.640034 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e5a41afa-526f-4ef6-9f9f-e49b6df4a0d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:18.718467 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a41afa-526f-4ef6-9f9f-e49b6df4a0d4 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:18.788446 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421cbec-ffd8-4058-8cb8-f1b1ed07405c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebfb233b2504463a4ee9202b5a3ab50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acd807f8a28d43cdac159fa3d606af60', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:18.789065 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421cbec-ffd8-4058-8cb8-f1b1ed07405c service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:18.789349 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421cbec-ffd8-4058-8cb8-f1b1ed07405c service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:18.789618 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421cbec-ffd8-4058-8cb8-f1b1ed07405c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:18.791410 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c421cbec-ffd8-4058-8cb8-f1b1ed07405c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:18.804350 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421cbec-ffd8-4058-8cb8-f1b1ed07405c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:18.805976 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421cbec-ffd8-4058-8cb8-f1b1ed07405c service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:18.817085 dv-cinder-854274-2-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1474/2912] 10.222.0.91 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:28.812018 dv-cinder-854274-2-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=58 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}